web/robots.txt
author ymh@caf4f556-3d62-0410-8435-a86758001935
Fri, 12 Feb 2010 21:20:30 +0000
changeset 145 b32456a13924
parent 136 bde1974c263b
permissions -rw-r--r--
Remove unwanted files
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
63
fa0f2b7c40eb Add robots.txt and increase version number
ymh@caf4f556-3d62-0410-8435-a86758001935
parents:
diff changeset
     1
User-agent: *
fa0f2b7c40eb Add robots.txt and increase version number
ymh@caf4f556-3d62-0410-8435-a86758001935
parents:
diff changeset
     2
Disallow: /dev/
fa0f2b7c40eb Add robots.txt and increase version number
ymh@caf4f556-3d62-0410-8435-a86758001935
parents:
diff changeset
     3
Disallow: /wiki/
136
bde1974c263b merge from wordpress
ymh@caf4f556-3d62-0410-8435-a86758001935
parents: 63
diff changeset
     4
Disallow: /wp-admin/
63
fa0f2b7c40eb Add robots.txt and increase version number
ymh@caf4f556-3d62-0410-8435-a86758001935
parents:
diff changeset
     5
Allow: /