web/robots.txt
author hurons@caf4f556-3d62-0410-8435-a86758001935
Mon, 17 May 2010 18:48:26 +0000
changeset 188 b0b8aadf573f
parent 136 bde1974c263b
permissions -rw-r--r--
bug header menu lang version 2
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
63
fa0f2b7c40eb Add robots.txt and increase version number
ymh@caf4f556-3d62-0410-8435-a86758001935
parents:
diff changeset
     1
User-agent: *
fa0f2b7c40eb Add robots.txt and increase version number
ymh@caf4f556-3d62-0410-8435-a86758001935
parents:
diff changeset
     2
Disallow: /dev/
fa0f2b7c40eb Add robots.txt and increase version number
ymh@caf4f556-3d62-0410-8435-a86758001935
parents:
diff changeset
     3
Disallow: /wiki/
136
bde1974c263b merge from wordpress
ymh@caf4f556-3d62-0410-8435-a86758001935
parents: 63
diff changeset
     4
Disallow: /wp-admin/
63
fa0f2b7c40eb Add robots.txt and increase version number
ymh@caf4f556-3d62-0410-8435-a86758001935
parents:
diff changeset
     5
Allow: /