web/robots.txt
author ymh@caf4f556-3d62-0410-8435-a86758001935
Wed, 22 Jul 2009 08:13:44 +0000
changeset 63 fa0f2b7c40eb
child 136 bde1974c263b
permissions -rw-r--r--
Add robots.txt and increase version number
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
63
fa0f2b7c40eb Add robots.txt and increase version number
ymh@caf4f556-3d62-0410-8435-a86758001935
parents:
diff changeset
     1
User-agent: *
fa0f2b7c40eb Add robots.txt and increase version number
ymh@caf4f556-3d62-0410-8435-a86758001935
parents:
diff changeset
     2
Disallow: /dev/
fa0f2b7c40eb Add robots.txt and increase version number
ymh@caf4f556-3d62-0410-8435-a86758001935
parents:
diff changeset
     3
Disallow: /wiki/
fa0f2b7c40eb Add robots.txt and increase version number
ymh@caf4f556-3d62-0410-8435-a86758001935
parents:
diff changeset
     4
Allow: /