web/robots.txt
author cavaliet@caf4f556-3d62-0410-8435-a86758001935
Fri, 21 Aug 2009 17:09:26 +0000
branchdrupal
changeset 76 9f571ade50dc
parent 63 fa0f2b7c40eb
child 136 bde1974c263b
permissions -rw-r--r--
take off not useful anymore files
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
63
fa0f2b7c40eb Add robots.txt and increase version number
ymh@caf4f556-3d62-0410-8435-a86758001935
parents:
diff changeset
     1
User-agent: *
fa0f2b7c40eb Add robots.txt and increase version number
ymh@caf4f556-3d62-0410-8435-a86758001935
parents:
diff changeset
     2
Disallow: /dev/
fa0f2b7c40eb Add robots.txt and increase version number
ymh@caf4f556-3d62-0410-8435-a86758001935
parents:
diff changeset
     3
Disallow: /wiki/
fa0f2b7c40eb Add robots.txt and increase version number
ymh@caf4f556-3d62-0410-8435-a86758001935
parents:
diff changeset
     4
Allow: /