web/robots.txt
author cavaliet
Wed, 26 Oct 2011 15:39:04 +0200
changeset 16 89a003e5b108
parent 0 7f95f8617b0b
permissions -rwxr-xr-x
Update routing and templates for tag list.
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
0
7f95f8617b0b first commit
ymh <ymh.work@gmail.com>
parents:
diff changeset
     1
# www.robotstxt.org/
7f95f8617b0b first commit
ymh <ymh.work@gmail.com>
parents:
diff changeset
     2
# www.google.com/support/webmasters/bin/answer.py?hl=en&answer=156449
7f95f8617b0b first commit
ymh <ymh.work@gmail.com>
parents:
diff changeset
     3
7f95f8617b0b first commit
ymh <ymh.work@gmail.com>
parents:
diff changeset
     4
User-agent: *