web/robots.txt
author cavaliet
Fri, 24 Aug 2012 13:12:16 +0200
changeset 102 75fb1d1aa426
parent 0 7f95f8617b0b
permissions -rwxr-xr-x
update readme
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
0
7f95f8617b0b first commit
ymh <ymh.work@gmail.com>
parents:
diff changeset
     1
# www.robotstxt.org/
7f95f8617b0b first commit
ymh <ymh.work@gmail.com>
parents:
diff changeset
     2
# www.google.com/support/webmasters/bin/answer.py?hl=en&answer=156449
7f95f8617b0b first commit
ymh <ymh.work@gmail.com>
parents:
diff changeset
     3
7f95f8617b0b first commit
ymh <ymh.work@gmail.com>
parents:
diff changeset
     4
User-agent: *