web/robots.txt
author ymh <ymh.work@gmail.com>
Mon, 17 Oct 2011 13:49:59 +0200
changeset 9 41a9fa70a47b
parent 0 7f95f8617b0b
permissions -rwxr-xr-x
continue to implement example app
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
0
7f95f8617b0b first commit
ymh <ymh.work@gmail.com>
parents:
diff changeset
     1
# www.robotstxt.org/
7f95f8617b0b first commit
ymh <ymh.work@gmail.com>
parents:
diff changeset
     2
# www.google.com/support/webmasters/bin/answer.py?hl=en&answer=156449
7f95f8617b0b first commit
ymh <ymh.work@gmail.com>
parents:
diff changeset
     3
7f95f8617b0b first commit
ymh <ymh.work@gmail.com>
parents:
diff changeset
     4
User-agent: *