common/corpus-common-addon/tests/dummy/public/robots.txt
author ymh <ymh.work@gmail.com>
Fri, 17 Nov 2017 09:10:53 +0100
changeset 559 104313c0de25
parent 127 5cd8c3065c38
permissions -rw-r--r--
Added tag 0.0.24 for changeset 64c4050f6a36
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
127
5cd8c3065c38 extract common functionalities to common module. First application to lexvo name resolving
ymh <ymh.work@gmail.com>
parents:
diff changeset
     1
# http://www.robotstxt.org
5cd8c3065c38 extract common functionalities to common module. First application to lexvo name resolving
ymh <ymh.work@gmail.com>
parents:
diff changeset
     2
User-agent: *
5cd8c3065c38 extract common functionalities to common module. First application to lexvo name resolving
ymh <ymh.work@gmail.com>
parents:
diff changeset
     3
Disallow: