web/robots.txt
author ymh <ymh.work@gmail.com>
Tue, 20 Mar 2018 13:31:04 +0100
changeset 375 4889e93fcfad
parent 304 8f398367060a
permissions -rw-r--r--
Add try catch to avoid stopping when processing objects
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
304
8f398367060a add error pages+ robots.txt
ymh <ymh.work@gmail.com>
parents:
diff changeset
     1
User-agent: *
8f398367060a add error pages+ robots.txt
ymh <ymh.work@gmail.com>
parents:
diff changeset
     2
Disallow: /