src/cm/media/robots.txt
author Production Moz <dev@sopinspace.com>
Wed, 04 Sep 2013 22:11:01 +0200
changeset 529 5eeed336b992
parent 0 40c8f766c9b8
permissions -rw-r--r--
Filter by category should also be tested for undefined (and not just empty string) in case no category has been defined.
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
0
40c8f766c9b8 import from internal svn r 4007
raph
parents:
diff changeset
     1
User-Agent: *
40c8f766c9b8 import from internal svn r 4007
raph
parents:
diff changeset
     2
Disallow: /jsi18n/
40c8f766c9b8 import from internal svn r 4007
raph
parents:
diff changeset
     3
Disallow: /text/
40c8f766c9b8 import from internal svn r 4007
raph
parents:
diff changeset
     4
Disallow: /admin/
40c8f766c9b8 import from internal svn r 4007
raph
parents:
diff changeset
     5
Disallow: /media/
40c8f766c9b8 import from internal svn r 4007
raph
parents:
diff changeset
     6
Disallow: /site_media/