ctrlv-privatebin/robots.txt

# "A robots.txt a day keeps the robots away."
# (for performance and privacy reasons)
#
# Note: To be effective this robots.txt must be put into the root of your server
# directory.

User-agent: *
Disallow: /
Some rewording 2016-07-19 13:05:07 +02:00			`# "A robots.txt a day keeps the robots away."`
			`# (for performance and privacy reasons)`
			`#`
			`# Note: To be effective this robots.txt must be put into the root of your server`
			`# directory.`

For server-load and privacy reasons, disallow robots. 2012-08-02 17:23:04 +02:00			`User-agent: *`
Revert order change According to Wikipedia this is indeed right.. https://en.wikipedia.org/wiki/Robots_exclusion_standard#Allow_directive Then there are only many wrong examples out there. 2016-07-03 13:09:47 +02:00			`Disallow: /`