chalec
/
ctrlv-privatebin
6
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

Revert order change 

According to Wikipedia this is indeed right.. https://en.wikipedia.org/wiki/Robots_exclusion_standard#Allow_directive

Then there are only many wrong examples out there.
This commit is contained in:
rugk 2016-07-03 13:09:47 +02:00 committed by GitHub
parent 0567a720fd
commit a5730b701c
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
robots.txt
View File

@ -1,4 +1,4 @@
# Might as well keep robots away for performance and privacy reasons. # Might as well keep robots away for performance and privacy reasons.
User-agent: * User-agent: *
Disallow: /
Allow: /index.php Allow: /index.php
Disallow: /