chalec
/
ctrlv-privatebin
6
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

Incorrect structure 

The structure for robots.txt is incorrect for some/most search engines.
This commit is contained in:
ic0nic 2013-11-01 01:22:16 +01:00 committed by Simon Rupf
parent 3b3a841be6
commit c918a9fe2e
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
robots.txt
View File

@ -1,4 +1,4 @@
# Might as well keep robots away for performance and privacy reasons. # Might as well keep robots away for performance and privacy reasons.
User-agent: * User-agent: *
Disallow: /
Allow: /index.php Allow: /index.php
Disallow: /