Page MenuHomePhorge

Disallow webcrawlers to follow Paste line number anchor links
Closed, ResolvedPublic


Paste provides line anchor links in every single line of a paste, e.g. the line number in line 60 of links to$60.
It makes no sense for crawlers to follow such links as they'll index the very same document again.
Thus robots.txt should be adjusted accordingly.