Quite possibly the best Robots.txt file ever.
Courtesy of Last.fm, h/t Nick Halstead.
Original title and link for this post: Quite possibly the best Robots.txt file ever.
Courtesy of Last.fm, h/t Nick Halstead.
Original title and link for this post: Quite possibly the best Robots.txt file ever.
