# UKBike global robots.txt file # # This file is used to allow crawlers to index our site. # It is NOT used for any other purpose, such as filtering # impressions or clicks. User-Agent: * Sitemap: http://www.ukbike.com/sitemap.xml.gz #User-agent: * #Disallow: */SearchResults.aspx~user* #User-agent: * #Disallow: */SearchResults.aspx~print~true~user* User-agent: * Disallow: */SearchResults.aspx* User-agent: * Disallow: *//~page~*