← Back to Submind

Topic

robots.txt

Should you block your Search result pages?

Google Search Central

The main subject of this discussion is the management of internal search result pages on websites that are crawled by Googlebot. While having a site-wide search feature can be useful for users navigating large content libraries, these dynamically generated pages often create what Google refers to as …