Google: Noindexed Pages Do Not Impact Crawl Spending Plan

Posted by

Google’s Browse Relations team verifies that noindexed pages don’t adversely affect a website’s crawl budget, no matter the number of a website has.

This topic is attended to not once but thrice throughout the November 2022 edition of Google’s SEO office-hours Q&A session.

Google Browse Supporters John Mueller and Gary Illyes take turns addressing three similar concerns from individuals worried they have too many noindexed pages on their sites.

From Mueller’s and Illyes’ responses, we find out there’s no such thing as “too many” indexed pages. Even more, unless your site has over a million pages, there’s no requirement to stress over crawl budget plan.

Here’s a fast wrap-up of each concern and response.

Concern 1: Excessive Indexed Pages

At the 8:23 mark in Google’s November 2022 office-hours, Illyes addresses a question asking if an “excessive” variety of indexed pages is a problem for discovery or indexed.

Illyes states noindex is a tool to assist sites keep content out of search engines. Google motivates using the noindex tag when required, and for that reason, there are no negative effects related to it.

“Noindex is a really powerful tool that online search engine support to help you, this site owner, keep material out of their indexes. For this factor, it doesn’t carry any unintended impacts when it concerns crawling and indexing. For example, having lots of pages with noindex will not affect how Google crawls and indexes your site.”

Concern 2: Ratio Of Indexed/Noindexed Pages

The following question shows up at the 10:22 mark:

“Should we watch on the ratio between indexed and non-indexed pages in Search Console in order to better acknowledge possibly wasted crawl budget plan on non-indexed pages?”

Mueller unmasks that websites ought to attempt to balance their indexed and nonindexed pages.

To that end, crawl budget plan is a factor that few sites require to think of; Mueller says:

“No, there is no magic ratio to keep an eye out for. Also, for a site that’s not massive, with less than a million pages, possibly, you actually do not require to worry about the crawl spending plan of your site. It’s fine to eliminate unneeded internal links, however for little to medium-sized websites, that’s more of a website health topic than an SEO one.”

Concern 3: Noindexed Pages Linked From Spammy Sites

At the 11:26 mark, a question shows up about no indexed pages that’s somewhat different from the previous two.

The question checks out:

“A great deal of SEOs are grumbling about having countless URLs flagged as left out by noindex in Google Search Console. All to nonsense internal search pages connected from spammy sites. Is this a problem for crawl budget?”

Ilyes repeats the earlier point about noindex being a tool for sites to utilize as needed.

Assuming the pages are purposefully noindexed, there’s no requirement to fret about Search Console flagging them. It doesn’t suggest you’re doing anything wrong.

Illyes states:

“Noindex is there to help you keep things out of the index, and it doesn’t included unintended negative impacts, as we stated previously. If you want to guarantee that those pages or their URLs, more particularly, do not end up in Google’s index, continue utilizing noindex and don’t stress over crawl budget.”

Source: Google