Google: Noindexed Pages Do Not Impact Crawl Budget

Posted by

Google’s Search Relations team confirms that noindexed pages do not adversely affect a site’s crawl budget plan, no matter how many a site has.

This topic is attended to not when however thrice during the November 2022 edition of Google’s SEO office-hours Q&A session.

Google Search Supporters John Mueller and Gary Illyes take turns responding to three similar questions from people concerned they have a lot of noindexed pages on their sites.

From Mueller’s and Illyes’ reactions, we learn there’s no such thing as “a lot of” indexed pages. Further, unless your site has more than a million pages, there’s no need to worry about crawl budget plan.

Here’s a quick wrap-up of each concern and response.

Question 1: Excessive Indexed Pages

At the 8:23 mark in Google’s November 2022 office-hours, Illyes addresses a concern asking if an “excessive” variety of indexed pages is an issue for discovery or indexed.

Illyes says noindex is a tool to assist websites keep material out of online search engine. Google motivates utilizing the noindex tag when needed, and because of that, there are no unfavorable effects associated with it.

“Noindex is an extremely powerful tool that search engines support to help you, this site owner, keep material out of their indexes. For this factor, it does not bring any unintended impacts when it pertains to crawling and indexing. For instance, having many pages with noindex will not affect how Google crawls and indexes your website.”

Question 2: Ratio Of Indexed/Noindexed Pages

The following question comes up at the 10:22 mark:

“Should we keep an eye on the ratio in between indexed and non-indexed pages in Browse Console in order to much better recognize possibly lost crawl spending plan on non-indexed pages?”

Mueller debunks that websites ought to try to stabilize their indexed and nonindexed pages.

To that end, crawl spending plan is a factor that few websites require to think about; Mueller states:

“No, there is no magic ratio to watch out for. Also, for a website that’s not massive, with less than a million pages, possibly, you really do not need to stress over the crawl budget plan of your site. It’s fine to remove unneeded internal links, but for little to medium-sized websites, that’s more of a site hygiene subject than an SEO one.”

Concern 3: Noindexed Pages Linked From Spammy Sites

At the 11:26 mark, a question comes up about no indexed pages that’s somewhat different from the previous 2.

The question reads:

“A great deal of SEOs are complaining about having millions of URLs flagged as left out by noindex in Google Search Console. All to rubbish internal search pages connected from spammy sites. Is this a problem for crawl spending plan?”

Ilyes reiterates the earlier point about noindex being a tool for websites to utilize as required.

Presuming the pages are deliberately noindexed, there’s no need to worry about Browse Console flagging them. It does not imply you’re doing anything incorrect.

Illyes states:

“Noindex is there to assist you keep things out of the index, and it doesn’t come with unexpected unfavorable impacts, as we said previously. If you want to make sure that those pages or their URLs, more specifically, don’t end up in Google’s index, continue utilizing noindex and do not fret about crawl budget plan.”

Source: Google