Google: Noindexed Pages Do Not Effect Crawl Budget

Posted by

Google’s Browse Relations group validates that noindexed pages do not adversely impact a site’s crawl spending plan, no matter the number of a site has.

This topic is resolved not once but thrice throughout the November 2022 edition of Google’s SEO office-hours Q&A session.

Google Search Advocates John Mueller and Gary Illyes take turns answering three similar questions from individuals worried they have too many noindexed pages on their sites.

From Mueller’s and Illyes’ actions, we find out there’s no such thing as “a lot of” indexed pages. Further, unless your website has more than a million pages, there’s no requirement to worry about crawl budget.

Here’s a fast recap of each question and answer.

Concern 1: Excessive Indexed Pages

At the 8:23 mark in Google’s November 2022 office-hours, Illyes addresses a concern asking if an “extreme” variety of indexed pages is a problem for discovery or indexed.

Illyes states noindex is a tool to assist sites keep material out of search engines. Google motivates using the noindex tag when required, and for that reason, there are no negative effects associated with it.

“Noindex is a very powerful tool that search engines support to help you, this website owner, keep material out of their indexes. For this reason, it doesn’t carry any unexpected effects when it concerns crawling and indexing. For example, having lots of pages with noindex will not affect how Google crawls and indexes your website.”

Concern 2: Ratio Of Indexed/Noindexed Pages

The following concern comes up at the 10:22 mark:

“Should we watch on the ratio between indexed and non-indexed pages in Browse Console in order to much better acknowledge potentially lost crawl budget plan on non-indexed pages?”

Mueller unmasks that websites should attempt to stabilize their indexed and nonindexed pages.

To that end, crawl spending plan is an aspect that couple of sites need to consider; Mueller says:

“No, there is no magic ratio to keep an eye out for. Likewise, for a website that’s not massive, with less than a million pages, perhaps, you truly do not need to fret about the crawl budget plan of your site. It’s great to remove unneeded internal links, however for small to medium-sized sites, that’s more of a website hygiene topic than an SEO one.”

Concern 3: Noindexed Pages Linked From Spammy Sites

At the 11:26 mark, a question turns up about no indexed pages that’s slightly different from the previous two.

The question reads:

“A lot of SEOs are complaining about having countless URLs flagged as left out by noindex in Google Search Console. All to nonsense internal search pages linked from spammy sites. Is this an issue for crawl budget?”

Ilyes restates the earlier point about noindex being a tool for sites to utilize as required.

Presuming the pages are purposefully noindexed, there’s no need to stress over Browse Console flagging them. It does not indicate you’re doing anything incorrect.

Illyes states:

“Noindex is there to assist you keep things out of the index, and it doesn’t come with unintentional negative effects, as we stated previously. If you want to guarantee that those pages or their URLs, more specifically, do not end up in Google’s index, continue utilizing noindex and do not worry about crawl spending plan.”

Source: Google