Skip to content

Diagnose a page not indexed by Google

Short answer

Start with URL Inspection, then check robots.txt, noindex rules and Google's chosen canonical, in that order. Google never guarantees indexing, so a page can meet every requirement and still be left out. A page missing from the index is also missing from AI Overviews and AI Mode.

  • Search Console access for the property that contains the URL.
  • The exact URL, including protocol and trailing slash, as users reach it.

Work through the following steps in the order of the Page indexing fields (URL Inspection tool).

If Crawl allowed? is “No” and you want the page indexed, remove the blocking rule (robots.txt). If you want the page out of results, robots.txt is the wrong tool. See step 3.

If Indexing allowed? is “No”, find the noindex in the <meta name="robots"> tag or the X-Robots-Tag header and remove it. Templates, CMS settings and staging configuration are the usual source.

If Google-selected canonical is a different URL, Google has indexed that one instead. That is correct if the pages are duplicates. If it isn’t, make the signals agree: canonical tag, internal links and sitemap all pointing at the URL you want (Canonical URL signals).

At this point the question is whether the page is worth indexing. See People-first content.

  • Run Test live URL after each fix. Then request indexing for that one URL, or resubmit the sitemap for many.
  • Re-inspect after Google recrawls. Requesting indexing has a daily limit and doesn’t guarantee indexing.
  • Reading “URL is on Google” as proof the page shows in results. It means eligible. Search for the URL to check.
  • Blocking a page in robots.txt and adding noindex. Google never sees the noindex.
  • Requesting indexing repeatedly instead of fixing the cause.

To appear as a supporting link in AI Overviews or AI Mode, a page must be indexed and eligible to show with a snippet (Google AI Overviews). A page missing from the index is missing there too.

Sources

  1. URL Inspection toolGoogle Search Console Help · official · ✓ 2026-10-26
  2. In-depth guide to how Google Search worksGoogle Search Central · official · ✓ 2026-10-25
  3. Introduction to robots.txtGoogle Search Central · official · ✓ 2026-10-24
  4. Block Search indexing with noindexGoogle Search Central · official · ✓ 2026-10-25
  5. How to specify a canonical URL with rel="canonical" and other methodsGoogle Search Central · official · ✓ 2026-10-24