What does noindex mean, and could it be hiding my website?

Answers · More Than Normal, Canterbury

The short answer

A noindex rule is an instruction on a web page that tells Google and other search engines not to show that page in search results. If it is left switched on by mistake after a website build or redesign, it can keep your entire site hidden from Google.

Yes, it can hide a live website, and it is one of the first things to check if your site does not appear on Google at all.

A noindex rule is a short instruction placed in a page’s code or server response that tells search engines not to include that page in search results. As Google’s guide to blocking indexing explains, when Googlebot crawls a page and sees noindex, Google drops that page from its search results completely.

How does noindex get onto a page?

Website builders and developers use noindex on purpose for pages that should stay out of Google, such as checkout pages, internal search results, thank-you pages or a private test version of a new website. Google lists two ways it can be added.

  • A meta tag in the page’s HTML <head>, written as <meta name="robots" content="noindex"> (or targeting googlebot specifically).
  • An X-Robots-Tag HTTP header sent by the server, often used for PDFs or non-HTML files, written as X-Robots-Tag: noindex.

Many content management systems and website builders also expose a search visibility tick-box in their settings, as Google’s robots.txt guide notes, rather than asking you to edit code by hand. A common trap when launching a new or redesigned site is forgetting to untick that “hide from search engines” option when the site goes live.

How do you check if your site has noindex?

You do not need to read raw HTML to check, though you can view a page’s source in your browser and search for noindex if you know how. The clearest check is inside Google Search Console, which Google provides as a free service.

One detail catches people out. Google says that if a URL is also blocked in robots.txt, Googlebot cannot crawl the page to see a noindex rule, so the URL Inspection tool will still report “Yes” under “Indexing allowed?” even if noindex is sitting in the page’s code.

What should you do if you find it by mistake?

If your public pages are marked noindex by accident, remove the tag, header or search-visibility setting on your website, then test the live URL again in the URL Inspection tool and request indexing. Google still has to recrawl the page before it can appear, and our answer on how long it takes to show up on Google explains how long that stage normally takes.

If you want a second pair of eyes across your whole site, our SEO audit checks indexing, noindex rules and robots.txt alongside your key pages.

Sources

Where a claim depends on how Google or another company says something works, we link to their own words so you can check it.

  1. Block Search indexing with noindex, Google Search Central. Supports how noindex works via a meta tag or X-Robots-Tag HTTP header, and that Googlebot must be able to crawl the page to see it.
  2. URL Inspection tool, Google Search Console Help. Supports checking 'Indexing allowed?' in Search Console to see whether a page is blocked by noindex.
  3. About Search Console, Google Search Console Help. Supports that Google Search Console is a free service for checking indexing problems and requesting re-indexing.
  4. Introduction to robots.txt, Google Search Central. Supports that website builders may expose a search visibility setting instead of raw files, and how robots.txt differs from noindex.

About this answer. We are an independent studio and this is our own research, experience and opinion, shared as general guidance. It is not legal, financial or other professional advice, and what works for one business may not work for another. Where the law or a regulator is involved, check the official guidance for your situation or ask a qualified adviser. Our sources are listed above.

Get our new answers by email

One short email a week with the answers we've published. Unsubscribe with one click.

We email you a link to confirm first. See our privacy notice.

Want to know where your website stands

A written SEO audit shows what to fix first, in order of priority, for £450.

Get an SEO auditBook a discovery call

No obligation, and we reply by email.