New: monitor which AI crawlers actually visit your site with Sona Agent Analytics  |  See the platform →

Free noindex checker

Find out whether a page is hidden from Google, Bing and AI search. We check the meta robots tag, the X-Robots-Tag header and crawler-specific tags in one go.

How it works

1. Fetch: We load your page the way a browser does, following redirects.

2. Read: We read the meta robots tag, the X-Robots-Tag header, and crawler-specific meta tags like googlebot and bingbot.

3. Verdict: If anything says noindex or none - or the page returns an error status - you see exactly which directive is responsible.

Noindex Checker FAQs

What is a noindex tag?

noindex is a directive that tells search engines not to show a page in their results. It can be set in the page's HTML as <meta name="robots" content="noindex">, or sent as an HTTP header: X-Robots-Tag: noindex. Crawlers that see it still fetch the page, but drop it from their index.

What does the noindex checker look at?

It loads your page like a browser and reads three places: the meta robots tag, the X-Robots-Tag response header, and crawler-specific meta tags such as <meta name="googlebot">. It also flags the "none" directive (shorthand for noindex, nofollow) and error status codes, which keep a page out of search whatever its tags say.

Why is my page noindexed when the HTML looks fine?

Check the X-Robots-Tag header - it's set by your server or CDN, not in the HTML, so it's easy to miss. Staging configs copied to production and SEO plugin settings are the other common causes.

Is noindex the same as blocking a page in robots.txt?

No. robots.txt stops crawlers fetching a page; noindex lets them fetch it but keeps it out of the index. Don't combine them on the same page: if robots.txt blocks the page, crawlers never see the noindex, and the URL can still appear in results from links elsewhere. Our Robots.txt Tester checks the robots.txt side.

Does noindex affect AI search engines?

Yes. Google's AI Overviews and AI Mode draw on Google's index, and Bing's index feeds Copilot and other assistants, so a noindexed page is generally left out of AI answers built on them too.

Why does the checker say it couldn't check my page?

Your site's bot protection returned an error (such as HTTP 403) to our checker. That response is a block page, not your real page, so its tags would tell you nothing - we say so rather than guess.

Can AI crawlers actually reach you?

This tool checks one thing. The free AI Crawl Checker tests 45 AI crawlers live against your page - robots.txt, firewalls, rate limits, noindex, sitemaps and more - and gives you the fix for each one that fails.

Want to see which AI bots actually visit, continuously? Try Sona Agent Analytics or book a demo.