New: monitor which AI crawlers actually visit your site with Sona Agent Analytics  |  See the platform →
Check for noindex

Free noindex checker

Find out whether a page is hidden from Google, Bing and AI search. We check the meta robots tag, the X-Robots-Tag header and crawler-specific tags in one go.

Check one page in seconds and see which directive hides it.

Sample resultyoursite.com
Noindexed
Meta robots tag
noindex
X-Robots-Tag header
not set
Crawler tags
not set
15%–25%
Estimated drop in organic web traffic from zero-click AI search
Source: Bain & Company, 2025
6×
ChatGPT visitors convert better than traditional Google search
Source: Webflow, 2025
50%
Of U.S. consumers now intentionally use AI-powered search
Source: McKinsey AI Discovery Survey, 2025
94%
Of B2B buyers now use AI while researching a purchase
Source: Forrester, Buyers' Journey Survey 2025
The problem

A stray noindex goes unnoticed, and nobody tells you.

  • A noindex tag left over from staging
  • A header set by your server or CDN
  • A page that returns an error status
  • Pages missing from Google, Bing and AI answers
The solution

Sona shows you which directive is responsible.

  • The meta robots tag checked
  • The X-Robots-Tag header checked
  • Crawler tags like googlebot and bingbot checked
  • The exact directive named
Check page
The basics

What is a noindex tag?

A noindex tag tells search engines to leave a page out of their results. It can sit in the page's HTML or in a server response header. The page stays live for visitors, but it does not show up in search.

This is step one, not the finish line. A page also needs clear structure and tags AI engines can read. This free checker looks at noindex directives. The free AI Crawl Checker tests whether AI crawlers can reach your site.

How it works

Check your page in three steps

Three steps from page URL to verdict.

1

Fetch

We load your page the way a browser does. Redirects are followed.

2

Read

We read the meta robots tag and the X-Robots-Tag header. We also read crawler-specific meta tags like googlebot and bingbot.

3

Verdict

If anything says noindex or none, or the page returns an error status, the page is flagged. You see exactly which directive is responsible.

Crawl & indexing tool

What this checks

We read the meta robots tag, the X-Robots-Tag header, and crawler-specific meta tags like googlebot and bingbot.

Where it looks

The three places it reads.

  • The meta robots tag
  • The X-Robots-Tag response header
  • Crawler-specific tags such as googlebot

What it flags

What keeps a page out of search.

  • noindex
  • The "none" directive (shorthand for noindex, nofollow)
  • Error status codes

How the page loads

How the page is fetched.

  • Like a browser
  • Redirects are followed

If anything says noindex or none - or the page returns an error status - you see exactly which directive is responsible.

Real impact

See the difference removing noindex makes

The same page, before and after the fix.

BEFOREFail
  • meta robots: noindex
  • X-Robots-Tag: noindex
1 directive removed
AFTER THE FIXPass
  • No noindex directive
  • the page can be indexed
Why it matters

Why noindex matters

A noindex tag quietly removes a page from search.

Left out of AI answers

A noindexed page is generally left out of AI answers built on Google's and Bing's indexes.

The header is easy to miss

The X-Robots-Tag header is set by your server or CDN, not in the HTML, so it's easy to miss.

Not the same as robots.txt

robots.txt stops crawlers fetching a page; noindex lets them fetch it but keeps it out of the index.

From snapshot to system

This check is a snapshot. Sona is the system.

Noindex decides whether a page can appear in search and AI answers. Sona Agent Analytics shows which AI crawlers read your pages and how many visitors they send back. AI Search Insights shows whether you are cited in AI answers.

AI Search Insights

"Am I being cited in AI answers, and how do I compare to competitors?"

  • Track the prompts your buyers actually ask across ChatGPT, Gemini, Google AI Overviews, Perplexity, Claude, DeepSeek, Grok & more
  • See your rankings and share of answer against competitors
  • Find which sources answer engines cite, and which of your pages get surfaced

Agent Analytics

"Are AI crawlers reading my site, and is AI search sending me traffic?"

  • See AI crawler activity by bot, GPTBot, ClaudeBot, PerplexityBot, Google-Extended
  • Measure referral traffic clicking through from AI answers
  • Page-level view of what gets crawled and what drives AI referrals
Get crawled→Get cited in answers→Earn referral clicks→Revenue

Can AI crawlers actually reach you?

This tool checks one thing. The free AI Crawl Checker tests 47 AI crawlers live against your page - robots.txt, firewalls, rate limits, noindex, sitemaps and more - and gives you the fix for each one that fails.

Want to see which AI bots actually visit, continuously? Try Sona Agent Analytics or book a demo.

FAQ

Noindex Checker FAQs

Quick answers about noindex and this checker.

noindex is a directive that tells search engines not to show a page in their results. It can be set in the page's HTML as <meta name="robots" content="noindex">, or sent as an HTTP header: X-Robots-Tag: noindex. Crawlers that see it still fetch the page, but drop it from their index.

It loads your page like a browser and reads three places: the meta robots tag, the X-Robots-Tag response header, and crawler-specific meta tags such as <meta name="googlebot">. It also flags the "none" directive (shorthand for noindex, nofollow) and error status codes, which keep a page out of search whatever its tags say.

Check the X-Robots-Tag header - it's set by your server or CDN, not in the HTML, so it's easy to miss. Staging configs copied to production and SEO plugin settings are the other common causes.

No. robots.txt stops crawlers fetching a page; noindex lets them fetch it but keeps it out of the index. Don't combine them on the same page: if robots.txt blocks the page, crawlers never see the noindex, and the URL can still appear in results from links elsewhere. Our Robots.txt Tester checks the robots.txt side.

Yes. Google's AI Overviews and AI Mode draw on Google's index, and Bing's index feeds Copilot and other assistants, so a noindexed page is generally left out of AI answers built on them too.

Your site's bot protection returned an error (such as HTTP 403) to our checker. That response is a block page, not your real page, so its tags would tell you nothing - we say so rather than guess.