Home/Glossary/Indexing in SEO
Glossary · Search engine optimization

Indexing in SEO

Search engine optimization · Glossary

What is Indexing in SEO?

Indexing is when Google stores a page in its database so it can appear in search results — if a page isn’t indexed, it can’t rank.

Why pages don't get indexed (site-average)2026Discovered but not crawled36%Crawled but rejected (quality)13%URL unknown to Google12%Noindex intentional33%404 / dead5%Redirect / canonical1%
From a real 310-URL audit on omegatrove.com (2026-07-07). "Crawled but rejected" is the quality-signal bucket that content depth fixes.
Reviewed by Omar Ghattas, Omega Trove Consulting · Published 2026-07-07
AI quick answer

Indexing in SEO is the process where a search engine like Google stores and organizes a web page in its index after crawling it, making the page eligible to appear in search results. If a page is not indexed, it cannot rank or earn organic traffic, no matter how good the content is. You verify a page’s indexing status in Google Search Console.

Example: a Winter Garden HVAC company

A Central Florida agency site had 340 URLs submitted in the sitemap; Search Console showed 187 indexed, 92 Crawled currently not indexed, 47 Discovered currently not indexed, and 14 Excluded by noindex. We audited the Crawled-not-indexed URLs and found a pattern: they were programmatic city-service pages (roughly 60 of them) with 200 to 300 words of near-duplicate content varying only by city name. Google had crawled them and decided they added no unique value. We rewrote 24 of the highest-volume city-service pages with unique 800-word content per city (real service details, local job examples, city-specific pricing), and left the other 36 in the sitemap unchanged as a control. Within 90 days, 22 of the 24 rewritten pages moved to Indexed; the 36 unchanged pages stayed Crawled-not-indexed. The pattern we see in projects we've run: Crawled-not-indexed is almost always a content quality verdict, not a technical bug.

How it works

  1. Googlebot crawls your URLs

    Googlebot discovers URLs through your sitemap, internal links, external backlinks, and the Search Console URL Inspection tool. The crawler downloads the HTML, then (if the page uses client-side JavaScript rendering) queues the page for the Web Rendering Service to execute the JavaScript and see the rendered content. Crawl frequency is driven by site authority, freshness signals, and crawl budget; a low-authority page might be crawled once every few weeks while a homepage might be crawled every few hours.

  2. Google decides whether to index each URL

    Crawling does not guarantee indexing. Google evaluates the page against quality signals: is the content unique, useful, well-structured, mobile-friendly, and free of technical issues (noindex tag, canonical to another URL, 404, soft 404)? A page can be Crawled, currently not indexed (Google saw it but chose not to include) or Discovered, currently not indexed (Google knows about it but has not crawled yet). Search Console's Pages report lists every URL by its indexing state and reason.

  3. Indexed pages become eligible for search results

    Once indexed, a page enters Google's search index and can appear in search results for relevant queries. Being indexed is necessary for ranking but not sufficient; a page can be indexed and still not rank for anything, either because content is weak, competition is high, or the page has no backlink or internal link support. The indexing report in Search Console tells you what Google has and has not; ranking reports (Performance) tell you what those indexed pages are actually earning.

When to use

  • Diagnosing why traffic-worthy URLs are not appearing in Google search results
  • Auditing a site after a redesign, migration, or major content update to confirm indexing recovered
  • Managing a large site where crawl budget and index coverage need explicit attention

When to avoid

  • Panicking over a single URL that is Discovered-not-indexed when the rest of the site is healthy (Google will crawl it eventually)
  • Using the Indexing API for anything other than JobPosting or BroadcastEvent content (Google's actual policy)
  • Adding noindex to fix ranking problems; noindex removes the page from search entirely, which is not what most people mean

Common mistakes

MistakeConfusing indexed with ranking
FixIndexed means the page is eligible to appear in results. Ranking means the page actually appears near the top for relevant queries. Indexed pages can rank at position 100 (functionally invisible) or position 3. Check Performance report for actual query impressions, not just Pages report for index status.
MistakeTreating 'Crawled, currently not indexed' as a technical bug
FixThis status almost always means Google evaluated the content and judged it weak (thin, duplicate, low value). Rewrite the content with unique value or accept that the page will not index. Requesting indexing repeatedly does not help; only content improvement does.
MistakeUsing the Google Indexing API against Google's policy
FixGoogle's official documentation restricts the Indexing API to JobPosting and BroadcastEvent structured data. Using it for regular blog posts or service pages violates the terms, and Google has begun ignoring API requests from sites that abuse it. Submit URLs through the sitemap and let normal crawling handle indexing.
MistakeBlocking Googlebot with robots.txt when you meant noindex
FixRobots.txt blocks Googlebot from crawling the URL, so Google never sees the noindex tag and may still index the URL with a placeholder title. To prevent indexing, use a meta noindex tag and allow crawling so Google can read the tag. Robots.txt is for crawl-budget control, not indexing control.

Related to your business type

Walk-in & local

For a Central Florida local-service site with 20 to 50 pages total, indexing is rarely a technical problem. Almost every URL is Indexed if the content is genuine. When pages stay Crawled-not-indexed, the cause is thin service-city pages that repeat the same content with only the city name swapped; Google reads this as programmatic low-value content. The fix is unique content per city, not more citations or backlinks.

Online stores

For Shopify or WooCommerce sites with hundreds or thousands of products, indexing is often crawl-budget-limited: Google indexes the top products and categories but leaves the long tail Discovered-not-indexed. Fix priorities: robots.txt to block faceted-nav URL explosion, canonical tags on parameter URLs, unique product descriptions on top-selling SKUs, and sitemap segmentation (separate sitemap for products vs. blog vs. categories) so you can track index coverage per section.

Premium & brand-first

For a premium brand where every page is intentionally crafted, indexing issues usually signal a specific technical problem: canonical tag pointing to the wrong URL, JavaScript rendering that hides content from the crawler, or a noindex tag left in place from a staging environment. Audit any Crawled-not-indexed page manually through URL Inspection, check the rendered HTML in Google's live URL test, and expect fewer than 5% of URLs to be non-indexed on a well-maintained brand site.

Indexing matters because it is the gate before ranking: a page that is crawled but not indexed is invisible in search, no matter how good the content is. You check it in Google Search Console under the Pages report (formerly Index Coverage), which buckets every URL as Indexed or Not indexed and gives the reason. For a single page, the URL Inspection tool tells you outright whether that URL is on Google and, if not, why.

Common reasons a Central Florida small business stays unindexed include “Crawled — currently not indexed” (Google saw the page but judged it thin or duplicate), “Discovered — currently not indexed” (often a crawl-budget or low-priority signal on new sites), an accidental “noindex” tag left in from a staging build, or a canonical tag pointing somewhere else. Thin, near-duplicate location pages — the kind that just swap “Orlando” for “Kissimmee” — are a frequent culprit.

Indexing also underpins local SEO and answer-engine optimization: Google’s AI Overviews, ChatGPT, and Perplexity can only cite a page that is already in the index. Getting indexed fast — via a clean XML sitemap, strong internal links from your homepage and service pages, and a logical site structure — is the precondition for showing up in the local pack and being quoted in AI answers.

Frequently asked

How long does it take Google to index a new page?
Anywhere from a few hours to a few weeks depending on your site's authority and crawl frequency. High-authority sites with strong internal linking often see new pages indexed within 24 to 48 hours. Low-authority or newer sites can take 2 to 4 weeks. Submitting the URL through Search Console's URL Inspection tool with Request Indexing speeds it up, though Google limits how many requests you can make per day. Sitemap submission ensures Google knows the URL exists but does not force fast indexing.
What does 'Crawled, currently not indexed' mean?
Google crawled the URL, evaluated the content, and decided not to include it in the search index. The most common cause is content quality: thin, duplicate, or near-duplicate content that adds no unique value. Less common causes include cannibalization with a stronger page on the same site, extremely low relevance for any query, or a technical signal like a canonical tag pointing elsewhere. The fix is almost always content improvement (add unique value, expand depth, differentiate), not a technical toggle.
What is the difference between 'Discovered' and 'Crawled' but not indexed?
Discovered means Google knows the URL exists (usually from your sitemap or an internal link) but has not yet crawled it. Crawled means Google has fetched the URL, evaluated it, and chosen not to index. Discovered-not-indexed usually resolves on its own within a few weeks as Google gets around to crawling. Crawled-not-indexed will not resolve without content improvement, since Google has already made a quality judgment. The fixes are different.
How do I ask Google to index my page faster?
Open Search Console, use the URL Inspection tool, enter the URL, and click Request Indexing. This puts the URL in a priority crawl queue. Google limits the number of daily requests per property (typically around 10 to 20). For bulk indexing, ensure your sitemap is up to date and submitted, add internal links from high-authority pages on your site, and earn a couple of backlinks to signal the URL matters. Do not use the Indexing API for regular content; Google's terms restrict it to JobPosting and BroadcastEvent.
Does noindex remove a page from Google?
Yes, adding a meta noindex tag or an X-Robots-Tag: noindex HTTP header tells Google to remove the page from the search index the next time it crawls. Removal typically happens within 3 to 14 days. Google must be able to crawl the page to see the noindex tag; if you also block the URL in robots.txt, Google cannot see the tag and may still show a URL-only listing without title or description. Use noindex to remove pages you want out of search; use robots.txt to control crawl behavior.

Sources & references

Related service

Search engine optimization with Omega Trove

See how we put this to work for Central Florida businesses — and book a free consultation.

Explore the service →
Related concepts

See also

Free consultation

Want this done for you?

We’ll show you exactly where you’re invisible — free.