SEO Course gold shield emblem

SEO COURSE
SITETRAIL CERTIFIED

Course outlineSkills assessment3-minute challenge

Your learning path: 93 lessons.

SEO Course / Foundations for SEO Leaders / Lesson 01

Module 01 / Lesson 01 · Read, apply, check

How Search Works: Crawling, Indexing and Ranking

Diagnose whether a page has a discovery, indexing or ranking problem before choosing a fix.

By Adriaan BritsCEO of Sitetrail · MSc Marketing
Former LinkedIn Learning instructor in SEO, Advanced Google Analytics and Google Ads
Course edition: October 2026

Visual explanationWorked examples20-minute practical taskKnowledge check

Discovery comes first

Search engines need to find a URL before they can evaluate its page. Crawlable internal links and accurate sitemaps give them routes to important content. An isolated page can remain invisible even when its writing is excellent. Start by tracing a real path from an established page to the missing destination, rather than assuming that publishing creates discovery.

Crawling is a request

A crawler requests the page and receives a response. Server errors, access restrictions and robots rules can prevent that request from producing useful content. A successful response does not prove that the content was understood or selected for the index. Inspect the response and the rendered page separately, especially when a site depends on JavaScript.

Indexing is selection

Indexing involves processing content and deciding what to retain and which URL represents it. Duplicate pages, canonical choices, noindex instructions and weak usefulness can all affect this stage. A page can be crawled without being indexed. Use URL Inspection to distinguish an exclusion from a page that simply performs poorly for a particular query.

Ranking is query-dependent

An indexed page competes for particular searches according to relevance and other signals. There is no single universal rank for a page. Location, language, query wording and result features can change what appears. Once technical eligibility is established, investigate whether the page actually answers the audience’s question and offers a useful experience.

A URL has three different hurdles

Discover and crawl

A useful link exposes /guide → the server must allow a successful fetch. Blocked access stops this path.

Render and index

The fetched page must expose usable content → an indexing decision follows. A crawl does not guarantee inclusion.

Retrieve and rank

For a relevant query, eligible pages are compared → indexed does not mean prominent.

Reader task

The selected destination must answer the need → visibility alone is not a customer outcome.

Diagnose the stage that failed instead of applying the same remedy to every missing result.

See it in practice

Illustrative case: a furniture retailer publishes a guide to measuring a narrow staircase before ordering a sofa. After two weeks, the owner sees no search visits and asks for more keywords. The marketer first checks whether the guide is linked from the delivery information page. It is not. URL Inspection also shows that Google has not discovered the URL. The team adds a useful link from delivery guidance, includes the URL in the sitemap and verifies a successful server response. They then monitor discovery and indexing before evaluating query performance. The immediate recommendation is to repair the route to the page, not rewrite useful instructions. Even after indexing, competitive visibility remains a separate question requiring evidence about intent and content quality.

Compare the alternative

Contrast this with a guide that URL Inspection confirms is indexed under its own canonical address. It receives impressions for sofa-delivery questions but attracts few clicks. Adding it to the sitemap again does not address that situation. The marketer should inspect the actual result presentation, the queries and competing pages, then decide whether the title, answer, audience fit or offer needs improvement. The same traffic symptom can therefore require a different intervention.

Avoid this misconception

The misconception is that a live URL must already be eligible to rank. Publishing, discovery, crawling, indexing and ranking are separate events. Treating them as one step encourages expensive content changes before a basic access problem has been identified.

Know the boundary

For a newly launched site, discovery and processing can take time. For a large established site, widespread exclusions may require a template or architecture review. Neither case justifies promising a fixed indexing deadline.

Do this today · 20 minutes

Turn this lesson into a useful action.

Choose one important page with disappointing search performance. Record its response, discovery links, indexing status, selected canonical and relevant queries. Write one sentence naming the earliest unresolved stage and the evidence supporting that diagnosis. Assign the next action to the person who can actually resolve it.

Before you start

Use an authorized page or campaign relevant to this lesson, or work entirely from the illustrative sample below. Record proposed changes as drafts until they are approved and implemented.

Practise with this scenario

A delivery guide loads normally, has no incoming internal links and is reported as unknown in URL Inspection.

Your steps

  • Write the URL and check whether it loads with the expected public content.
  • Trace a real internal route to it and inspect sitemap inclusion; record missing discovery paths.
  • With authorized Search Console access, open URL Inspection and record indexing/canonical evidence; in the sample, mark discovery unresolved.
  • Choose the earliest evidenced failure and write the next action and owner before proposing a content rewrite.

What better looks like

Before: “No traffic means the writing needs more keywords.”

After: “Discovery is unresolved; add a useful route and verify the indexing evidence.”

Your working notes

Notes stay in this browser. Download a copy to keep them.

Verify your work

  • A real internal discovery path is documented.
  • The indexing observation is recorded with a date.
  • The proposed fix addresses the earliest evidenced failure.

Follow up

Recheck access and discovery after the change. Evaluate ranking only after establishing that the page is eligible and indexed.

Before you move on

Make the decision.

A retailer’s new delivery guide has no organic visits. URL Inspection reports that the URL is unknown to Google, and no existing page links to it. The page loads normally in a browser. Which action is the strongest first response?

Sources and further reading

Google: How Search works

Search Console URL Inspection

Lesson edition 2 · References reviewed 14 October 2026 · Practical exercise reviewed 15 October 2026. Examples are illustrative teaching scenarios.

Free learning. Informed choices.

Built for aspiring SEO directors, existing practitioners and business owners who want to turn sound judgment into practical results.

Course hub · Free skills assessment · Privacy

No Sitetrail account is required. Course progress and assessment results are saved in this browser when storage is available; they do not sync to the app. Download your worksheets and certificate to keep your own copies.

Plugin Downloaded Congratulations Installation Guide: 

  1. In WordPress, go to Plugins → Add New Plugin.
  2. Click Upload Plugin and select the downloaded ZIP file.
  3. Click Install Now, then Activate Plugin.

 

Your free trial starts automatically. No license key is needed yet.