Thoughtful design. Meaningful digital experiences.

Technical SEO

Technical SEO Basics Every Website Owner Should Know

A plain-language guide to technical SEO: crawling, indexing, sitemaps, robots.txt, canonical URLs, structured data, page speed and Google Search Console.

Technical SEO is the part of search engine optimization that deals with how your website is built and delivered, rather than what it says. You do not need to be a developer to understand the basics — and knowing them makes it much easier to spot problems and ask the right questions.

How search engines see your website

In simple terms, a search engine discovers pages (crawling), processes and stores them (indexing), and then decides which indexed pages to show for a given search (ranking). Technical SEO is mostly about the first two steps: making sure your important pages can be found, rendered and understood.

Crawlability: can pages be found?

Crawlers mainly discover pages by following links. Important pages should be reachable through normal HTML links from your navigation or content — not only through search boxes, scripts or buttons. Pages that nothing links to (“orphan pages”) are easy to miss.

Indexability: are pages allowed in the index?

A page can be crawlable but still excluded from search results. Common reasons include a “noindex” directive, a canonical tag pointing to a different URL, or the page returning an error status. These are sometimes intentional, but accidental noindex tags left over from development are a classic mistake.

XML sitemaps

A sitemap is a file listing the canonical URLs you want search engines to know about. It does not guarantee indexing, but it helps discovery — especially for new or large websites. It should include only real, indexable pages, not redirects, errors or duplicates.

robots.txt

The robots.txt file tells crawlers which parts of a site they may request. It is useful for keeping crawlers away from areas that have no search value, but it is not a privacy tool and not a reliable way to remove a page from search results — use a noindex directive for that. Never block the CSS and JavaScript files search engines need to render your pages.

Canonical URLs and duplicate content

The same content can often be reached through several URLs — with and without a trailing slash, with tracking parameters, over HTTP and HTTPS. A canonical tag tells search engines which version is the primary one, consolidating signals instead of splitting them.

Titles, descriptions and headings

  • Give every page a unique, descriptive title tag.
  • Write a meta description that accurately summarizes the page — it may be shown in results.
  • Use one clear H1 per page and logical H2/H3 headings beneath it.

Structured data

Structured data, usually written as JSON-LD, describes things on a page in a machine-readable way — an organization, an article, a breadcrumb trail, a product. It can make pages eligible for richer search features, but it must match visible content. Marking up information that is not on the page, or that is not true, can cause problems.

Page speed and Core Web Vitals

Core Web Vitals are Google’s metrics for loading performance, responsiveness and visual stability. They are part of a broader page experience picture. Practical improvements include compressing and correctly sizing images, reducing unnecessary scripts, and reserving space for images and embeds so layouts do not shift.

JavaScript-heavy websites

Search engines can render JavaScript, but relying on the browser to build all of a page’s content adds delay and risk. Prerendering or server-side rendering puts important content directly in the HTML, making it immediately available to crawlers and faster for visitors.

Use Google Search Console

Google Search Console is free and shows how Google sees your site: which pages are indexed, which have issues, how your Core Web Vitals look and which searches bring visitors. Verifying your site and submitting your sitemap there is one of the most valuable first steps after launch.

Looking for help with this? Explore our technical seo & website optimization service or start a conversation.

Have an idea worth bringing to life?

Let’s turn your next idea into a thoughtful digital experience.