Category: Technical SEO

  • Technical SEO Audit Checklist: What to Check and in What Order

    Technical SEO Audit Checklist: What to Check and in What Order

    A technical SEO audit should answer one question before anything else: what is stopping search engines from accessing, processing or indexing the pages that matter?

    The order matters. Testing structured data on a page that returns a server error is wasted effort. Improving Core Web Vitals on a page carrying an accidental noindex directive will not solve its visibility problem.

    This checklist starts with technical eligibility, then moves through discovery, rendering, architecture and page experience. Each important finding should be verified against the live site before it becomes a recommendation.

    Quick Summary

    Run a technical SEO audit in this order:

    1. Define the audit scope.
    2. Check crawler access and server responses.
    3. Verify indexability and canonical signals.
    4. Review sitemaps, internal links and discovery.
    5. Test rendering where JavaScript matters.
    6. Audit redirects, broken links and status codes.
    7. Review performance, mobile delivery and HTTPS.
    8. Validate structured data and relevant specialist checks.
    9. Prioritise findings, implement fixes and retest.

    What Is a Technical SEO Audit?

    A technical SEO audit evaluates whether a website’s technical setup allows search engines to discover, crawl, process and index its important pages correctly.

    Google’s minimum technical requirements are a useful starting point. Googlebot must be able to access the page, the page must return a successful response and it must contain indexable content.

    A technical audit checks how consistently those conditions hold across important templates and URL groups. Content, keyword and backlink audits are separate tasks with different evidence.

    Before You Start, Define the Audit Scope

    Do not start by exporting every warning from a crawler. First decide what the audit is meant to cover.

    Record the main domain, subdomains, important page types, CMS and recent migrations or template changes. Identify the pages that generate leads, sales or important organic visits.

    You will usually need Google Search Console plus a crawler such as Screaming Frog, Semrush or Ahrefs. Browser developer tools and PageSpeed Insights help with deeper checks.

    Step 1: Check Access and Server Responses

    Start with access because nothing later matters if the page cannot be fetched correctly.

    Confirm that important URLs return the intended HTTP response and are publicly accessible. Google’s technical requirements state that pages need a successful HTTP 200 response to be eligible for indexing.

    Then review robots.txt. Google’s robots.txt guidance explains that the file controls crawler access. It is not a reliable way to remove a web page from Google Search.

    Look for accidental blocks, server errors, login walls and blocked resources that affect rendering. Verify critical issues against the live response instead of relying only on a crawler label.

    Step 2: Check Indexability and Canonical Signals

    Once Google can access the page, confirm whether the page is allowed and intended to be indexed.

    Use the Page Indexing report to look for site-level patterns. Use URL Inspection when you need Google-specific evidence for an individual URL.

    Check robots meta directives, X-Robots-Tag headers, canonical tags, Google-selected canonicals, duplicate URLs and unexpected exclusions.

    Do not assume every excluded URL needs fixing. Google notes that some non-indexed URLs are expected, including duplicates and deliberately excluded pages.

    The audit should ask whether the correct pages are indexed, not whether every possible URL is indexed.

    Step 3: Check XML Sitemaps, Internal Links and Discovery

    Next, check how search engines discover the URLs you care about.

    A sitemap tells search engines which URLs you consider important. Google’s sitemap documentation also makes clear that sitemap inclusion does not guarantee crawling or indexing.

    Review whether the XML sitemap contains canonical, indexable URLs and excludes redirects, errors and unwanted duplicates.

    Then crawl the internal link structure. Look for orphan pages, broken links, excessive depth and navigation that hides key URLs.

    Use crawlable link guidance when checking whether navigation links can be followed reliably.

    Step 4: Check Rendering Where JavaScript Matters

    Rendering needs deeper investigation when important content, links or metadata depend on JavaScript.

    Compare the server HTML with the rendered page on affected templates. Check whether titles, canonicals, main content and internal links appear as expected.

    Do not label every JavaScript website as a problem. The question is whether search engines can access the important output reliably.

    Step 5: Review Status Codes, Redirects and Broken Paths

    Now check what happens when users and crawlers follow URLs across the site.

    Find broken internal links, redirect loops, long chains and irrelevant redirect destinations.

    A 404 is not automatically an SEO fault. An intentionally removed page with no suitable replacement may correctly return 404 or 410. Prioritise broken journeys that affect valuable URLs.

    Step 6: Review Performance, Mobile Delivery and HTTPS

    Once access and indexability are sound, review how important templates perform for users.

    Use Core Web Vitals guidance and PageSpeed Insights to investigate loading performance, responsiveness and visual stability.

    Check representative templates instead of treating one homepage score as the whole site. Confirm that important mobile content remains available and pages are served securely over HTTPS.

    Performance matters, but it does not replace crawl and indexability checks.

    Step 7: Validate Structured Data and Conditional Checks

    Validate structured data only after confirming that the page itself is accessible and indexable.

    Google explains that structured data can support eligible search features, but valid markup does not guarantee a rich result.

    Check whether the markup matches visible content. Add specialist checks only when they apply. Hreflang belongs in an international-site audit, while server-log and crawl-budget analysis should be justified by scale or crawl behaviour.

    Prioritise Findings Before You Fix Anything

    A crawler can return hundreds of warnings. The audit’s value comes from deciding which ones matter. Prioritise in this order:

    1. Blocking issues: important pages cannot be accessed, rendered or indexed.
    2. High-impact consistency issues: template-wide canonical, redirect, sitemap or internal-link problems.
    3. Experience issues: performance or mobile problems on important templates.
    4. Enhancements: structured data and lower-risk improvements.
    5. Monitor or no action: expected exclusions, intentional 404s and warnings without a meaningful consequence.

    Illustrative example: a crawl finds 4,000 noindexed URLs. Most filtered search pages may be intentionally excluded. If valuable category pages inherited the same noindex header from a template, that becomes a high-priority fix.

    Issue count alone does not determine priority.

    Turn Every Important Finding into a Developer-Ready Task

    A technical SEO audit should finish with an actionable record, not a dashboard export.

    For each important issue, document the affected URL or template, evidence, likely cause, recommended change, owner, priority, acceptance criteria and retest method.

    After deployment, check the live response again. For indexing issues, use URL Inspection or the relevant Search Console report after Google has processed the change.

    The audit is complete when the intended behaviour is verified.

    Frequently Asked Questions

    What is included in a technical SEO audit?

    It usually covers crawl access, indexability, canonicals, sitemaps, internal links, rendering, redirects, performance, mobile delivery, HTTPS and structured data.

    Can I do a technical SEO audit myself?

    Yes, especially on smaller sites. Search Console and a crawler cover many checks. Complex JavaScript, server or large-site issues may need developer or specialist support.

    How long does a technical SEO audit take?

    It depends on site size, templates and complexity. A small site can be reviewed quickly, while large, international or JavaScript-heavy sites need deeper investigation.

    How often should you run a technical SEO audit?

    Run one after migrations, redesigns, major template changes or unexpected visibility problems. Ongoing monitoring is usually more useful than relying on a fixed annual schedule.

    Which tools do you need for a technical SEO audit?

    Start with Google Search Console and a crawler. Add browser developer tools, PageSpeed Insights and the Rich Results Test when the issue requires them.

    Should every SEO audit warning be fixed?

    No. Some exclusions, 404s and crawler warnings are expected. Verify the business and search impact before turning a warning into a task.

    Final Thoughts

    A technical SEO audit works best when the checks follow the same dependency chain that search engines face.

    Start with access. Confirm indexability. Then review discovery, rendering, architecture, status codes, performance and structured data. Most importantly, verify each serious finding before asking someone to fix it.

    This order prevents teams from spending hours on low-impact warnings while important pages remain blocked or excluded.

    If you want an audit that documents the evidence, priority and exact fix, CraftDigitally’s technical SEO service focuses on developer-ready findings. You can also request a free technical SEO audit to see what is broken before committing to implementation.

  • What Is Technical SEO? Crawling, Indexing and Site Health Explained

    What Is Technical SEO? Crawling, Indexing and Site Health Explained

    Technical SEO helps search engines access, process and understand a website correctly. It covers crawling, rendering, indexing, site structure, performance and search appearance.

    A page can contain useful content and still struggle if search engines cannot reach it, render its important information or identify the correct URL to index. Technical SEO helps remove those barriers.

    The goal is not a perfect audit score. The goal is to make important pages easy to find, accessible, indexable and reliable for users. A good process also verifies whether a fix worked.

    Quick Summary

    • Technical SEO supports discovery, crawling, rendering and indexing.
    • Crawling and indexing are separate stages.
    • Robots.txt, noindex and canonical tags solve different problems.
    • Site health includes crawlability, indexability, links and performance.
    • Technical fixes should be retested after implementation.

    What Is Technical SEO?

    Search engine process from discovery and crawling to rendering, indexing and serving

    Technical SEO improves the parts of a website that affect how search engines access and process its pages. It includes server responses, crawl controls, internal links, sitemaps, canonical tags, JavaScript rendering, structured data and page performance.

    Google explains Search as a process that moves through crawling, indexing and serving results. Technical SEO helps reduce problems that interrupt that process.

    It differs from on-page SEO, which focuses more on content, headings, titles and search intent. Off-page SEO focuses on signals from outside the website.

    How Crawling, Rendering and Indexing Work

    Difference between crawlable, blocked and crawled but excluded web pages

    Technical SEO becomes easier to diagnose when each search stage is treated separately.

    Crawling: Can Search Engines Access the Page?

    Crawling starts when a search engine discovers a URL and requests it from the server. URLs can be found through internal links, XML sitemaps and links from other pages.

    Google’s technical requirements for Search say Googlebot must not be blocked, the page must return a successful HTTP response and it must contain indexable content to be eligible for indexing.

    Common crawl problems include:

    • important URLs blocked in robots.txt
    • broken internal links
    • redirect loops
    • server errors
    • orphan pages
    • navigation without crawlable links

    Robots.txt controls crawler access. It is not a reliable instruction for removing a normal page from Google’s index.

    Rendering: Can Search Engines See the Important Content?

    Initial HTML compared with a fully rendered JavaScript web page

    Rendering matters when important content or links depend on JavaScript. Google can execute JavaScript, but the rendered page may differ from the HTML returned by the server.

    Google’s JavaScript SEO documentation describes crawling, rendering and indexing as separate processing stages for JavaScript pages.

    The useful question is whether important content, links, metadata and canonical signals remain available after processing.

    A page may look complete in a browser while its initial HTML contains little useful content. That does not prove an SEO problem, but it justifies comparing the server response with the rendered page.

    Indexing: Should This Page Be Stored?

    Comparison of robots.txt, noindex and canonical controls in technical SEO

    A crawled URL is not automatically an indexed URL.

    A noindex directive tells supported search engines not to index a page. Google’s noindex guidance explains that the page must remain crawlable for Google to see that directive.

    Canonicalisation solves a different problem. It tells Google which URL you prefer when several URLs contain duplicate or very similar content.

    Google treats redirects and rel="canonical" annotations as strong signals, while sitemap inclusion is weaker, according to its canonicalisation guidance.

    That is why crawl evidence and index evidence should not be treated as the same thing.

    What Does Site Health Mean in Technical SEO?

    Technical SEO site health checks for status codes, links, canonicals, sitemaps and performance

    Site health describes whether the technical parts of a website work together without creating avoidable search or user problems. It is not one official Google score.

    A technically healthy site usually has:

    • intended HTTP status codes
    • crawlable navigation
    • consistent canonical signals
    • useful XML sitemaps
    • no accidental noindex directives
    • accessible mobile content
    • stable rendering
    • acceptable real-world performance

    Key Areas to Check in Technical SEO

    Crawlability and Discovery

    Important pages should be discoverable through crawlable internal links. XML sitemaps can also help search engines find new or updated URLs.

    Google’s link best practices explain how standard crawlable links support discovery.

    Check robots.txt, broken links, redirect chains, status codes and orphan pages before assuming a page needs more content.

    Indexability and Canonicalisation

    Review robots directives, X-Robots-Tag headers, canonical tags, redirects, duplicate URLs, sitemap inclusion and Search Console index status.

    Do not treat every excluded URL as an error. Some URLs should remain excluded because they are duplicates, login areas or intentionally removed pages.

    Site Architecture and Internal Linking

    Site architecture affects how easily users and crawlers move between important pages.

    Internal links show relationships between pages and help search engines discover new URLs. Important pages should not depend on deep or inconsistent navigation paths.

    Mobile Experience and Core Web Vitals

    Google’s Core Web Vitals documentation identifies LCP, INP and CLS as metrics for loading performance, responsiveness and visual stability.

    Good scores are useful, but they do not guarantee rankings.

    Structured Data

    Structured data gives search engines explicit information about page content and entities.

    Google explains that structured data can help it understand page content and can make eligible pages available for supported search features.

    It does not guarantee a rich result.

    Technical SEO vs On-Page SEO

    Technical SEO asks whether a page can be accessed, processed and indexed correctly. On-page SEO asks whether the page communicates useful information and satisfies the searcher’s need.

    Strong headings and useful copy are mainly on-page elements. An accidental noindex header or server error is a technical issue.

    How to Check Your Site’s Technical SEO

    Technical SEO workflow from finding and fixing an issue to deployment and verification

    A useful review follows the search process instead of collecting warnings without context.

    1. Check the live response. Confirm the page returns the intended status code.
    2. Confirm crawl access. Review robots.txt and infrastructure that could block crawlers.
    3. Inspect index controls. Check robots directives, headers and canonical signals.
    4. Review discovery. Confirm important pages appear in internal links and appropriate sitemaps.
    5. Check rendered content. Compare server HTML with rendered content on JavaScript-heavy pages.
    6. Review Search Console evidence. Use Page Indexing, Crawl Stats and URL Inspection.
    7. Test page experience. Review important templates instead of isolated tool scores.
    8. Retest after deployment. Confirm the response, content or directive changed as expected.

    Do You Need Coding Knowledge for Technical SEO?

    You do not need to be a developer to start technical SEO.

    Many checks use Search Console, browser developer tools and crawling software. Basic knowledge of HTML, status codes, redirects and robots directives is useful.

    Developer support becomes more important when problems involve servers, JavaScript, templates, routing or performance engineering.

    Does Technical SEO Matter for AI Search?

    Technical SEO still matters for Google’s AI search features because pages need to be accessible and eligible for Search before they can appear as supporting links.

    Google states that the same SEO foundations apply to AI Overviews and AI Mode. It does not require special AI schema, AI text files or separate technical optimisation for inclusion.

    This does not mean that passing a technical audit guarantees an AI citation.

    Frequently Asked Questions

    What are examples of technical SEO?

    Robots.txt rules, XML sitemaps, redirects, canonical tags, noindex directives, JavaScript rendering, structured data and Core Web Vitals.

    Can a page be crawled but not indexed?

    Yes. Crawling means the search engine accessed the URL. Indexing is a separate decision.

    Does technical SEO require coding?

    Not always. Coding is more useful for server, JavaScript, template and performance issues.

    Is page speed part of technical SEO?

    Yes. Performance depends on how the page and its resources are delivered.

    Is structured data part of technical SEO?

    Usually, yes. It is implemented in page code and can help search engines interpret eligible content.

    How often should technical SEO be checked?

    Check it after migrations, redesigns, template changes and major releases. Ongoing monitoring is better than one annual audit.

    Final Thoughts

    Technical SEO becomes easier when you stop treating it as a list of tool warnings.

    Start with the search process. Can a crawler discover the page? Can it fetch the correct response? Is important content available after rendering? Is the preferred URL indexable? Then verify the result after each meaningful fix.

    That approach helps teams focus on issues that affect important pages.

    If you need help proving where a problem sits, CraftDigitally’s technical SEO service focuses on live evidence, clear priorities and fixes your developer can act on.

  • How we run a technical SEO audit

    How we run a technical SEO audit

    We test your site the way a crawler sees it. Every finding is checked against your live server response, not a screenshot.

    We read what a crawler reads

    Search engines see your server response, not your design. We fetch each page the way a crawler does and check the real headers.

    Every finding is verified

    Nothing goes in the report because a tool said so. We reproduce each issue on the live site, then hand your developer the exact fix.

    You keep the report

    The audit is yours whether or not you hire us. Fix it with your own team, or ask us to implement it, will do it for you.

    You keep the report

    The audit is yours whether or not you hire us. Fix it with your own team, or ask us to implement it, will do it for you.