Early AccessSite Architecture Crawl

Site crawl tool: see how your website is built and linked.

Site Architecture Crawl is a site crawl tool that follows the links on your site, page by page. It maps how your pages connect and how deep each one sits. Then it shows where the structure needs work.

Free for 3 calendar months

Create a free account, then turn on Site Architecture Crawl in your dashboard.

Pages per crawl
No fixed cap; safeguards apply
Active crawls
One at a time per site
Early Access
Free for 3 calendar months
Illustration of Site Architecture Crawl, not real data: an example website's pages arranged around its homepage by URL path, with the links into and out of one selected page.

What it does

A site crawl tool for structure, not scores.

This tool looks at how your site fits together. It does not score each page. For a page by page SEO check, use Website SEO Audit.

  1. Website structure

    See your pages grouped by URL path, from the homepage out.

  2. Crawl depth

    See how many clicks each page is from the start. Pages 5 or more clicks deep get flagged.

  3. Internal links

    See which pages link to a page, and where that page links out.

  4. Broken internal links

    Find links to pages that are missing, broken or out of reach.

  5. Redirect chains

    Find chains of redirects, loops and redirects that end in an error.

  6. Canonicals and sitemaps

    Find canonical URLs that fail, and sitemap URLs that are not indexable pages.

For a scored, page by page check, see Website SEO Audit.

Website structure and crawl depth

Two maps of the same site.

Your site has two shapes. One is its URL paths, like /shop/shoes/red. The other is the links between pages. The two are often not the same.

The Site structure view groups pages by URL path. Its lines show where a path goes on. They are not links.

Crawl depth is about links. It counts the clicks from your start page to each page. A page that takes many clicks can be hard for people and crawlers to find.

Level 0Level 1Level 2Level 3//shop/blog/shop/shoes/shop/shoes/red
URL paths: how addresses nest
0 clicks1 click2 clicks//shop/blog/shop/shoes/shop/shoes/red

Internal link analysis

Pick any page in the Link network view. You see the pages that link to it, and the pages it links to. Links are grouped, so a big site stays easy to read.

This internal link checker also flags links to missing pages, server errors and pages that turn the crawler away. Each finding lists the pages it affects.

Interactive 3D link graph

Walk through your site in 3D.

Turn the view, zoom in and pick a page to see its links. Colors show each page’s state, so problems stand out.

The 3D view needs WebGL. If your browser does not have it, a plain outline lists the same pages.

Hard to find pages

Pages your links may have left behind.

Some pages are in your sitemap, but no link the crawl saw leads to them. The report marks them as potential orphan pages.

They may still have links the crawl could not see, such as links added by scripts. So check each one before you act. A page with no link and no sitemap entry stays hidden from any crawl.

Partial crawls and safeguards

No fixed page cap. Firm safeguards.

  • No set page limit

    The crawl keeps going while it finds new pages on your site. Large sites can take hours or days.

  • A gentle pace

    It waits at least 1 second between requests. You can slow it down to 10 seconds.

  • Safeguards

    Limits on time, requests and data protect your site and our servers. Endless calendars and filter pages are skipped.

  • Honest reports

    If a safeguard ends a crawl early, the report is marked partial. It says what it did not cover.

  • Runs on our servers

    You can close your browser. You can pause a crawl and resume it later. The report appears when the analysis is done.

  • Follows your rules

    It skips URLs your robots.txt blocks and links marked nofollow. If your site keeps refusing it, the crawl pauses.

Early Access terms

Its own three months of free Early Access.

Site Architecture Crawl has its own free Early Access. It lasts three calendar months. No card is needed, and nothing is billed. You turn it on for this tool alone.

Pages per crawl
No fixed cap; safeguards apply
Pace
One request every 1 to 10 seconds
Active crawls
One at a time per site
Early Access
Free for 3 calendar months
After it ends
Reports stay readable; new crawls cannot start
Account
A free account with a confirmed email

Turning on Website SEO Audit does not turn on this tool. Each one has its own dates.

The full rules are in the Early Access terms.

Questions

Site crawl tool questions.

Is this a full SEO audit?
No. It maps your structure and links, and flags broken paths. It does not score pages. For a technical SEO check of each page, use Website SEO Audit.
Will it find every page?
It finds the pages it can reach through links, sitemaps, redirects and canonicals. Pages with no link and no sitemap entry stay hidden. A safeguard can also end a crawl early.
Will it slow down my site?
It sends one request at a time, with at least a second between them. It also gives way to other audits. If your site keeps refusing, it pauses.
What if the crawl stops early?
You still get a report. It is marked partial and says which limits it hit. Treat it as a sample, not the full site.

Free Early Access

Map your site with a site crawl.

Sign in, pick a site and start a crawl. Early Access is free for three months.