Early AccessSite Architecture Crawl
Site crawl tool: see how your website is built and linked.
Site Architecture Crawl is a site crawl tool that follows the links on your site, page by page. It maps how your pages connect and how deep each one sits. Then it shows where the structure needs work.
Free for 3 calendar months
Create a free account, then turn on Site Architecture Crawl in your dashboard.
- Pages per crawl
- No fixed cap; safeguards apply
- Active crawls
- One at a time per site
- Early Access
- Free for 3 calendar months
What it does
A site crawl tool for structure, not scores.
This tool looks at how your site fits together. It does not score each page. For a page by page SEO check, use Website SEO Audit.
Website structure
See your pages grouped by URL path, from the homepage out.
Crawl depth
See how many clicks each page is from the start. Pages 5 or more clicks deep get flagged.
Internal links
See which pages link to a page, and where that page links out.
Broken internal links
Find links to pages that are missing, broken or out of reach.
Redirect chains
Find chains of redirects, loops and redirects that end in an error.
Canonicals and sitemaps
Find canonical URLs that fail, and sitemap URLs that are not indexable pages.
For a scored, page by page check, see Website SEO Audit.
Website structure and crawl depth
Two maps of the same site.
Your site has two shapes. One is its URL paths, like /shop/shoes/red. The other is the links between pages. The two are often not the same.
The Site structure view groups pages by URL path. Its lines show where a path goes on. They are not links.
Crawl depth is about links. It counts the clicks from your start page to each page. A page that takes many clicks can be hard for people and crawlers to find.
Internal link analysis
See every link into and out of a page.
Pick any page in the Link network view. You see the pages that link to it, and the pages it links to. Links are grouped, so a big site stays easy to read.
This internal link checker also flags links to missing pages, server errors and pages that turn the crawler away. Each finding lists the pages it affects.
Interactive 3D link graph
Walk through your site in 3D.
Turn the view, zoom in and pick a page to see its links. Colors show each page’s state, so problems stand out.
The 3D view needs WebGL. If your browser does not have it, a plain outline lists the same pages.
Hard to find pages
Pages your links may have left behind.
Some pages are in your sitemap, but no link the crawl saw leads to them. The report marks them as potential orphan pages.
They may still have links the crawl could not see, such as links added by scripts. So check each one before you act. A page with no link and no sitemap entry stays hidden from any crawl.
Partial crawls and safeguards
No fixed page cap. Firm safeguards.
No set page limit
The crawl keeps going while it finds new pages on your site. Large sites can take hours or days.
A gentle pace
It waits at least 1 second between requests. You can slow it down to 10 seconds.
Safeguards
Limits on time, requests and data protect your site and our servers. Endless calendars and filter pages are skipped.
Honest reports
If a safeguard ends a crawl early, the report is marked partial. It says what it did not cover.
Runs on our servers
You can close your browser. You can pause a crawl and resume it later. The report appears when the analysis is done.
Follows your rules
It skips URLs your robots.txt blocks and links marked nofollow. If your site keeps refusing it, the crawl pauses.
Early Access terms
Its own three months of free Early Access.
Site Architecture Crawl has its own free Early Access. It lasts three calendar months. No card is needed, and nothing is billed. You turn it on for this tool alone.
- Pages per crawl
- No fixed cap; safeguards apply
- Pace
- One request every 1 to 10 seconds
- Active crawls
- One at a time per site
- Early Access
- Free for 3 calendar months
- After it ends
- Reports stay readable; new crawls cannot start
- Account
- A free account with a confirmed email
Turning on Website SEO Audit does not turn on this tool. Each one has its own dates.
The full rules are in the Early Access terms.
Questions
Site crawl tool questions.
- Is this a full SEO audit?
- No. It maps your structure and links, and flags broken paths. It does not score pages. For a technical SEO check of each page, use Website SEO Audit.
- Will it find every page?
- It finds the pages it can reach through links, sitemaps, redirects and canonicals. Pages with no link and no sitemap entry stay hidden. A safeguard can also end a crawl early.
- Will it slow down my site?
- It sends one request at a time, with at least a second between them. It also gives way to other audits. If your site keeps refusing, it pauses.
- What if the crawl stops early?
- You still get a report. It is marked partial and says which limits it hit. Treat it as a sample, not the full site.
Free Early Access
Map your site with a site crawl.
Sign in, pick a site and start a crawl. Early Access is free for three months.