Site Crawl & Link Graph
Crawl your own pages the way search engines see them, and see how your entries link to each other. Only your site is requested, unless you turn on external link checks.
Running a crawl
- Click "Crawl the Site"
On the Site Crawl tab (or the Dashboard). Keep the tab open while it runs: "Reading pages", "Checking links", "Reading the XML sitemap".
- If it stops
Click Continue to pick up where it left off. A new crawl replaces the old one; the previous report stays visible until the new one finishes.
- Or schedule it
Set Crawl Automatically to Weekly; it then runs in the background.
- Cards: Pages crawled, Broken pages, Broken links, Redirect chains, Canonical issues, Indexation conflicts
- A results table, e.g. Canonical Conflicts
Settings
Under Pro Settings → Pro Features → Site Crawl:
The home page, then your most recently changed entries, then the largest archives, up to this number.
Off or Weekly.
Also check up to 100 links to other sites. Those sites receive a request from your server.
The crawler reads a fixed list of pages (it doesn't discover new pages through links); links on those pages are then checked for their status. It identifies itself as Siteryn SEO Crawler.
What a crawl reports
| Section | Flags |
|---|---|
| Broken Pages | Crawled pages answering 4xx/5xx or not at all. |
| Broken Links | Link targets answering 4xx/5xx, with up to 3 pages that link to each. |
| Redirect Chains & Loops | More than one redirect in a row, a loop, or a redirect that ends at an error. |
| Canonical Conflicts | No canonical, several canonicals, canonical to another address, to a redirect, to a broken page or to a noindex page. |
| Indexation Conflicts | In the sitemap but noindex, canonicalized elsewhere, blocked by robots.txt or not answering 200; or indexable but missing from the sitemap. |
| Titles, Descriptions & Headings | No title, no meta description, no H1, several H1s (indexable pages only). |
| Duplicate Titles & Descriptions | The same title or description on two or more indexable pages. |
| Structured Data Conflicts | Invalid or conflicting JSON-LD on the page. |
| Mixed Content & Slow Pages | Resources loaded over http:// on HTTPS pages; pages taking more than 2000 ms. |
| Sitemap & robots.txt | Sitemap reachable and how many addresses it lists, plus robots.txt checks (below). |
Each table shows 20 rows; download all findings as CSV from Reports. The result also appears in the free plugin's Health Checks as "Site crawl".
robots.txt checks
- Lines that aren't "Field: value", unknown directives, and rules before any User-agent line.
- Blocks the whole site (
Disallow: /for every crawler): a problem. - No
Sitemap:line, and WordPress installed in a subfolder (crawlers read robots.txt only at the domain root). - Crawl-delay is noted: Google ignores it.
Link Graph
Built from the Content Audit: how your entries link to each other. Nothing on the site changes.
| Section | What it shows |
|---|---|
| Click Depth | Clicks from the home page (your front page and posts page are 0, entries in a menu are 1), then through content links. 4 clicks or more is deep. Keep important pages within three clicks. |
| Link Equity | Entries that receive the most internal linking (100 = strongest), calculated PageRank-style from content links. Strongly linked entries with a weak SEO analysis are listed to fix first. |
| Link Suggestions | Orphaned or deep entries, with up to 3 strong entries on the same topic that don't yet link to them. Add the links by hand. |
| Dead Ends | Entries that link to no other entry (products excluded). Add a next step for the reader. |
A true orphan has no link from another entry, isn't your home or posts page, and isn't in a menu. The count appears on the cards and the Dashboard.