📖 Quick Summary
Tool: Screaming Frog SEO Spider
Difficulty: Beginner
Reading Time: 6 minutes
Business Impact: ⭐⭐⭐⭐☆
Internal
What this means
An internal URL is a page that belongs to your own website and can be crawled by Screaming Frog SEO Spider.
Why this matters to the business
Internal pages are the pages that generate traffic, leads and revenue. If they cannot be crawled properly, search engines may struggle to understand your website.
How Growth Architect AI identifies this
By analysing Screaming Frog crawl data and evaluating each internal page alongside Google Search Console and Google Analytics 4 performance data.
What to do about it
Ensure important internal pages are accessible, indexable and properly linked throughout your website.
Related terms
External • Crawl Depth • Indexability • Inlinks
External
What this means
An external URL points to a page that exists on another website.
Why this matters to the business
External links help search engines understand your website’s relationships with trusted sources and can improve user experience when linking to useful information.
How Growth Architect AI identifies this
By analysing every outbound link discovered during the Screaming Frog crawl.
What to do about it
Regularly check external links to ensure they remain active and point to reputable websites.
Related terms
Internal • Outlinks • Broken Links
URL
What this means
A URL is the unique web address used to access a page, image or file on your website.
Why this matters to the business
Every page that generates traffic, leads or sales has its own URL. Well-structured URLs are easier for users and search engines to understand.
How Growth Architect AI identifies this
Every crawled page, image and resource is analysed using its unique URL.
What to do about it
Keep URLs short, descriptive and consistent. Avoid unnecessary parameters where possible.
Related terms
Address • Internal • Canonical URL
Address
What this means
The Address column in Screaming Frog displays the exact URL being analysed.
Why this matters to the business
It allows you to identify precisely which page contains an issue or opportunity without confusion.
How Growth Architect AI identifies this
The Address field becomes the primary reference point when analysing SEO issues across multiple datasets.
What to do about it
Use the Address to investigate the page inside your CMS or browser before making changes.
Related terms
URL • Internal
Content type
What this means
Content Type identifies the type of resource returned by the server, such as HTML, PDF, image or JavaScript.
Why this matters to the business
Different content types require different optimisation strategies. Search engines treat HTML pages differently from PDFs, images and other file types.
How Growth Architect AI identifies this
By analysing the HTTP response headers collected during the crawl.
What to do about it
Ensure your important landing pages are served as HTML and optimise other content types appropriately.
Related terms
Status Code • HTML • PDF
Status code
What this means
A Status Code is the response returned by your web server when a page is requested.
Why this matters to the business
Status codes tell search engines whether a page exists, has moved, contains an error or is temporarily unavailable.
How Growth Architect AI identifies this
Every crawled URL is assigned its corresponding HTTP status code.
What to do about it
Investigate anything other than a 200 response to ensure users and search engines can access important pages.
Related terms
200 OK • 301 Redirect • 404 Not Found
Status
What this means
Status provides a simplified description of the page’s accessibility based on its HTTP response.
Why this matters to the business
It quickly highlights pages that require attention without needing to interpret technical response codes.
How Growth Architect AI identifies this
By translating HTTP responses into readable crawl statuses.
What to do about it
Review pages marked as redirects, client errors or server errors to ensure they are functioning correctly.
Related terms
Status Code • Crawl • Redirect
Indexability
What this means
Indexability indicates whether search engines are allowed to include a page within their search results.
Why this matters to the business
If an important page is not indexable, it cannot appear in Google search results, regardless of how good the content is.
How Growth Architect AI identifies this
By analysing robots directives, canonical tags, HTTP responses and crawl behaviour.
What to do about it
Ensure important pages are indexable while preventing low-value pages from being indexed unnecessarily.
Related terms
Noindex • Canonical • Robots.txt
Indexability status
What this means
Indexability Status explains why a page is or is not indexable.
Why this matters to the business
Understanding why a page cannot be indexed allows you to fix problems before they impact search visibility.
How Growth Architect AI identifies this
By combining crawl data, meta robots directives, canonical tags and HTTP responses.
What to do about it
Review the reported reason and resolve any unintended indexing restrictions.
Related terms
Indexability • Noindex • Canonicalised
Crawl depth
What this means
Crawl Depth measures how many clicks away a page is from your homepage.
Why this matters to the business
Pages buried deep inside your website are harder for users and search engines to discover, making them less likely to generate traffic or revenue.
How Growth Architect AI identifies this
By analysing the crawl path generated by Screaming Frog SEO Spider and highlighting pages located several levels away from the homepage.
What to do about it
Improve internal linking so important pages are easier to reach from your main navigation or relevant content.
Related terms
Internal Links • Inlinks • Orphan Pages • Site Architecture