Screaming Frog

Screaming Frog

@screamingfrog.co.uk

Run by Founder Dan Sharp of Screaming Frog, a UK search marketing agency & developer of the SEO Spider. Gooner. SEO. & Philanthropist.

1K followers164 following117 posts

Screaming Frog reposted

🌿 GreenSEO is back at @brightonseo.com in October, exploring sustainability in the AI age. 🍻 Join us for a free night of SEO, sustainability and AI, with talks from Kiri Nowak-Smith, Ed Chinn and Jimmy Dorrell. 🎟 Tickets in comments. Proudly sponsored by @screamingfrog.co.uk and Climbing Trees.

Screaming Frog reposted

Too much football, too soon! Here's the FPL link to this year's SEO league Auto-join: fantasy.premierleague.com/leagues/auto... Code: 59636c @screamingfrog.co.uk Here you go. (P.S. I'm offering a minority stake in the league to private investors, totally above board and not at all corrupt)

fantasy.premierleague.comFantasy Premier League, Official Fantasy Football Game of the Premier LeagueOfficial Fantasy Premier League 2026/27. Free to play fantasy football game, set up your fantasy football team at the Official Premier League site.

Little tip - Under ‘Config > Spider > Limits’ you can limit the number of URLs crawled per subdomain. This little-known config can be useful when performing research, such as crawling a sample number of URLs per subdomain in list mode.

Little tip - If you don't want to keep crawls you can adjust the crawl retention settings via ‘File > Settings > Crawl Retention’ to auto delete after a period of time. You can also prevent projects and crawls from being cleaned up via right click 'Lock' in 'File > Crawls'.

Little tip - You can right click and 'Show Inlinks', 'Show Inlinks to Children', or perform the same for 'Outlinks' to see all inlink and outlink relationships in our site visualisations.

Little tip - You can fetch API data without any crawling. Just go to 'Mode > APIs', select your APIs such as GA4, GSC, PSI or link metrics - and upload the list of URLs to pull data quickly.

Screaming Frog reposted

My first public “vibe-coded” idea-to-product: storeratings.co Building this was fun but definitely tested my patience. A combination of Vercel, GitHub, and Cursor, I got there in the end. I am not a developer or designer, go easy.

Little tip - You can customise the OpenAI endpoint to use LLMs that are compatible with the OpenAI API format. For example, this means you can use Grok or DeepSeek by updating the endpoint, and API key.

Little tip - Learning how to debug why a page might be missing in a crawl is a valuable SEO skillset. Common reasons include - Not being linked to internally, JS, uncrawlable pagination, uncrawlable link types, search forms etc. Check out our tutorial - www.screamingfrog.co.uk/seo-spider/t...

screamingfrog.co.ukHow To Debug Missing Pages In A CrawlFind out why pages might be missing in a crawl, and how to debug and analyse why they are not being crawled.

Little tip - There are 'outside <head>' filters for key elements such as titles, canonicals, hreflang etc in their tabs. However, often the cause is an invalid element in the <head>, which closes it early. Check the Validation tab to see if this has been triggered when debugging.

Screaming Frog reposted