That One CrawlerDaddy mode

About

About That One Crawler

That One Crawler is a free SEO, GEO and AEO audit tool for blogs, made by independent developer Suman Debnath. It crawls up to 1,000 pages, scores each one for Google and for AI answers, checks whether AI agents can use the site, and explains every fix in plain English. No signup, no paywall.

By Updated

pages per scan
1,000
checks on every page
50+
AI agent readiness checks
24
fix-it guides
32
free focused tools
6
signups, paywalls or databases
0

What That One Crawler does

Paste a blog's address and That One Crawler reads its sitemap (or follows its links), fetches up to 1,000 pages a few at a time, and checks every one for the problems that stop posts from ranking or being quoted: missing or duplicate titles, thin content, broken links, keyword cannibalization, pages search engines can't index, missing structured data and slow, heavy pages.

Each page gets an SEO score and an AI search readiness score out of 100, and the site gets an AI agent readiness score from 24 checks on whether assistants like ChatGPT, Claude and Perplexity can reach and read it. Every finding links to a guide that explains the fix, and the whole list can be copied as one prompt for an AI coding agent.

Who makes it

That One Crawler is designed, built and run by Suman Debnath, an independent developer who builds AI and web tools. There's no company, investor or sales team behind it: one person, a Vercel hobby plan and a strong opinion that SEO tools shouldn't hide the useful parts behind a login.

The code is public on GitHub, so you can see exactly what it checks and how it scores.

Suman Debnath

Independent developer · maker of That One Crawler

Why it exists

It started as Crawl Daddy, a blog SEO scanner built with Python, Flask and a headless browser on Replit. It worked, but it had to be republished every 30 days to stay online.

In October 2026 it was rebuilt from scratch as That One Crawler: faster, free to run, always online, and extended for how search works now. Google still matters, but so do AI Overviews, ChatGPT search, Perplexity and the agents that browse for people, so every scan checks for all of them.

  1. Before

    Crawl Daddy

    Python, Flask and a headless browser on Replit. Worked well; had to be republished every 30 days to stay alive.

  2. October 2026

    That One Crawler

    Rebuilt from scratch on Next.js and Vercel. Always online, free to run, and checks AI search and AI agents too.

How we keep it honest

  • Evidence for every finding. Each issue says what we saw and where, so you can check it yourself.
  • Nothing invented. No made-up search volumes or traffic estimates. Keywords come from your own pages.
  • AI that sticks to the facts. AI rewrites only use facts found on your page, and say which model wrote them.
  • Your results stay yours. Scans are saved in your browser, not on our servers. We don't have a database.
  • Polite crawling. About six pages at a time, a clear user agent, and robots.txt rules for our bot are obeyed.

How it works under the hood

Your browser runs the crawl and calls small, stateless server functions that fetch and analyze each page, so the tool can run free on serverless hosting without a queue or a database. It's built with Next.js and React on Vercel, parses HTML with cheerio, gets speed data from Google PageSpeed Insights and the Chrome UX Report, and uses the free tiers of Groq and Google Gemini for its optional AI rewrites.

Curious what the crawler does on other people's sites? Meet the bot, or read how we handle your data.

Now point it at your own blog

Free, no signup, results in a couple of minutes. Your scans stay in your browser.

Frequently asked questions

Is That One Crawler really free?

Yes. Every audit and tool is free with no signup. The optional AI rewrites include 20 free actions a day, after which you can add your own free Gemini key.

Who is behind That One Crawler?

Suman Debnath, an independent developer. It's a personal project, not a company product, and it isn't funded by ads or by selling data.

Is That One Crawler open source?

The code is public on GitHub, so you can read exactly how every check and score works.

How is it different from other SEO audit tools?

It's built for blogs, checks up to 1,000 pages free, and scores AI search and AI agent readiness alongside classic SEO, with a plain-English guide for every issue.