About Our Crawler

If you found TechSEO in your server logs, this page explains who it is and how to control it.

What it is

TechSEO is a free SEO audit tool. A visitor types in a website address and the crawler checks the pages of that website for technical problems such as broken links and missing page titles. It does not index your content, does not publish it and does not sell it.

How it behaves

  • The user agent is TechSEO/1.0 (+https://techseo.online/about-our-crawler/).
  • It reads robots.txt first and does not fetch pages that file blocks.
  • It requests one URL at a time with a short pause between requests.
  • Each crawl is limited to a fixed number of pages.

How to block it

Add this to the robots.txt file of your website:

User-agent: TechSEO
Disallow: /

Questions or abuse reports

Please use the contact page and include the website address and the time of the requests.