For website owners
SEOClaveBot: SEOClave's crawler
If you see SEOClaveBot in your logs, it's because someone ran an SEO audit or one of our free tools on your website at SEOClave. We don't crawl the web on our own.
What it does
- Audit: it reads your robots.txt, your sitemap and up to 10 pages (100 or 500 if the person has a plan), one request after another, never in parallel.
- Free tools: the robots.txt tester and the redirect checker only request the address that was typed.
- It respects your robots.txt: it doesn't go where you forbid it.
- If someone without an account asks for an audit of your site again within 24 hours, we give them the existing report: we don't visit you twice.
How it identifies itself
| Field | Value |
|---|---|
| User-agent | SEOClaveBot/0.1 (+https://seoclave.com/bot) |
| IP | 177.7.46.169 and 2a02:4780:75:1761::1 |
How to block it
Add this to your robots.txt. We'll stop auditing your site:
User-agent: SEOClaveBot
Disallow: /The AI crawler test
In every audit we check whether your server lets in the ChatGPT, Claude and Perplexity crawlers, because a robots.txt that says «come in» is no use if your CDN or a security plugin answers them with a 403. To do that we request only the audited page, once per crawler, presenting ourselves with its exact user-agent, plus a normal browser and a Googlebot for comparison. About 9 requests in total.
We only test the crawlers your robots.txt lets in. If you block GPTBot, we don't present ourselves as GPTBot. ChatGPT-User and Perplexity-User, which visit when a person asks the AI to, are always tested, because their companies state that robots.txt doesn't apply to them.
Contact
Something doesn't look right? Write to us at serviciosdigitalesenvenezuela@gmail.com and we'll look into it.
To see what your robots.txt lets each crawler do, use our robots.txt tester.