Skip to content
Crawlable

Terms of Service

Crawlable measures what AI crawlers can read on your site and generates files that fix what it finds. It is a diagnostic tool, not a ranking service, and this page is explicit about that distinction.

Effective 16 October 2026. We will post any material change on this page before it takes effect.

01What the service does

Crawlable fetches pages from a website you nominate, exactly as a non-rendering crawler would — raw HTML, no JavaScript execution — and reports what such a crawler can read. It checks your robots.txt against a registry of known AI crawler tokens, inspects headings, metadata and structured data, and generates suggested replacement files.

Everything it produces is a measurement of your own site and a recommendation based on that measurement. You decide what to act on.

On a Continuous GEO Sentinel subscription, the service also re-crawls your registered domains automatically, every 7 days on Starter Sentinel and every 14 days on Growth Sentinel and Pro Sentinel, stores each result as a report on your licence, and emails the licence address when the score falls by 5 or more points or an AI search crawler that was allowed becomes blocked by your robots.txt.

02What the service does not do

Worth knowing

Crawlable does not influence, negotiate with, or have any relationship with OpenAI, Anthropic, Google, Perplexity, Meta or any other operator of an AI system or search engine. We cannot make your content appear in their answers, and nobody can sell you that outcome.

Specifically, we make no representation or guarantee that following our recommendations will cause your site to be cited, indexed, ranked, retrieved, summarised or mentioned by any third-party model, assistant or search product; that any change will produce traffic, leads or revenue; or that a crawler which reads your site today will continue to do so.

Those systems are operated by third parties who change their behaviour without notice and publish little about how they select sources. What we can tell you with confidence is whether your content is readable at all — which is a precondition for being used, not a promise of it.

Scores and grades are our own editorial assessment against our own published weighting. They are not an industry standard and carry no external authority.

03Your right to audit the site you submit

By submitting a URL you confirm that you own the site, or are authorised by its owner to have it crawled. Our crawler identifies itself honestly as CrawlableBot and is rate-limited. Because the audit exists to measure what an AI crawler would receive, it fetches the pages you nominate regardless of robots.txt directives — which is precisely why the authorisation above is required rather than optional. The one directive it does obey is an explicit opt-out: a User-agent: CrawlableBot group that disallows / stops us before a single page is fetched. See the CrawlableBot page.

We only fetch content that is already publicly reachable without authentication. We do not attempt to bypass logins, paywalls or access controls, and requests to private, internal or loopback addresses are refused outright.

04Licence for the files we generate

The audit produces files intended for your site — typically llms.txt, a suggested robots.txt, JSON-LD structured data and a FIXES.md summary.

These are yours. You may use, modify, publish, redistribute and commercialise them without restriction or attribution, including on behalf of clients. We claim no ownership of them and no ownership of your site's content. The licence survives cancellation, expiry and refund.

The Crawlable application, its scoring methodology, its written guidance and its crawler registry remain ours.

05Who may use this

Crawlable is a tool for people who run websites, sold to businesses and professionals. By using it you confirm you are at least 18, or the age of majority where you live if that is higher, and that if you are acting for a company you are authorised to agree to these terms on its behalf.

Worth knowing

We deliberately do not ask for your date of birth, and we ask nothing about children. The service is not directed to children, we have no reason to believe anyone under 13 uses it, and collecting ages would mean holding personal data we have no use for. If you believe a child has submitted information to us, tell us and we will delete it.

06Licence keys and acceptable use

A licence key is your credential. We store only a SHA-256 hash of it and show only its last four characters, which means we cannot recover a lost key for you — keep it somewhere safe. Treat it like a password; you are responsible for activity under your key.

You agree not to:

  • submit sites you neither own nor are authorised to audit;
  • use the service to probe, map or attack infrastructure;
  • share, resell or pool a single licence key across parties it was not bought for (agency use across your own clients is expressly permitted);
  • circumvent rate limits, quotas or credit accounting, or automate the interface to do so;
  • resell the raw audit output as a competing automated product, as distinct from delivering reports to your own clients, which is fine.

We may suspend a key we reasonably believe is being used this way. Where we do, we will say why, and unused credits will be refunded.

07Availability

The service is provided as-is. We do not offer an uptime commitment. Audits depend on third-party infrastructure and on the responsiveness of the site being audited; an audit may return a partial result when a site responds too slowly to finish within our processing budget, and the report will say so plainly when that happens.

08Limitation of liability

To the fullest extent permitted by law, our total liability arising out of or relating to the service is limited to the amount you paid us in the twelve months preceding the claim.

We are not liable for indirect, incidental, special or consequential loss, nor for lost profits, lost traffic, lost rankings, lost visibility in any AI system, or lost data — including where such loss follows from acting on a recommendation we made.

Worth knowing

The files we generate change how crawlers and search engines treat your site. A mistaken robots.txt can remove you from search results. Review every generated file before publishing it, and keep a backup of what you replace. You are responsible for what you deploy.

Nothing here excludes liability that cannot lawfully be excluded, including for fraud or for death or personal injury caused by negligence.

09Payment, refunds and changes

Payments are processed by Lemon Squeezy, which acts as merchant of record and is the seller for your transaction. Their terms govern the payment itself, and they handle applicable sales tax and VAT.

Every plan on sale is a Continuous GEO Sentinel subscription that renews monthly until you cancel it from your dashboard; cancelling stops the next renewal, and the service continues to the end of the month already paid for. Starter Sentinel starts with a 14-day free trial: Lemon Squeezy takes your payment details at sign-up and charges nothing until the trial ends, and cancelling during the trial means you are never charged. During the trial, audits, reports and alerts work in full; Fix Kit downloads unlock with the first payment. Licences bought as the retired one-time plans (Starter, Growth and Agency Pro) keep working until their scan window closes.

Refund terms are set out on the refunds page. How we handle your data is described in our privacy policy.

If we change these terms materially, the new version will be posted here with a new effective date before it applies. Continuing to use the service after that date means you accept the change; if you do not, stop using it and contact support@usecrawlable.com about any unused credits.

Questions

Anything here that is unclear, email support@usecrawlable.com. A real person reads it.