Terms of Service

Crawlable fetches pages from a website you nominate, exactly as a non-rendering crawler would — raw HTML, no JavaScript execution — and reports what such a crawler can read. It checks your robots.txt against a registry of known AI crawler tokens, inspects headings, metadata and structured data, and generates suggested replacement files.

Everything it produces is a measurement of your own site and a recommendation based on that measurement. You decide what to act on.

Specifically, we make no representation or guarantee that following our recommendations will cause your site to be cited, indexed, ranked, retrieved, summarised or mentioned by any third-party model, assistant or search product; that any change will produce traffic, leads or revenue; or that a crawler which reads your site today will continue to do so.

Those systems are operated by third parties who change their behaviour without notice and publish little about how they select sources. What we can tell you with confidence is whether your content is readable at all — which is a precondition for being used, not a promise of it.

Scores and grades are our own editorial assessment against our own published weighting. They are not an industry standard and carry no external authority.

By submitting a URL you confirm that you own the site, or are authorised by its owner to have it crawled. Our crawler identifies itself honestly as CrawlableBot, is rate-limited, and obeys directives in the target site's robots.txt.

We only fetch content that is already publicly reachable without authentication. We do not attempt to bypass logins, paywalls or access controls, and requests to private, internal or loopback addresses are refused outright.

The audit produces files intended for your site — typically llms.txt, a suggested robots.txt, JSON-LD structured data and a FIXES.md summary.

These are yours. You may use, modify, publish, redistribute and commercialise them without restriction or attribution, including on behalf of clients. We claim no ownership of them and no ownership of your site's content. The licence survives cancellation, expiry and refund.

The Crawlable application, its scoring methodology, its written guidance and its crawler registry remain ours.

A licence key is your credential. We store only a SHA-256 hash of it and show only its last four characters, which means we cannot recover a lost key for you — keep it somewhere safe. Treat it like a password; you are responsible for activity under your key.

You agree not to:

• submit sites you neither own nor are authorised to audit;
• use the service to probe, map or attack infrastructure;
• share, resell or pool a single licence key across parties it was not bought for (agency use across your own clients is expressly permitted);
• circumvent rate limits, quotas or credit accounting, or automate the interface to do so;
• resell the raw audit output as a competing automated product, as distinct from delivering reports to your own clients, which is fine.

We may suspend a key we reasonably believe is being used this way. Where we do, we will say why, and unused credits will be refunded.

The service is provided as-is. We do not offer an uptime commitment. Audits depend on third-party infrastructure and on the responsiveness of the site being audited; an audit may return a partial result when a site responds too slowly to finish within our processing budget, and the report will say so plainly when that happens.

To the fullest extent permitted by law, our total liability arising out of or relating to the service is limited to the amount you paid us in the twelve months preceding the claim.

We are not liable for indirect, incidental, special or consequential loss, nor for lost profits, lost traffic, lost rankings, lost visibility in any AI system, or lost data — including where such loss follows from acting on a recommendation we made.

Nothing here excludes liability that cannot lawfully be excluded, including for fraud or for death or personal injury caused by negligence.

Payments are processed by Lemon Squeezy, which acts as merchant of record and is the seller for your transaction. Their terms govern the payment itself, and they handle applicable sales tax and VAT.

Refund terms are set out on the refunds page. How we handle your data is described in our privacy policy.

If we change these terms materially, the new version will be posted here with a new effective date before it applies. Continuing to use the service after that date means you accept the change; if you do not, stop using it and contact support@usecrawlable.com about any unused credits.