https://usecrawlable.com 2026-09-20T19:20:04.810Z weekly 1 https://usecrawlable.com/platforms 2026-09-20T19:20:04.810Z weekly 0.8 https://usecrawlable.com/ai-crawlers 2026-09-20T19:20:04.810Z weekly 0.8 https://usecrawlable.com/platforms/nextjs 2026-09-20T19:20:04.810Z monthly 0.7 https://usecrawlable.com/platforms/react 2026-09-20T19:20:04.810Z monthly 0.7 https://usecrawlable.com/platforms/wordpress 2026-09-20T19:20:04.810Z monthly 0.7 https://usecrawlable.com/platforms/shopify 2026-09-20T19:20:04.810Z monthly 0.7 https://usecrawlable.com/platforms/webflow 2026-09-20T19:20:04.810Z monthly 0.7 https://usecrawlable.com/platforms/squarespace 2026-09-20T19:20:04.810Z monthly 0.7 https://usecrawlable.com/platforms/wix 2026-09-20T19:20:04.810Z monthly 0.7 https://usecrawlable.com/platforms/astro 2026-09-20T19:20:04.810Z monthly 0.7 https://usecrawlable.com/platforms/framer 2026-09-20T19:20:04.810Z monthly 0.7 https://usecrawlable.com/platforms/vue-nuxt 2026-09-20T19:20:04.810Z monthly 0.7 https://usecrawlable.com/platforms/angular 2026-09-20T19:20:04.810Z monthly 0.7 https://usecrawlable.com/platforms/gatsby 2026-09-20T19:20:04.810Z monthly 0.7 https://usecrawlable.com/ai-crawlers/gptbot 2026-09-20T19:20:04.810Z monthly 0.6 https://usecrawlable.com/ai-crawlers/oai-searchbot 2026-09-20T19:20:04.810Z monthly 0.6 https://usecrawlable.com/ai-crawlers/chatgpt-user 2026-09-20T19:20:04.810Z monthly 0.6 https://usecrawlable.com/ai-crawlers/claudebot 2026-09-20T19:20:04.810Z monthly 0.6 https://usecrawlable.com/ai-crawlers/claude-searchbot 2026-09-20T19:20:04.810Z monthly 0.6 https://usecrawlable.com/ai-crawlers/claude-user 2026-09-20T19:20:04.810Z monthly 0.6 https://usecrawlable.com/ai-crawlers/perplexitybot 2026-09-20T19:20:04.810Z monthly 0.6 https://usecrawlable.com/ai-crawlers/perplexity-user 2026-09-20T19:20:04.810Z monthly 0.6 https://usecrawlable.com/ai-crawlers/google-extended 2026-09-20T19:20:04.810Z monthly 0.6 https://usecrawlable.com/ai-crawlers/applebot-extended 2026-09-20T19:20:04.810Z monthly 0.6 https://usecrawlable.com/ai-crawlers/amazonbot 2026-09-20T19:20:04.810Z monthly 0.6 https://usecrawlable.com/ai-crawlers/bytespider 2026-09-20T19:20:04.810Z monthly 0.6 https://usecrawlable.com/ai-crawlers/meta-externalagent 2026-09-20T19:20:04.810Z monthly 0.6 https://usecrawlable.com/ai-crawlers/cohere-ai 2026-09-20T19:20:04.810Z monthly 0.6 https://usecrawlable.com/ai-crawlers/mistralai-user 2026-09-20T19:20:04.810Z monthly 0.6