https://crawlr.ai/ 2026-04-22 daily 1.0 https://crawlr.ai/sandbox 2026-04-22 daily 0.9 https://crawlr.ai/features 2026-04-22 weekly 0.9 https://crawlr.ai/pricing 2026-04-22 weekly 0.9 https://crawlr.ai/auth 2026-04-22 monthly 0.6 https://crawlr.ai/forgot-password 2026-04-22 monthly 0.3 https://crawlr.ai/terms 2026-04-22 monthly 0.3 https://crawlr.ai/privacy 2026-04-22 monthly 0.3 https://crawlr.ai/features/full-site-crawling 2026-04-22 weekly 0.8 https://crawlr.ai/features/fast-scalable 2026-04-22 weekly 0.8 https://crawlr.ai/features/smart-crawl-control 2026-04-22 weekly 0.8 https://crawlr.ai/features/scheduled-crawls 2026-04-22 weekly 0.8 https://crawlr.ai/features/http-status-codes 2026-04-22 weekly 0.8 https://crawlr.ai/features/indexability-signals 2026-04-22 weekly 0.8 https://crawlr.ai/features/meta-content-analysis 2026-04-22 weekly 0.8 https://crawlr.ai/features/link-analysis 2026-04-22 weekly 0.8 https://crawlr.ai/features/crawl-graph 2026-04-22 weekly 0.8 https://crawlr.ai/features/orphan-page-detection 2026-04-22 weekly 0.8 https://crawlr.ai/features/diq-score 2026-04-22 weekly 0.8 https://crawlr.ai/features/api-access 2026-04-22 weekly 0.8