ai-crawler-readiness
v1.0.0
com.lumnika/ai-crawler-readiness
Can AI crawlers read this site? GPTBot/ClaudeBot verdicts, robots vs edge blocking, 47k-domain index
“Crawler” 共 82 个结果
v1.0.0
com.lumnika/ai-crawler-readiness
Can AI crawlers read this site? GPTBot/ClaudeBot verdicts, robots vs edge blocking, 47k-domain index
v1.7.0
dev.workers.pathwren.www/crawler-log-triage
对访问日志中的爬虫流量做归类与诊断,免费无需密钥(原文功能描述为未填写的占位符)。
v1.6.0
dev.workers.pathwren.www/ai-crawler-index
查询与统计抓取本站的 AI 爬虫索引情况,免费无需密钥(原文功能描述为未填写的占位符)。
v1.4.0
dev.workers.pathwren.www/crawler-ip-verifier
校验来访 IP 是真实的 Googlebot 等爬虫还是假冒者,免费无需密钥(原文功能描述为未填写的占位符)。
v4.1.2
com.crimsoncrawler/mcp-server
通过 80 余个类型化 MCP 工具对威胁情报进行富化、检索、评估与管理。
v1.4.2
com.actablesite/ai-crawler-robots-monitor
检查 AI 爬虫的 robots.txt 策略,并监控公开站点的策略、sitemap 与 llms.txt 变化。
v1.4.1
com.actablesite/readiness
检查 AI 爬虫的 robots.txt 策略,并监控公开站点的策略、sitemap 与 llms.txt 变化。
v0.2.1
io.github.shulex-voc/smart-crawler
电商竞品情报、VOC 情感分析、Amazon ASIN 分析与 Reddit 增长方案。
v1.0.0
io.github.lazymac2x/ai-crawler-policy
部署在 Cloudflare Workers 上的 MCP 服务器:ai-crawler-policy。
v1.0.2
dev.oassis/scraper-crawler
Web Tools and Web Tasks for AI agents. 100-credit MCP trial; API-key credits or x402.
v1.0.0
io.github.saulius876-lgtm/website-content-crawler
Web pages and whole sites to clean Markdown for RAG and AI agents. Crawls links and sitemaps.
v1.0.2
ai.seocrawl/mcp
来自 SEOcrawl AI 的实时 Google Search Console 数据、关键词与页面分析、站点审计及 SEO 任务。
v1.0.5
com.atlas-compiler/atlas
Deterministic Zero-LLM Web Compiler, Scraper, Crawler, and Site Mapper for AI Agents.
v1.0.0
ai.tsoden.serp/ai-visibility-audit
Free live checks: AI crawler access, llms.txt, entity schema and AI-search readiness of any site.
v1.3.0
com.engagemii/citation-watch
AI visibility of 82M+ companies: scores, AI crawler reads, full records. Free 500 and 1M datasets.
v0.1.2
com.visdenda/free
Anonymous SEO MCP: crawler directory, robots.txt, llms.txt, update radar, page scan. No API key.
v1.0.1
com.402registry/402registry
Does an AI crawler see your site? Free registry lookup, x402 pricing; checks paid in USDC on Base.
v0.1.1
io.github.RDUK98/ai-visibility-auditor
Free checks of AI crawler root rules, JSON-LD and HTML metadata. No ranking measurement.
v1.1.0
io.github.Red-Center-Studio/rcs-tools
Free website checks: AI search readiness, AI crawler access, domain health, DNS risks. No key.
v1.0.1
ai.preferly/preferly
Free AI visibility checks for any website: AI crawler access, llms.txt, schema, business info.
v0.1.1
io.github.stellalytics/website-domain-intelligence
Tech stack, WHOIS, DNS, SPF/DMARC, SSL expiry and AI crawler rules per domain. Runs on Apify.
v1.0.0
com.seoclave/seoclave
Google keyword data for Latin America plus technical SEO, robots.txt, DNS and AI-crawler checks.
v1.0.2
io.github.michaelvereb/agentauditai
Autonomous AI agent readiness, crawler reachability, and 30-point audit specification engine.
v1.0.0
com.profullstack/crawlproof
AI-crawler audits + ads (crawlproof.com)