搜索「Crawler」的结果

io.github.shufflethis/geo-tool-check

Is this page readable for AI search? Crawler access, structure and citability checks, runs locally.

io.github.everyai-com/ai-ready

Scan and fix your site's AI discoverability: crawler access, llms.txt, JSON-LD. Free.

com.saastemly/crawl4agent

crawl4ai-compatible web crawler API: POST a URL.

site.crawlwise/crawlwise

SEO audits and AI crawler checks. Honest findings only; no invented scores.

io.github.Mingye-Lu/acrawl

自主网页爬虫：17 个浏览器工具，外加目标驱动的 run_goal 智能体；单二进制、隐身模式。

dev.agentbuilt/agentbuilt

Free AI-readiness audit of any URL: AI crawler rules, JS-free text, JSON-LD, llms.txt. Tool catalog.

io.github.jmshinhwa/tdm-reservation-lint

Finds the robots.txt lines that reserve nothing — retired crawler tokens, shadowed groups, rules abo

io.tranx/alice

Audit any site's AI visibility from your assistant: crawler access, rendering, and schema.

com.citevana/mcp

Free MCP tools for AI-search visibility: crawler checks, page audits, and llms.txt generation.

com.lastminutedealshq/ai-visibility

AI-search-visibility tools: check crawler access, generate llms.txt, lint robots.txt, census data.

io.github.iliasabk/geolint

ESLint for AI search: audits AI-crawler access, llms.txt, schema and citability.

com.tizonaintelligence/tizona

面向自主智能体的验证与路由：爬虫标识、邮箱、网页截取与数据路由。

com.see-geo/seegeo

Audit any website for AI visibility: graded report, findings with fixes, AI crawler access check.

com.brainiall/web

网页搜索、URL 内容转 Markdown 抽取、站点结构映射与递归网页抓取。

io.github.maxaeo/maxaeo-ai-visibility-mcp

本地优先的 MCP 服务器，用于 AI 可见度、GEO/AEO、llms.txt 与 AI 抓取友好度审计。

io.github.taylorsmithgg/crawl-census

Ask before you fetch: will this domain serve your crawler, refuse it, or charge it?

com.domduck/domduck

跟踪域名信誉随时间的变化：Domain Rating、Tranco 排名、TLS 与 AI 爬虫策略。

net.hogarmas/blindspot

Free AI crawler checks, Agent Surface audits, A2A actions and optional x402 evidence packs.

com.momenticmarketing/momentic

免费的 SEO、GEO 与 AEO 审计：分析任意页面或域名、AI 爬虫访问情况与智能体适配度。

io.github.kopachlager/prerenderbuddy-mcp

Local MCP tools for crawler-readability and discovery-file diagnostics.

io.github.apifymcpfactory-droid/llms-txt-checker

Checks llms.txt, AI crawler access in robots.txt, and sitemap - with a 0-100 AI readiness score.

io.github.Bigsupe55/geo-inspector-mcp

检查站点的 AI 搜索就绪度：AI 爬虫访问、llms.txt、schema 结构化标记与 meta 指令。

io.github.arthurcarlsonn/aeo-mcp

面向 AI 智能体的 AEO 工具：爬虫权限、llms.txt、结构化数据与 AI 就绪度审计。

io.github.us/fastcrw

抓取、爬取、映射并搜索网页——开源、可自托管的 Rust 爬虫与搜索引擎，面向 AI 智能体。