Broken Links Checker — Crawl Pages, Assets & Redirect Chains
v1.0.11
io.github.kriton-dev/broken-links
Find broken links on a website: crawls its pages and reports 404s, errors and redirect chains
“Crawl” 共 116 个结果
v1.0.11
io.github.kriton-dev/broken-links
Find broken links on a website: crawls its pages and reports 404s, errors and redirect chains
v1.0.52
com.crawlwitness/oracle
AI consent & licensing check for any domain, with signed on-chain receipts. Paid via x402.
v0.2.1
io.github.pipeworx-io/firecrawl
Firecrawl MCP,封装 Firecrawl API(firecrawl.dev)。
v0.1.0
io.github.Nero-Engine/ai-crawler-access-checker
Shows if GPTBot, ClaudeBot, PerplexityBot and other AI crawlers can read each site in a list.
v0.1.3
com.webcrawlerapi/mcp-server
Turn any web page into clean Markdown for your AI assistant. OAuth sign-in, no API key.
v0.2.1
io.github.pipeworx-io/crawlbase
Crawlbase MCP — wraps the Crawlbase Crawling API (crawlbase.com, formerly ProxyCrawl).
v0.2.1
io.github.pipeworx-io/crawlgraph
CrawlGraph MCP — backlink intelligence on the public Common Crawl webgraph (4.4B edges.
v0.2.1
io.github.pipeworx-io/commoncrawl
Common Crawl's public web archive — find every time a URL was crawled since 2008 and read.
v1.0.0
com.crawlerzoo/arena
Games for AI agents: negotiation, social deduction, racing and puzzles, vs bots and agents.
v1.0.2
dev.oassis/scraper-crawler
Web Tools and Web Tasks for AI agents. 100-credit MCP trial; API-key credits or x402.
v1.8.0
app.openkrill/site-check
Check public pages for SEO tags, AI crawler rules, AI citation signals and landing page conversion.
v1.0.0
com.insightfulpipe/enrichment
Hosted Enrichment Crawlers MCP server, with each action switched on or off per account.
v1.0.0
com.insightfulpipe/crawler
Hosted Web Crawler MCP server for Claude, ChatGPT and Cursor, with each action switched per account.
v1.0.0
dev.workers.quietworklabs.robots-check/robots-check
robots.txt tester (RFC 9309), AI crawler access (GPTBot, ClaudeBot...) and sitemap check.
v0.4.2
io.github.clearcrawl/clearcrawl
Any URL to clean markdown/JSON; PDF, XLSX, CSV, DOCX to text and tables. Free tier for agents.
v1.0.0
xyz.crawlhive/crawlhive
Memecoin safety scanner for Solana, BNB and Robinhood Chain with an onchain track record
v1.0.0
io.github.realtycrawl/realtycrawl
Search source-linked real estate observations with capability discovery and bounded credits.
v1.0.0
com.crawlerdata/google-shopping-serp
Google Shopping products and seller prices, plus Google Search, Images, News and Local results.
v1.0.0
com.jobcrawls/connector
Search jobs in Finland and calculate net salary. Read-only, no login. English, Finnish, Swedish.
v1.0.1791044090
com.saastemly/crawl4agent
crawl4ai-compatible web crawler API: POST a URL.
v1.0.3
io.github.prismcrawl/prismcrawl
Live Google, Bing, Amazon, Maps, Yelp & app store data. As low as $0.15/1K successes; failures free.
v0.1.1
com.ranovam/flarum-scraper
搜索或监控任意 Flarum 论坛的讨论、回复、参与者。
v1.0.0
com.monocrawl/mcp
Public social media, search and e-commerce data from 70+ platforms, on one API key.
v1.0.0
io.github.sadri-dridi/agent-crawl-readiness
Bounded crawl-readiness check for agent access: robots.txt, sitemap.xml, llms.txt, homepage.