🕷️网页抓取 MCP 推荐

Publish HTML, files, or a URL to a permanent public URL, then update it — from any MCP agent.

Etix event discovery for Claude — search events, venues & performers and fetch event details

Read-only Workday for Claude — fetch tasks, pay, benefits via your signed-in session

Generate HTML to PDF documents in bulk or single — raw replacements or based on conditions, loops

Human visual review for agent-built HTML: publish artifacts, pull anchored comments, push fixes.

Open-source web scraper for AI agents with scrape, crawl, and map tools

400 professional Agent Skills + workflow recipes — searchable & fetchable over MCP.

Host the HTML pages your AI generates and share each as a link with comments and access control.

Stealth browser for AI agents: fetch pages behind Cloudflare/DataDome/CAPTCHA, extract clean data.

Read-only MCP server for the OrchestKit docs: full-text search + Markdown fetch. No auth.

Pure-Go browser for AI: fetch pages, render JS without Chromium, return clean Markdown over MCP.

A job-search companion: tailor your CV to a role, score fit, fix ATS issues. Also via MCP.

Inspect a site's AI-search readiness: AI crawler access, llms.txt, schema markup, meta directives

Call 120+ AI models and live web context (scrape/crawl/extract) from any MCP client with one key

MCP server for SearXNG with engine targeting, multi-page fanout, and HTML→Markdown URL reading.

Verify citations in AI text: fetches each cited source, returns verdicts with evidence quotes.

x402 paying-fetch client for AI agents. Spending caps, approval, receipts. Non-custodial.

Gives AI agents a public IPv6 identity, hostname, port forwarding, web fetch, team mesh. Free tier.

Publish HTML or Markdown to a public URL in one call. Zero config, auto-registers on first use.

Safe, self-hosted web grounding for AI agents and crawlers over a stealth browser

Metalift MCP for AI agents: web search (2 credits), scrape, crawl, and map tools

The statistical analyst in your AI chat — validated, citable, re-runnable analysis of your data.

Cloud file relay: chunked uploads, folders, share links, inline text reads, ZIP packing.

Parse PDF/Word/PPT/HTML to Markdown; tables as JSON, image extraction, RAG chunking, page ranges.

Web scraping to clean Markdown with JS rendering, multi-page crawl, structured extract, sitemaps.

Autonomous web crawler. 17 browser tools + goal-driven run_goal agent. Single binary, stealth.

Bulk Bluesky profiles plus full follower/following exports via the open AT Protocol. Pay per record.

Track brand mentions & keywords on Bluesky. Sentiment, engagement, author reach. Pay per result.

AEO tools for AI agents: crawler permissions, llms.txt, structured data, AI-readiness audit.

Deterministic AI agent microtools, no accounts/API keys. fetch_extract: 98% token cut. 38 tools.

One-link team polls: create polls, vote, fetch results, and close polls.

Weekly 5-15 reports for executive teams: submit reports, fetch the Friday briefing.

Scrape, crawl, and map websites to Markdown or JSON via local CLI.

Find & fetch research datasets across 12 archives, omics registries, and literature sources.

HSM-backed vault secrets for AI agents (JIT fetch) plus prompt-injection and threat scanning.

Look up genes, fetch sequences, predict variant consequences, find orthologs and xrefs via Ensembl.

smartfetch direct-URL fetch, smartsearch web discovery, smartcrawl sites, and docs export MCP.

Backlink lookups and competitor gap analysis on Common Crawl's open web graph (4.4B links).

Social-video URL → transcript, frames, OCR text & metadata across 6 platforms. MCP, x402.

Search brands and retrieve design assets, company data, other brand context from Brandfetch's API

List, fetch and search AI Daily Insights — a Chinese daily AI-industry briefing built for agents.

Universal web scraper with LLM-ready markdown, RAG chunking, PDF/DOCX support.

Search, scrape, and crawl the web for AI agents. Batch scraping and answers with citations.

Fetch your Trackman Golf stats (handicap, rounds, shots, club gapping) as MCP tools.

Web scraping for AI agents: fetch any page via proxy or full browser, past anti-bot defenses.

Extract data from any website with thousands of scrapers, crawlers, and automations on Apify Store ⚡

Scrape Shopify App Store apps, full review histories and catalog. E-commerce market research.

Scrape Bluesky posts, profiles, followers, threads and keyword search. Clean JSON, pay per result.