🕷️网页抓取 MCP 推荐

Puppeteer

vlatest

基于Puppeteer的网页自动化和数据抓取MCP工具

Firecrawl

vlatest

基于Firecrawl的智能网页爬取和内容提取MCP工具

Apify Actors MCP服务器，提供与各种Apify Actor的交互能力，包括网页抓取、数据提取、社交媒体监控等功能

ByteFun AI MCP服务 - 打通产品设计、UI设计、代码开发的服务平台，支持设计稿转代码和跨平台原生代码开发。提供两大核心功能模块：UI设计优化 - 将用户输入的需求转换为带有UI设计规范的静态HTML+CSS设计提示词，实现设计稿到代码的转换；代码开发优化 - 将用户输入的需求转换为带有完整开发规则的TypeScript代码开发提示词，支持跨平台原生开发。

非官方的DeepWiki MCP服务器，通过MCP接收DeepWiki URL，爬取所有相关页面并转换为Markdown格式，可返回单个文档或按页面列表返回

Search, answer, and fetch Tako's knowledge base of 100K+ data charts, plus deep research agents.

A home for your agent's HTML artifacts - publish, pull, share and review them over MCP.

Deploy HTML/React artifacts from your AI client to hosted, share-gated URLs. Private by default.

Publish HTML, files, or a URL to a permanent public URL, then update it — from any MCP agent.

Etix event discovery for Claude — search events, venues & performers and fetch event details

Read-only Workday for Claude — fetch tasks, pay, benefits via your signed-in session

Generate HTML to PDF documents in bulk or single — raw replacements or based on conditions, loops

Human visual review for agent-built HTML: publish artifacts, pull anchored comments, push fixes.

Open-source web scraper for AI agents with scrape, crawl, and map tools

400 professional Agent Skills + workflow recipes — searchable & fetchable over MCP.

Host the HTML pages your AI generates and share each as a link with comments and access control.

Stealth browser for AI agents: fetch pages behind Cloudflare/DataDome/CAPTCHA, extract clean data.

Read-only MCP server for the OrchestKit docs: full-text search + Markdown fetch. No auth.

Pure-Go browser for AI: fetch pages, render JS without Chromium, return clean Markdown over MCP.

A job-search companion: tailor your CV to a role, score fit, fix ATS issues. Also via MCP.

Inspect a site's AI-search readiness: AI crawler access, llms.txt, schema markup, meta directives

Call 120+ AI models and live web context (scrape/crawl/extract) from any MCP client with one key

MCP server for SearXNG with engine targeting, multi-page fanout, and HTML→Markdown URL reading.

Verify citations in AI text: fetches each cited source, returns verdicts with evidence quotes.

x402 paying-fetch client for AI agents. Spending caps, approval, receipts. Non-custodial.

Gives AI agents a public IPv6 identity, hostname, port forwarding, web fetch, team mesh. Free tier.

Publish HTML or Markdown to a public URL in one call. Zero config, auto-registers on first use.

Safe, self-hosted web grounding for AI agents and crawlers over a stealth browser

Metalift MCP for AI agents: web search (2 credits), scrape, crawl, and map tools

The statistical analyst in your AI chat — validated, citable, re-runnable analysis of your data.

Cloud file relay: chunked uploads, folders, share links, inline text reads, ZIP packing.

Parse PDF/Word/PPT/HTML to Markdown; tables as JSON, image extraction, RAG chunking, page ranges.

Web scraping to clean Markdown with JS rendering, multi-page crawl, structured extract, sitemaps.

Autonomous web crawler. 17 browser tools + goal-driven run_goal agent. Single binary, stealth.

Bulk Bluesky profiles plus full follower/following exports via the open AT Protocol. Pay per record.

Track brand mentions & keywords on Bluesky. Sentiment, engagement, author reach. Pay per result.

AEO tools for AI agents: crawler permissions, llms.txt, structured data, AI-readiness audit.

Deterministic AI agent microtools, no accounts/API keys. fetch_extract: 98% token cut. 38 tools.

One-link team polls: create polls, vote, fetch results, and close polls.

Weekly 5-15 reports for executive teams: submit reports, fetch the Friday briefing.

Scrape, crawl, and map websites to Markdown or JSON via local CLI.

Find & fetch research datasets across 12 archives, omics registries, and literature sources.

HSM-backed vault secrets for AI agents (JIT fetch) plus prompt-injection and threat scanning.

Look up genes, fetch sequences, predict variant consequences, find orthologs and xrefs via Ensembl.

smartfetch direct-URL fetch, smartsearch web discovery, smartcrawl sites, and docs export MCP.

Backlink lookups and competitor gap analysis on Common Crawl's open web graph (4.4B links).

Social-video URL → transcript, frames, OCR text & metadata across 6 platforms. MCP, x402.

Search brands and retrieve design assets, company data, other brand context from Brandfetch's API