搜索「crawl scrape firecrawl fetch」的结果

io.github.steadyapi/scrapers

YouTube transcripts, Google Hotels prices, Google Ads Transparency, Google Trends and Threads posts.

io.github.sadri-dridi/agent-crawl-readiness

Bounded crawl-readiness check for agent access: robots.txt, sitemap.xml, llms.txt, homepage.

com.gramscraper/mcp

Public Instagram and TikTok data: profiles, posts, reels, stories, comments, hashtags and places.

io.github.newmediamadman/nm-signals

Audit webpage access for AI crawlers. API key and Premium or Partner plan required.

app.rowb.ai-visibility/audit

One-call audit: robots.txt AI-bot rules, llms.txt, JSON-LD, meta tags, sitemap. Score plus fixes.

com.upscrape/mcp

Real-time data APIs for 50+ commerce, grocery, social and maps platforms over one OAuth MCP server

com.lumnika/ai-crawler-readiness

Can AI crawlers read this site? GPTBot/ClaudeBot verdicts, robots vs edge blocking, 47k-domain index

dev.fetchwire/social-data

YouTube, TikTok, Instagram, X, Reddit, LinkedIn and Threads: public data in one schema.

io.github.brenton-keller/google-ads-transparency-center

Google Ads by domain or brand: creatives, formats, dates; or bulk-check which domains advertise.

io.github.ihen404/x402-scraper

Autonomous HTTP 402 Web Scraping Mesh on Base for $0.02 USDC.

io.github.DataLeadsPRO/web-scraper

Fetch, crawl, and browse protected pages with anti-bot handling - renders in a real browser and

io.brandfetch/brandfetch

搜索品牌，并从 Brandfetch API 获取设计资源、企业资料与其他品牌背景信息。

io.github.Ansarii/firecrawl-stealth-mcp

WAF-bypass web scraper and passive URL mapper for AI agents with zero pay-on-fail.

com.litescrape/litescrape-mcp-server

Google, Bing, DuckDuckGo and Google Maps search results, free without an API key.

io.github.paulovitorti/shopee-brasil-produtos

Produtos da Shopee Brasil por busca ou loja: preço, Pix, nota, cidade, loja e vendidos

io.github.Nero-Engine/depop-marketplace-monitor

Depop listings for searches or URLs, with alerts on new listings, price drops and sales.

dev.workers.pathwren.www/crawler-log-triage

对访问日志中的爬虫流量做归类与诊断，免费无需密钥（原文功能描述为未填写的占位符）。

com.transcriptfetch/youtube-transcripts

面向 YouTube、TikTok 与 Instagram 的生产级字幕转写 API，带 AI 转写兜底。

io.github.steadyfetch/steadyfetch-actors

Apify MCP pinned to 30 Steadyfetch actors: ad, video and audio transcripts, trends, jobs, Amazon

com.agishub/web-scraper

10 个按次付费的网页工具：Markdown 转换、CSS 抓取、链接提取、爬取、截图、PDF 与浏览器。

io.github.harshmaur/reddit-scraper

Reddit posts, comments, search, users & subreddits as JSON via Apify. No Reddit API key. $2/1k

io.github.sadri-dridi/fetch-status

HEAD a public URL and return status only.

io.github.sadri-dridi/web-fetch

HTTP status and content type for a public URL. Body discarded.

io.github.brenton-keller/telegram-channel-scraper

Public Telegram channel posts, views, reactions, media and subscriber counts. No login needed.