Agent Scraper Mcp
Web scraping MCP server for AI agents. 6 tools: clean content extraction, structured scraping with CSS selectors, full-page screenshots via Playwright, link extraction, metadata extraction (OG/Twitter cards), and Google search. Free tier with x402 micropayments.
Install Agent Scraper Mcp
Install instructions vary — visit the GitHub repository for the latest install command. Most MCP servers follow one of three patterns: npx -y <package> for Node, uvx <package> for Python, or docker run <image> for containerized servers.
Use Agent Scraper Mcp with Claude Code
Once the server is on your machine, register it with Claude Code so the agent can call it like any other tool. The general pattern is:
claude mcp add aparajithn-agent-scraper-mcp -- <install-command>After it's registered, run claude and ask anything that requires Agent Scraper Mcp. Claude Code will negotiate the MCP handshake and surface the server's tools, prompts, and resources to the model automatically. See our Claude Code MCP guide for environment variables, scope flags, and credential handling.
What this server is for
Agent Scraper Mcp sits in the browser automation category. It's community-maintained — check the repo's last-commit date and open issues before depending on it in production. The full description from the source list:
Web scraping MCP server for AI agents. 6 tools: clean content extraction, structured scraping with CSS selectors, full-page screenshots via Playwright, link extraction, metadata extraction (OG/Twitter cards), and Google search. Free tier with x402 micropayments.
FAQ
Is Agent Scraper Mcp free?
Yes — every MCP server in the ClawHire directory is open-source or freely available. Some servers proxy to paid APIs (you supply your own keys), but the server itself is free.
Does it work with Claude Desktop / Cursor / Windsurf?
If a client speaks the Model Context Protocol, it can use this server. The transport (stdio vs SSE vs HTTP) needs to match what the client supports, but the server itself is client-agnostic.
How do I report a bug or contribute?
Open an issue or PR on the GitHub repository.
More browser automation servers
An MCP Server Integration with Apple Shortcuts
Automate your local browser
An MCP server using Playwright for browser automation and webscrapping
A MCP server that supports searching for Bilibili content. Provides LangChain integration examples and test scripts.
Native Safari browser automation for AI agents with 80+ tools. No Chrome dependency, optimized for Apple Silicon with 60% less CPU overhead.
Browser automation capabilities using Puppeteer, both support local and remote browser connection.