web-scout
A powerful MCP server extension providing web search and content extraction capabilities. Integrates DuckDuckGo search functionality and URL content extraction into your MCP environment, enabling AI assistants to search the web and extract webpage content programmatically.
claude mcp add --transport stdio pinkpixel-dev-web-scout-mcp npx -y @pinkpixel/web-scout-mcp@latest
How to use
Web Scout MCP Server provides a privacy-conscious web search and content extraction service accessible via an MCP client. It exposes two core tools: DuckDuckGoWebSearch for performing fast, structured web searches through the DuckDuckGo engine, and UrlContentExtractor for fetching and extracting clean, readable text from web pages. The server is designed to handle multiple URLs in parallel and includes memory-optimized operation with intelligent rate limiting, making it suitable for embedding in larger workflows or client applications.
To use the server, install the MCP package and run the CLI either globally or locally. You can also configure your MCP client to launch the server using npx or a local installation. The provided tools can be invoked by your MCP client by referencing their input schemas (query and maxResults for DuckDuckGoWebSearch; one or more URLs for UrlContentExtractor). Example inputs are provided in the README, illustrating typical usage and structure.
How to install
Prerequisites:
- Node.js >= 18.0.0
- npm (or yarn)
Install options:
-
Global installation (recommended for quick use): npm install -g @pinkpixel/web-scout-mcp
Run the server
web-scout-mcp
-
Local installation (for project-based usage): mkdir my-project cd my-project npm init -y npm install @pinkpixel/web-scout-mcp
Run via npx
npx @pinkpixel/web-scout-mcp
-
Using via MCP config (as a client reference): Add to your MCP client config: { "mcpServers": { "web-scout": { "command": "npx", "args": ["-y", "@pinkpixel/web-scout-mcp@latest"] } } }
Notes:
- The server provides two MCP tools: DuckDuckGoWebSearch and UrlContentExtractor.
- You can refer to the README for exact input/output formats for each tool.
- If embedding the package yourself, consider setting WEB_SCOUT_DISABLE_AUTOSTART=1 to prevent automatic bootstrap when using createServer().
Additional notes
Tips and common considerations:
- Environment variables: WEB_SCOUT_DISABLE_AUTOSTART=1 can prevent automatic bootstrap when embedding the package and calling createServer().
- By default, running the published entrypoint (e.g., node dist/index.js or npx @pinkpixel/web-scout-mcp) bootstraps the stdio transport for MCP communication.
- The server supports parallel processing for multiple URLs and includes memory optimization to prevent crashes.
- If you encounter issues with starting via npx, ensure npm is up to date and your network allows package fetches from the npm registry.
- The MCP client config example in the README demonstrates how to wire the server into an MCP workflow; you can customize the server name (e.g., web-scout) to fit your project.
- Check the LICENSE and Node.js version requirements in the README to ensure compatibility.
Related MCP Servers
agentor
Fastest way to build and deploy reliable AI agents, MCP tools and agent-to-agent. Deploy in a production ready serverless environment.
mikrotik
MCP server for Mikrotik
bitbucket
Bitbucket MCP - A Model Context Protocol (MCP) server for integrating with Bitbucket Cloud and Server APIs
mcp-document-converter
MCP Document Converter - A powerful MCP tool for converting documents between multiple formats, enabling AI agents to easily transform documents.
web-search
A Model Context Protocol (MCP) server that provides web search functionality using a headless Chrome browser to scrape Google, DuckDuckGo and Bing search results.
mcp-tidy
CLI tool to visualize and manage MCP server configurations in Claude Code. List servers, analyze usage statistics, and clean up unused servers