Back to Directory
Web Scraping MCP
Web Scraping
WebHarvest Ltd.
Intelligent web scraping with support for dynamic content, rate limiting, and ethical scraping practices.
1/13/2024
What is MCP?
Model Context Protocol (MCP) is an open protocol that allows you to provide custom tools to agentic LLMs (Large Language Models) in Cursor's Composer feature.
Installation Steps
Follow these steps to install the MCP tool in Cursor
1. Open Cursor Settings
Navigate to Cursor Settings > Features > MCP
2. Add New Server
Click the "+ Add New MCP Server" button
3. Configure the Server
Name:Give your server a nickname
Type:Select the transport type (stdio or sse)
Command/URL:Enter either SSE endpoint URL or shell command
Example Configurations
For stdio Server:
Command: node ~/mcp-quickstart/weather-server-typescript/build/index.jsFor SSE Server:
URL: http://example.com:8000/sseImportant Notes
- MCP tools may not work with all models
- MCP tools are only available to the Agent in Composer
- For servers requiring environment variables, create a wrapper script that sets the variables before running the server
Tags
web scraping
automation
data extraction
Details
Category
Web Scraping
Company
WebHarvest Ltd.
Status
Approved
Submitted
1/13/2024