crawl4ai
pipStandardThe crawl4ai MCP server provides local developers with efficient internet search and content retrieval for LLMs. It exposes tools to fetch web content, parse HTML, and extract structured data. It connects to web APIs and search engines. Developers use it to build AI agents that need to retrieve and process web data without consuming excessive tokens.
127290Updated 1 month ago
Overview
The crawl4ai MCP server provides local developers with efficient internet search and content retrieval for LLMs. It exposes tools to fetch web content, parse HTML, and extract structured data. It connects to web APIs and search engines. Developers use it to build AI agents that need to retrieve and process web data without consuming excessive tokens.
Installation
1Install the package
pip
pip install crawl4ai-mcp-server2Add to Claude
Add this configuration to your claude_desktop_config.json:
claude_desktop_config.json
{
"mcpServers": {
"weidwonder-crawl4ai-mcp-server-github": {
"command": "uvx",
"args": [
"pip install crawl4ai-mcp-server"
]
}
}
}3Verify installation
Restart Claude Desktop, then ask:
"What tools do you have available from crawl4ai?"
Prerequisites
- Python 3.10 or higher
- pip or uv package manager
- Claude Desktop or Claude API access
- API key for crawl4ai
Configuration
API Key Required
This server requires an API key from crawl4ai. Add it to your environment or config.
| Variable | Required | Description |
|---|---|---|
| CRAWL4AI_API_KEY | Yes | Your crawl4ai API key |
Usage Examples
List Resources
"What resources are available in crawl4ai?"
Claude will query available resources and return a list of what you can access.
Get Details
"Show me details about [specific item] in crawl4ai"
Claude will fetch and display detailed information about the requested item.
Create New
"Create a new [item] in crawl4ai with [details]"
Claude will use the appropriate tool to create the resource and confirm success.
Works with crawl4ai
Related skills
Browse all skillsNeed help with MCP integration?
We build custom MCP integrations for B2B companies. From simple connections to complex multi-tool setups.