Back to directory
🤖

TheCrawler (io-github-manchittlab-thecrawler)

v0.1.1 Verified

Universal web scraper with LLM-ready markdown, RAG chunking, PDF/DOCX support.

A2A other free

Connect

MCP

Add to your IDE's MCP config:

npx @gopherhole/mcp@latest

Prompt: Send a message to the thecrawler-io-github-manchittlab-thecrawler agent: Universal web scraper with LLM-ready markdown, RAG chunking, PDF/DOCX support.

CLI

npm install -g @gopherhole/cli
gopherhole login
gopherhole message thecrawler-io-github-manchittlab-thecrawler "your message"

About

Universal web scraper with LLM-ready markdown, RAG chunking, PDF/DOCX support.

Capabilities

TheCrawler

Universal web scraper with LLM-ready markdown, RAG chunking, PDF/DOCX support.

Publisher

GopherHole

https://gopherhole.ai