CrawlAPI

About

CrawlAPI transforms any web address into organized markdown and structured information, designed for LLM workflows, AI agents, and RAG applications. It offers three core endpoints: the /scrape function converts a single URL into markdown with metadata, /batch processes as many as ten URLs simultaneously, and /search scrapes the top results from a given query. The service includes an OpenAPI specification along with tool manifests for LangChain and CrewAI, allowing for direct integration into your agent. A free usage tier is provided, with a paid plan costing $9.99 monthly for 5,000 API calls.