Agent - Gather Data Wherever It Lives on the Web | Firecrawl Firecrawl agent is a magic API that searches, navigates, and gathers data from even the most complex websites Describe what data you want and agent handles the rest Accomplishes in minutes what takes humans hours
Scrape - Firecrawl Docs auto: Firecrawl will automatically retry scraping with enhanced proxies if the basic proxy fails If the retry with enhanced is successful, 5 credits will be billed for the scrape
Introducing Firecrawl Skill and CLI: The Complete Web Data Toolkit for . . . The Firecrawl CLI and Skill gives AI agents a complete web data toolkit they can use on their own With a single install, agents like Claude Code, Antigravity, and OpenCode get a unified interface for scraping pages, searching the web, and browsing interactive sites - plus crawling and mapping for structured site exploration
Mastering Firecrawls Crawl Endpoint: A Complete Web Scraping Guide Use Firecrawl's v2 crawl endpoint to scrape an entire site in one job This guide covers URL control, performance tuning, async delivery via watcher() and webhooks, debugging incomplete crawls, and a RAG agent built on top of crawled pages with LangChain
Introduction - Firecrawl Docs Firecrawl API Reference Response codes Firecrawl employs conventional HTTP status codes to signify the outcome of your requests Typically, 2xx HTTP status codes denote success, 4xx codes represent failures related to the user, and 5xx codes signal infrastructure problems
Browser | Firecrawl Firecrawl Browser Sandbox gives your agents a secure browser environment where agents can interact with the web Fill out forms, click buttons, authenticate, and more