XCrawl is a web data API for people building AI products: point it at a site and get clean JSON or Markdown back, with the miserable parts — rotating proxies, JavaScript rendering, retries — handled on their side. It does single-page scrapes, full crawls, site maps and search, with SDKs for Python and friends.
This is the Firecrawl category: LLM pipelines eat Markdown, and someone has to turn the live web into it. The build-or-buy math is lopsided — maintaining your own headless-browser fleet with proxy rotation is a part-time job that nobody wants back once they’ve given it up.
What it costs
Usage-based credits; free tier to start. Pricing on-site.
What we can’t tell you
How it holds up on your ugly target. Every scraping API demos beautifully on clean sites; the test that matters is the JS-heavy, bot-hostile one you actually need. Spend the free credits there, and compare output quality and success rate against Firecrawl before committing a pipeline. Respect the sites you crawl — rate limits and robots exist for a reason, and your API key is the one that gets banned.
The details
| What it is | Scrape/crawl/map/search API returning clean JSON or Markdown |
| Price | Free tier; usage-based credits on-site |
| Best for | AI builders feeding LLM pipelines with live web data |
| Think twice if | Your target is bot-hostile — burn the free credits on it first |



















