Moved our internal agent's web scraping tool from Apify to FireCrawl because it benchmarked 50x faster with AgentOps
When @AlexReibman realized firecrawl🔥was 50x faster than his previous scraping tool 🤯
Wouldn't have known without @AgentOpsAI🖇️👀
While building Mendable - we found that feeding LLMs well-structured markdown improved accuracy. Also, it was hard. So, we released an open source repo and an API that crawls and turns entire websites into a markdown with just a few lines of code. Introducing FireCrawl 🔥 👇- Moved our internal agent's web scraping tool from Apify to FireCrawl because it benchmarked 50x faster with AgentOpsWhen @AlexReibman realized firecrawl🔥was 50x faster than his previous scraping tool 🤯 Wouldn't have known without @AgentOpsAI🖇️👀
Hm, were you scraping a single page or entire site? Static or dynamic content?
curious how many pages are you crawling?
