web scraping

Getting data off a page that would rather you didn’t. Most of what I write here now runs on Firecrawl, because it deletes the part of scraping I never enjoyed: the proxies, the retries, the headless browser that breaks every other Tuesday. You can try the whole thing without paying. The free tier is 1,000 pages a month and takes no card, the agent runs five jobs a day from a prompt box with no code at all, and the research index across 43 million papers is free outright. That is plenty to find out whether it solves your problem before you spend a cent on it.*