DEV Community

#webscraping

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
1.500 is not 1.5: what broke while re-reading 131 banks' rules every Monday

1.500 is not 1.5: what broke while re-reading 131 banks' rules every Monday

Comments
6 min read
ADP jobs API: PepsiCo, Stellantis and Casey's careers sites on myjobs.adp.com, as JSON

ADP jobs API: PepsiCo, Stellantis and Casey's careers sites on myjobs.adp.com, as JSON

Comments
3 min read
Home Depot, Walgreens and Best Buy jobs API: the BrassRing careers search, one cookie and 50 jobs a page

Home Depot, Walgreens and Best Buy jobs API: the BrassRing careers search, one cookie and 50 jobs a page

Comments
3 min read
Track a competitor's ads on Google, LinkedIn and TikTok with Python

Track a competitor's ads on Google, LinkedIn and TikTok with Python

Comments
8 min read
Five Reads of facebook.com/nike in Eleven Seconds: Followers Matched to the Digit, 'Talking About This' Didn't

Five Reads of facebook.com/nike in Eleven Seconds: Followers Matched to the Digit, 'Talking About This' Didn't

Comments
6 min read
SAP SuccessFactors jobs API: EY and Nucor careers sites, one HTML table at a time

SAP SuccessFactors jobs API: EY and Nucor careers sites, one HTML table at a time

Comments
2 min read
iCIMS jobs API: BrightSpring and Concentra careers portals, behind one iframe flag

iCIMS jobs API: BrightSpring and Concentra careers portals, behind one iframe flag

Comments
2 min read
How to Scrape Walmart Mexico Prices, Stock and Sellers with Python

How to Scrape Walmart Mexico Prices, Stock and Sellers with Python

Comments
7 min read
How to evaluate scraping APIs before your crawler budget surprises you

How to evaluate scraping APIs before your crawler budget surprises you

Comments
5 min read
Pull Indian tech and AI-startup job data from employer career pages, in one API call

Pull Indian tech and AI-startup job data from employer career pages, in one API call

Comments
5 min read
How to give an AI agent live web search and scraping with Dumpling AI (MCP, n8n, credits explained)

How to give an AI agent live web search and scraping with Dumpling AI (MCP, n8n, credits explained)

Comments
5 min read
Firecrawl Pricing Explained: What 1,000 Pages Really Cost

Firecrawl Pricing Explained: What 1,000 Pages Really Cost

Comments
7 min read
'wise' Is a Printing Company Founded in 1969. The 404s Were the Good Outcome

'wise' Is a Printing Company Founded in 1969. The 404s Were the Good Outcome

Comments
6 min read
How to scrape a public Telegram channel without an account or API key

How to scrape a public Telegram channel without an account or API key

Comments
2 min read
What robots.txt can and can't do for paid content — and the setup that actually holds

What robots.txt can and can't do for paid content — and the setup that actually holds

Comments
5 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.