List of libraries, tools and APIs for web scraping and data processing.

🔎 Hunt down social media accounts by username across social networks

Command-line program to download videos from YouTube.com and other video sites

Analysis of Bot Protection systems with available countermeasures 🚿. How to defeat anti-bot system 👻 and get around browser fingerprinting scripts 🕵️‍♂️ when scraping the web?

Headless Chrome Node.js API

🌐 Human-friendly and powerful HTTP request library for Node.js

Scrape information about places from Google Maps. Gives you extra information that you can't get using the Google Places API.

💯 Teach puppeteer new tricks through plugins.

Actor for scraping posts and comments from Instagram

Forgiving html and xml parser

Maps proxy protocols to `http.Agent` implementations

HTTP proxy tunneling agent. Formerly part of mikeal/request, now a standalone module.

Create HAR files from Chrome Debugging Protocol data

The web scraping and automation SDK for JavaScript / Node.js. Enables development of web scrapers, crawlers and web automation jobs (not only) with headless Chrome and Puppeteer.