Tags: ScrapingBee/scrapingbee-python
Tags
Authenticate via the Authorization header and document all API parame… …ters (#23) The client now sends the API key in an Authorization: Bearer header instead of the api_key query parameter, keeping keys out of URLs and server logs. Every endpoint supports it and the public interface is unchanged: ScrapingBeeClient(api_key=...) works as before. Also adds per-endpoint parameter tables to the README covering every request parameter each API accepts, and tests asserting that all client methods authenticate via the header and never send api_key as a query parameter. Version: 2.1.1 -> 2.2.0.
[SCR-383] Document Auto-Mode (mode=auto) support (#22) Auto-Mode is a server-side, flag-gated beta feature. The SDK is a pure pass-through, so `params={'mode': 'auto', 'max_cost': N}` already works and the `Spb-auto-cost` response header is readable today — no client code or validation changes are needed (server enforces the 400s). - README.md: add an "Auto-Mode" example (enable mode=auto, optional max_cost cap, read the Spb-auto-cost header) plus usage notes (GET only; max_cost optional/>=1; not combinable with render_js/premium_proxy/stealth_proxy). - CHANGELOG.md: add 2.0.3 entry documenting Auto-Mode support. - scrapingbee/__version__.py: bump 2.0.2 -> 2.0.3. - tests/test_utils.py: update User-Agent assertion to track the bumped version (derived from __version__). Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com> Co-authored-by: Sahil Sunny <hello.sahilsunny@gmail.com>
Related to [SCR-44]: Add support for remaining ScrapingBee APIs (#20) * Added Remaining APIs - Changed the request method such that it can work with all of our APIs - Added all APIs. Now it supports HTML API, Google Search API, Amazon Search API, Amazon Product API, Walmart Search API, Walmart Product API, ChatGPT API, YouTube Search API, YouTube Metadata API, YouTube Trainability API, YouTube Transcript API - Added a method to call our usage endpoint - Create a new method for accessing our HTML API. So that in future, we can deprecate the get and post methods. * Added Deprecation Warning * Minor change Fixed lint issue due to incorrect spacing * Use | None union types in client signatures Update ScrapingBeeClient method signatures in scrapingbee/client.py to use PEP 604 union types (e.g. `dict | None` and `int | None`) instead of bare `dict = None` / `int = None`. This clarifies optional parameter typing for modern type checkers and requires Python 3.10+; changes touch request, get, post, html_api and several API helper methods (Google, Amazon, Walmart, YouTube, ChatGPT, usage, etc.). * Drop support for Python versions prior to 3.10 Align package metadata and CI with the 3.10+ requirement needed for PEP 604 union typing. * Align SDK with current API documentation Add the latest documented endpoints, remove obsolete YouTube APIs, and update supported Python tooling and documentation so the SDK matches the current public API surface. * Use httpbingo.org for live HTML manual tests Switch echo endpoints away from flaky httpbin.org so manual verification of the HTML API is more reliable without masking response failures.
PreviousNext