Skip to content

Tags: ScrapingBee/scrapingbee-python

Tags

v2.2.0

Toggle v2.2.0's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature.
Authenticate via the Authorization header and document all API parame…

…ters (#23)

The client now sends the API key in an Authorization: Bearer header
instead of the api_key query parameter, keeping keys out of URLs and
server logs. Every endpoint supports it and the public interface is
unchanged: ScrapingBeeClient(api_key=...) works as before.

Also adds per-endpoint parameter tables to the README covering every
request parameter each API accepts, and tests asserting that all client
methods authenticate via the header and never send api_key as a query
parameter.

Version: 2.1.1 -> 2.2.0.

v2.1.1

Toggle v2.1.1's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature.
[SCR-383] Document Auto-Mode (mode=auto) support (#22)

Auto-Mode is a server-side, flag-gated beta feature. The SDK is a pure
pass-through, so `params={'mode': 'auto', 'max_cost': N}` already works
and the `Spb-auto-cost` response header is readable today — no client
code or validation changes are needed (server enforces the 400s).

- README.md: add an "Auto-Mode" example (enable mode=auto, optional
  max_cost cap, read the Spb-auto-cost header) plus usage notes
  (GET only; max_cost optional/>=1; not combinable with
  render_js/premium_proxy/stealth_proxy).
- CHANGELOG.md: add 2.0.3 entry documenting Auto-Mode support.
- scrapingbee/__version__.py: bump 2.0.2 -> 2.0.3.
- tests/test_utils.py: update User-Agent assertion to track the
  bumped version (derived from __version__).

Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Co-authored-by: Sahil Sunny <hello.sahilsunny@gmail.com>

v2.1.0

Toggle v2.1.0's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature.
Related to [SCR-44]: Add support for remaining ScrapingBee APIs (#20)

* Added Remaining APIs

- Changed the request method such that it can work with all of our APIs
- Added all APIs. Now it supports HTML API, Google Search API, Amazon Search API, Amazon Product API, Walmart Search API, Walmart Product API, ChatGPT API, YouTube Search API, YouTube Metadata API, YouTube Trainability API, YouTube Transcript API
- Added a method to call our usage endpoint
- Create a new method for accessing our HTML API. So that in future, we can deprecate the get and post methods.

* Added Deprecation Warning

* Minor change

Fixed lint issue due to incorrect spacing

* Use | None union types in client signatures

Update ScrapingBeeClient method signatures in scrapingbee/client.py to use PEP 604 union types (e.g. `dict | None` and `int | None`) instead of bare `dict = None` / `int = None`. This clarifies optional parameter typing for modern type checkers and requires Python 3.10+; changes touch request, get, post, html_api and several API helper methods (Google, Amazon, Walmart, YouTube, ChatGPT, usage, etc.).

* Drop support for Python versions prior to 3.10

Align package metadata and CI with the 3.10+ requirement needed for PEP 604 union typing.

* Align SDK with current API documentation

Add the latest documented endpoints, remove obsolete YouTube APIs, and update supported Python tooling and documentation so the SDK matches the current public API surface.

* Use httpbingo.org for live HTML manual tests

Switch echo endpoints away from flaky httpbin.org so manual verification of the HTML API is more reliable without masking response failures.

v2.0.2

Toggle v2.0.2's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature.
Fix handling of AI extract rules (#19)

* Fix handling of AI extract rules

* Drop support for Python 3.7

v2.0.1

Toggle v2.0.1's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
Update test_utils.py

v2.0.0

Toggle v2.0.0's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
V2 (#16)

* Update v2.0.0

* fix test

v1.2.0

Toggle v1.2.0's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
Implement retry (#13)

* Implement retry

* Update supported python versions

* Drop support for Python3.6

* Lint max col

* Linter complient

* Update version and README

v1.1.8

Toggle v1.1.8's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
Add the json parameter for post requests: (#10)

* Add the json parameter for post requests:
The purpose here is to be iso "requests" in order
to accept empty json body.

Some "black" formatting too.

* change flake8 max line length (100 -> 120)

v1.1.7

Toggle v1.1.7's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
Add js_scenario param (#9)

v1.1.6

Toggle v1.1.6's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
Update __version__.py