Skip to content

feat: add direct async iteration on Dataset and KeyValueStore #2267

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
Pijukatel wants to merge 21 commits into
base: master
Choose a base branch
from
Open

feat: add direct async iteration on Dataset and KeyValueStore #2267

Changes from 1 commit
Commits
Show all changes
21 commits
Select commit Hold shift + click to select a range
193cc2e
feat: add direct async iteration on Dataset and KeyValueStore
Pijukatel Oct 1, 2026
2deace2
feat: make KeyValueStore record iteration overridable by storage clients
Pijukatel Oct 1, 2026
3c03eae
perf: read key-value store entries in bulk in the SQL and Redis clients
Pijukatel Oct 1, 2026
125bba2
test: drop the test for records deleted during key-value store iteration
Pijukatel Oct 2, 2026
668c170
refactor: decode None values in one place in the Redis key-value stor…
Pijukatel Oct 2, 2026
0e255a5
docs: describe the bulk iterate_entries overrides in docstrings
Pijukatel Oct 2, 2026
6c0cc3f
refactor: reject a decoding Redis client instead of suppressing the t…
Pijukatel Oct 2, 2026
95a5154
refactor: narrow Redis replies without a cast
Pijukatel Oct 2, 2026
a07f81a
docs: scope the raw-bytes requirement to the Redis key-value store cl…
Pijukatel Oct 2, 2026
1f32875
fix: bound memory of the SQL key-value store iteration with keyset pages
Pijukatel Oct 2, 2026
f809fe7
fix: retry the batched Redis value read and test the batching helper
Pijukatel Oct 2, 2026
c0c334e
test: give the batching helper test module a unique basename
Pijukatel Oct 2, 2026
f7db136
fix: skip Redis records deleted mid-iteration without a missing-value…
vdusek Oct 6, 2026
5918899
docs: correct memory and round-trip claims in KVS iteration docstrings
vdusek Oct 6, 2026
eb6a2f3
test: cover SQL iterate_entries limit ending inside a later page
vdusek Oct 6, 2026
a967540
test: rename batching test helpers and add missing test docstrings
vdusek Oct 6, 2026
db0339a
feat: make KeyValueStore async iteration yield keys like a dict
Pijukatel Oct 6, 2026
0b9af81
refactor: return the key iterator from KeyValueStore.__aiter__ like D…
vdusek Oct 6, 2026
4905199
docs: fix RedisStorageClient and KVS iteration docstrings
vdusek Oct 6, 2026
1c66c3b
test: record Redis and SQL batch calls with wrapping mocks
vdusek Oct 6, 2026
2c3dd78
test: cover records deleted mid-iteration in memory and SQL KVS clients
vdusek Oct 6, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
test: give the batching helper test module a unique basename 
The test directories have no `__init__.py`, so pytest cannot import two
modules named `test_utils.py` and aborted the whole unit test collection.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01Wg6jZgyQp7XkvVvxuueJyV
  • Loading branch information
@Pijukatel @claude
Pijukatel and claude committed Oct 2, 2026
commit c0c334e10be475bcb919d21d14d950e4064c25b2
0 tests/unit/storage_clients/test_utils.py → ...age_clients/test_batch_records_by_size.py
View file
Open in desktop
File renamed without changes.
Loading