Skip to content

Fix/token lookup pruning - #498

Merged
bitner merged 2 commits into
maint/v0.10from
fix/token-lookup-pruning
Nov 19, 2026
Merged

bitner merged 2 commits into
maint/v0.10from
fix/token-lookup-pruning

Conversation

@bitner

@bitner bitner commented Nov 19, 2026

Copy link
Copy Markdown
Collaborator

Fix token lookup pruning on databases with Non-C Collation

Description

With v0.10.0, the token used for keyset pagination was changed to hex encoded values to avoid issues with escaping characters. With that change, get_token_record ended up using C collation based on the results of the decode function. This makes sure that we save the token keys for collection and id to text before passing them to the item lookup so that there is no collation difference which prevented partition pruning and index scans.

This also stages a v0.10.2 release


Checklist

  • Linting: Code is formatted and linted
  • Tests: Tests pass. I have included new tests for these changes where applicable.
  • Edge Cases: I have manually verified "unhappy paths" and edge cases beyond the basic success criteria (e.g., database connection timeouts, malformed input, strict mapping rejections).
  • Documentation: I have updated README.md to reflect any new environment variables, configuration changes, or breaking updates.
  • Accountability: I can explain the implementation logic for every line of code submitted.

AI tool usage

  • AI (Copilot or something similar) supported my development of this PR. See our policy about AI tool use. Use of AI tools must be indicated.

Policy: We require a "human-in-the-loop." You are the author and are fully accountable for all submitted code. Please ensure all tool-generated content is thoroughly reviewed before submission to ensure it is not an "extractive contribution" that squanders maintainer time.

@bitner
bitner changed the base branch from main to stage_v0.10.1 November 19, 2026 19:59
@bitner
bitner changed the base branch from stage_v0.10.1 to release_v0.10.1 November 19, 2026 20:06
@bitner bitner closed this Nov 19, 2026
@bitner bitner reopened this Nov 19, 2026
@bitner
bitner changed the base branch from release_v0.10.1 to maint/v0.10 November 19, 2026 20:39
@bitner
bitner merged commit cf9143a into maint/v0.10 Nov 19, 2026
6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant