Skip to content

Update tokenizers submodule to the linear-time HF encode path#20472

Merged
digantdesai merged 2 commits into
mainfrom
tokenizer_nlon_pin_bump
Jun 24, 2026
Merged

Update tokenizers submodule to the linear-time HF encode path#20472
digantdesai merged 2 commits into
mainfrom
tokenizer_nlon_pin_bump

Commits

Commits on Jun 24, 2026