Skip to content

gh-153569: hide tokenizer state behind token and source operations - #156654

Merged
pablogsal merged 4 commits into
python:mainfrom
pablogsal:gh-153569-tokenizer-source-ftstring-clean
Sep 12, 2026
Merged

gh-153569: hide tokenizer state behind token and source operations#156654
pablogsal merged 4 commits into
python:mainfrom
pablogsal:gh-153569-tokenizer-source-ftstring-clean

gh-153569: keep character scanning inline with source offsets

aef6c9e
Select commit
Loading
Failed to load commit list.
Sign in for the full log view
DO-NOT-MERGE
succeeded Sep 8, 2026 in 8s