Skip to content

gh-153569: centralize formatted-string state and transitions - #139

Closed
pablogsal wants to merge 2 commits into
gh-153569-tokenizer-reader-statefrom
gh-153569-tokenizer-formatted-state
Closed

gh-153569: centralize formatted-string state and transitions#139
pablogsal wants to merge 2 commits into
gh-153569-tokenizer-reader-statefrom
gh-153569-tokenizer-formatted-state

Conversation

@pablogsal

Copy link
Copy Markdown
Owner

Replace the generic lexer mode array with active formatted-string frames. Carry raw-string context with emitted and cached parser tokens, so token interpretation remains correct after the lexer advances.

Keep expression entry, punctuation, closing, and debug-expression transitions together in the string scanner, with explicit dispatch over its three modes.

Depends on #138.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant