Skip to content

fix(tokenizer): respect the model vocabulary in ids2tokens - #3783

Open
carey-bk wants to merge 1 commit into
modelscope:mainfrom
carey-bk:fix/3780-token-list
Open

fix(tokenizer): respect the model vocabulary in ids2tokens#3783
carey-bk wants to merge 1 commit into
modelscope:mainfrom
carey-bk:fix/3780-token-list

Commits

  1. Commits on Oct 20, 2026