perf: move pre-tokenize from partition to build_kg to reduce memory#156
Merged
ChenZiHong-Gavin merged 3 commits intomainfrom Jan 14, 2026
Merged
perf: move pre-tokenize from partition to build_kg to reduce memory#156ChenZiHong-Gavin merged 3 commits intomainfrom
ChenZiHong-Gavin merged 3 commits intomainfrom
![github-code-quality[bot]](https://avatars.githubusercontent.com/u/9919?v=4&size=32){kind=avatar}