Migrate to transformers 5 - #363

Open

pmachapman wants to merge 14 commits into

mainfrom

Commits on Sep 30, 2026

Migrate to transformers 5
pmachapman
committed
14cf685
Use forward-ported pipeline
pmachapman
committed
513e709
Use auto_find_batch_size
pmachapman
committed
a7185d8
Revert Use auto_find_batch_size
pmachapman
committed
6221642
Fixes from code review
pmachapman
committed
fe2945b
More memory efficient method for retrieving token scores

ddaspit
authored and
pmachapman
committed
0dc46cb
Remove default generation config

ddaspit
authored and
pmachapman
committed
3957387
Fix type checking issues on Mac

ddaspit
authored and
pmachapman
committed
2e1239f
Fixes for issues raised by Claude
pmachapman
committed
c2d6a22
Further fixes for issues raised by Claude
pmachapman
committed
130bd27
Fix T5 loading, attention handling, and group_by_length mapping

authored and
pmachapman
committed
e77bcc9
Relax datasets version to a range
pmachapman
committed
5ec388b
Require eager attention for output_attentions on a caller-owned model

ddaspit
and
claude
committed
915ca5a
Avoid importing torch in the engine tests

ddaspit
and
claude
committed
6d4cd7f