Skip to content

fix cosyvoice3 training of flow and llm#1700

Closed
aaron-lii wants to merge 2 commits into
FunAudioLLM:mainfrom
aaron-lii:cosy3-train
Closed

fix cosyvoice3 training of flow and llm#1700
aaron-lii wants to merge 2 commits into
FunAudioLLM:mainfrom
aaron-lii:cosy3-train

Conversation

@aaron-lii
Copy link
Copy Markdown

  1. 根据flow推理代码对训练时的forward部分进行了修正。
  2. 根据example.py中的示例,增加了llm训练时instruct_token的拼接,与推理结构保持一致。

改动在单卡训练上已跑通。

@aaron-lii aaron-lii mentioned this pull request Dec 18, 2025
@aluminumbox
Copy link
Copy Markdown
Collaborator

多谢提醒,已经参考并在代码中修正

@aluminumbox
Copy link
Copy Markdown
Collaborator

instruct_token并不参与bistream构造,因此不适合与text直接concat,可以参考一下更新后的代码

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants