Skip to content

Fix HFI_TextGeneration_Stream to honour input.messages for chat #567

Description

@sroussey

Roadmap: prd/roadmap/libs.md

HFI_TextGeneration_Stream is the unified text-generation run-fn but always builds messages: [{ role: "user", content: input.prompt }]. Every AiChatTask against HF Inference silently loses conversation history.

Fix: route through toOpenAIMessages(input) with the Array.isArray(input.messages) && input.messages.length > 0 chat-vs-prompt discriminator.

Grades: prd/analysis/grades/libs.md recommendation #1

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions