Skip to content

No model providers found - but Docker Model Runner already setup with models #2799

@jschmdt

Description

@jschmdt

OS macOS 26.4.1 / Docker Agent v1.54.0

  1. When I ran docker-agent for the first time, I was prompted to pull ai/qwen3:latest. First I declined because I already have some models installed locally via Docker Model Runner.

After declining, the CLI showed:

No model providers available.

This seems unexpected. I would assume Docker Model Runner acts as a local model provider service and that docker agent would connect to it automatically.

  1. To further test the provider availability I downloaded ai/qwen3:latest – started docker-agent, but when I tried to list the models from Docker Model Runner (ctrl+m) the UI just showed …
No models available for selection

… which is a bit confusing, since at least ai/qwen3:latest should be selectable, even if its already active. And as you can see in the screenshot: Docker Model Runner is listed as the Provider dmr of the qwen model. Proof that DMR is already active as an provider but still not discovered by docker-agent when invoked with ctrl+m.

Image

Expected Behavior

  1. Models available through Docker Model Runner should be detected and listed automatically.
  2. List Models works correctly when inside of docker-agents

Enhancement Request

For local agentic workflows, please consider supporting LM Studio and other local endpoints as well 😋🙏

Attachments

Docker Agent Output

$ docker agent
Model ai/qwen3:latest not found locally.
Do you want to pull it now? ([y]es/[n]o): n
No model providers available.
To fix this, you can:
  - Install Docker Model Runner: https://docs.docker.com/ai/model-runner/get-started/
  - Configure an API key for a cloud provider:
    - anthropic: ANTHROPIC_API_KEY
    - openai: OPENAI_API_KEY
    - google: GOOGLE_API_KEY (or GEMINI_API_KEY, GOOGLE_GENAI_USE_VERTEXAI)
    - mistral: MISTRAL_API_KEY
    - amazon-bedrock: AWS_ACCESS_KEY_ID (or AWS_PROFILE, AWS_ROLE_ARN, AWS_BEARER_TOKEN_BEDROCK)

Docker Model Runner: Models Are Available

Image

Metadata

Metadata

Assignees

No one assigned

    Labels

    area/docker-model-runnerFor features/issues/fixes related to the usage of Docker Model Runner (DMR)area/providers/docker-model-runnerDocker Model Runner (DMR) local inference

    Type

    No fields configured for Bug.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions