From 3313c0c143aa9fe3d3fd0a22dcbe181a2ddbfe22 Mon Sep 17 00:00:00 2001 From: gman Date: Wed, 21 Oct 2026 12:08:34 -0700 Subject: [PATCH] fix(mlx-vlm): bump mlx-vlm pin to v0.6.12 mlx-vlm v0.4.4 attaches the image placeholder to the last message that is not system or assistant. After a tool call that is the tool result, which the chat template renders as text, so the next turn fails with "Image features and image tokens do not match: tokens: 0". v0.6.12 keeps the placeholder on the user message that carried the image. The v0.4.4 pin (#9568) worked around the mlx-cuda wheels stopping at 0.31.1. They are at 0.32.4 now, and v0.6.12 (mlx>=0.32.0) resolves with mlx[cuda12] and mlx[cuda13]. v0.7.x would need backend changes: it drops mlx_vlm.tool_parsers, which backend.py imports. Signed-off-by: gman --- backend/python/mlx-vlm/requirements-cpu.txt | 2 +- backend/python/mlx-vlm/requirements-cublas12.txt | 2 +- backend/python/mlx-vlm/requirements-cublas13.txt | 2 +- backend/python/mlx-vlm/requirements-l4t12.txt | 2 +- backend/python/mlx-vlm/requirements-l4t13.txt | 2 +- backend/python/mlx-vlm/requirements-mps.txt | 2 +- 6 files changed, 6 insertions(+), 6 deletions(-) diff --git a/backend/python/mlx-vlm/requirements-cpu.txt b/backend/python/mlx-vlm/requirements-cpu.txt index b9ae5b10678c..4e9ef39be502 100644 --- a/backend/python/mlx-vlm/requirements-cpu.txt +++ b/backend/python/mlx-vlm/requirements-cpu.txt @@ -1,2 +1,2 @@ -git+https://github.com/Blaizzy/mlx-vlm@v0.4.4 +git+https://github.com/Blaizzy/mlx-vlm@v0.6.12 mlx[cpu] \ No newline at end of file diff --git a/backend/python/mlx-vlm/requirements-cublas12.txt b/backend/python/mlx-vlm/requirements-cublas12.txt index 74a3d231ca67..5f37a3a58195 100644 --- a/backend/python/mlx-vlm/requirements-cublas12.txt +++ b/backend/python/mlx-vlm/requirements-cublas12.txt @@ -1,2 +1,2 @@ -git+https://github.com/Blaizzy/mlx-vlm@v0.4.4 +git+https://github.com/Blaizzy/mlx-vlm@v0.6.12 mlx[cuda12] \ No newline at end of file diff --git a/backend/python/mlx-vlm/requirements-cublas13.txt b/backend/python/mlx-vlm/requirements-cublas13.txt index d7c460f4b8c8..0af5583abb3a 100644 --- a/backend/python/mlx-vlm/requirements-cublas13.txt +++ b/backend/python/mlx-vlm/requirements-cublas13.txt @@ -1,2 +1,2 @@ -git+https://github.com/Blaizzy/mlx-vlm@v0.4.4 +git+https://github.com/Blaizzy/mlx-vlm@v0.6.12 mlx[cuda13] \ No newline at end of file diff --git a/backend/python/mlx-vlm/requirements-l4t12.txt b/backend/python/mlx-vlm/requirements-l4t12.txt index 74a3d231ca67..5f37a3a58195 100644 --- a/backend/python/mlx-vlm/requirements-l4t12.txt +++ b/backend/python/mlx-vlm/requirements-l4t12.txt @@ -1,2 +1,2 @@ -git+https://github.com/Blaizzy/mlx-vlm@v0.4.4 +git+https://github.com/Blaizzy/mlx-vlm@v0.6.12 mlx[cuda12] \ No newline at end of file diff --git a/backend/python/mlx-vlm/requirements-l4t13.txt b/backend/python/mlx-vlm/requirements-l4t13.txt index d7c460f4b8c8..0af5583abb3a 100644 --- a/backend/python/mlx-vlm/requirements-l4t13.txt +++ b/backend/python/mlx-vlm/requirements-l4t13.txt @@ -1,2 +1,2 @@ -git+https://github.com/Blaizzy/mlx-vlm@v0.4.4 +git+https://github.com/Blaizzy/mlx-vlm@v0.6.12 mlx[cuda13] \ No newline at end of file diff --git a/backend/python/mlx-vlm/requirements-mps.txt b/backend/python/mlx-vlm/requirements-mps.txt index ee5351beb349..736e41d74176 100644 --- a/backend/python/mlx-vlm/requirements-mps.txt +++ b/backend/python/mlx-vlm/requirements-mps.txt @@ -1,3 +1,3 @@ -git+https://github.com/Blaizzy/mlx-vlm@v0.4.4 +git+https://github.com/Blaizzy/mlx-vlm@v0.6.12 torch torchvision