Skip to content

[Bug] 不兼容新版本xinference的reranker模型的获取和添加 #6867

Description

@sakurawill

Contact Information

添加模型时提示认证失败,请检查参数是否正确:'str' object has no attribute 'get'

MaxKB Version

2.10.5

Problem Description

在选择供应商

添加 Xorbits Inference
添加重排模型时出错
提示认证失败,请检查参数是否正确:'str' object has no attribute 'get'

Steps to Reproduce

2026-09-02T07:37:15.246Z INFO uvicorn.access pid:1 role:local address:0.0.0.0:9997 node:f4e55df58e94 192.168.18.8:52852 - "GET /v1/cluster/auth HTTP/1.1" 200
2026-09-02T07:37:15.252Z DEBUG xinference.core.supervisor pid:117 role:local address:0.0.0.0:57726 node:f4e55df58e94 [request 1e3e0978-a6a1-11f1-838f-32066000f0d4] Enter describe_running_model, args: <xinference.core.supervisor.SupervisorActor object at 0x7afd79876390>,Qwen3-Reranker-4B, kwargs:
2026-09-02T07:37:15.254Z DEBUG xinference.core.supervisor pid:117 role:local address:0.0.0.0:57726 node:f4e55df58e94 [request 1e3e4604-a6a1-11f1-838f-32066000f0d4] Enter describe_model, args: <xinference.core.supervisor.SupervisorActor object at 0x7afd79876390>,Qwen3-Reranker-4B, kwargs:
2026-09-02T07:37:15.254Z DEBUG xinference.core.worker pid:117 role:local address:0.0.0.0:57726 node:f4e55df58e94 Enter describe_model, args: <xinference.core.worker.WorkerActor object at 0x7afd79584e90>, kwargs: model_uid=Qwen3-Reranker-4B-rep0
2026-09-02T07:37:15.254Z DEBUG xinference.core.worker pid:117 role:local address:0.0.0.0:57726 node:f4e55df58e94 Leave describe_model, elapsed time: 0 s
2026-09-02T07:37:15.255Z DEBUG xinference.core.supervisor pid:117 role:local address:0.0.0.0:57726 node:f4e55df58e94 [request 1e3e4604-a6a1-11f1-838f-32066000f0d4] Leave describe_model, elapsed time: 0 s
2026-09-02T07:37:15.255Z DEBUG xinference.core.supervisor pid:117 role:local address:0.0.0.0:57726 node:f4e55df58e94 [request 1e3e0978-a6a1-11f1-838f-32066000f0d4] Leave describe_running_model, elapsed time: 0 s
2026-09-02T07:37:15.256Z INFO uvicorn.access pid:1 role:local address:0.0.0.0:9997 node:f4e55df58e94 192.168.18.8:52852 - "GET /v1/models/Qwen3-Reranker-4B HTTP/1.1" 200
2026-09-02T07:37:15.264Z DEBUG xinference.core.supervisor pid:117 role:local address:0.0.0.0:57726 node:f4e55df58e94 [request 1e3fdab4-a6a1-11f1-838f-32066000f0d4] Enter get_model, args: <xinference.core.supervisor.SupervisorActor object at 0x7afd79876390>,Qwen3-Reranker-4B, kwargs:
2026-09-02T07:37:15.265Z DEBUG xinference.core.supervisor pid:117 role:local address:0.0.0.0:57726 node:f4e55df58e94 [request 1e3fdab4-a6a1-11f1-838f-32066000f0d4] Leave get_model, elapsed time: 0 s
2026-09-02T07:37:15.266Z DEBUG xinference.core.model pid:3691 role:local address:0.0.0.0:57726 node:f4e55df58e94 Request rerank, current serve request count: 0, request limit: inf for the model Qwen3-Reranker-4B-rep0
2026-09-02T07:37:15.268Z DEBUG xinference.core.model pid:3691 role:local address:0.0.0.0:57726 node:f4e55df58e94 [request 1e407fb4-a6a1-11f1-87d5-32066000f0d4] Enter rerank, args: ModelActor(Qwen3-Reranker-4B-rep0),['你好'],你好, kwargs: top_n=3,max_chunks_per_doc=None,return_documents=True,return_len=None
139.19.330.231 I slot get_availabl: id 5 | task -1 | selected slot by LCP similarity, f_sim_best = 1.000 (> 0.100 thold), f_keep = 1.000
139.19.330.248 I slot launch_slot_: id 5 | task 32 | processing task, is_child = 0
139.19.358.349 I slot release: id 5 | task 32 | stop processing: n_tokens = 76, truncated = 0
2026-09-02T07:37:15.298Z DEBUG xinference.core.model pid:3691 role:local address:0.0.0.0:57726 node:f4e55df58e94 [request 1e407fb4-a6a1-11f1-87d5-32066000f0d4] Leave rerank, elapsed time: 0 s
2026-09-02T07:37:15.300Z DEBUG xinference.core.model pid:3691 role:local address:0.0.0.0:57726 node:f4e55df58e94 After request rerank, current serve request count: 0 for the model Qwen3-Reranker-4B-rep0
2026-09-02T07:37:15.304Z INFO uvicorn.access pid:1 role:local address:0.0.0.0:9997 node:f4e55df58e94 192.168.18.8:52866 - "POST /v1/rerank HTTP/1.1" 200

The expected correct result

No response

Related log output

Additional Information

No response

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions