Skip to content

fix(vllm): build SamplingParams once so stop reaches the engine - #12872

Open
pos-ei-don wants to merge 2 commits into
mudler:masterfrom
pos-ei-don:fix/vllm-stop-sampling-params
Open

pos-ei-don wants to merge 2 commits into
mudler:masterfrom
pos-ei-don:fix/vllm-stop-sampling-params

docs(vllm): explain sampling validation

05af7b0
Select commit
Loading
Failed to load commit list.