server: a failed prompt fill leaves the batch and its prompt clean (Windows bad_alloc abort) - #97

server: a failed prompt fill leaves the batch and its prompt clean (Windows bad_alloc abort)#97

joelteply merged 4 commits into

889580fc/seq-state-across-stream-countsCambrianTech/llama.cpp:889580fc/seq-state-across-stream-countsfrom

fable/failed-fill-leaves-batch-cleanCambrianTech/llama.cpp:fable/failed-fill-leaves-batch-cleanCopy head branch name to clipboard