llama-cpp-alternative

Here are 2 public repositories matching this topic...

Krasis is a Hybrid LLM runtime which focuses on efficient running of larger models on consumer grade VRAM limited hardware

Ultra-fast LLM inference engine — Vulkan backend, no CUDA required, AMD/Intel/NVIDIA

machine-learning cpp amd gpu vulkan inference quantization llm local-ai llama-cpp-alternative

Add a description, image, and links to the llama-cpp-alternative topic page so that developers can more easily learn about it.

To associate your repository with the llama-cpp-alternative topic, visit your repo's landing page and select "manage topics."