From 3a90c24152112ab4ea814f28ed0311a142394d8a Mon Sep 17 00:00:00 2001 From: abhinav anand <280037518+abhinav00anand@users.noreply.github.com> Date: Thu, 3 Sep 2026 13:25:38 +0530 Subject: [PATCH] Add viento to AI and Agents -> LLM Inference and Serving --- README.md | 1 + 1 file changed, 1 insertion(+) diff --git a/README.md b/README.md index 2ff06e0271..26b4460faf 100644 --- a/README.md +++ b/README.md @@ -162,6 +162,7 @@ _Libraries for building AI applications, LLM integrations, and autonomous agents - [sglang](https://github.com/sgl-project/sglang) - A high-performance serving framework for large language models and multimodal models. - [vllm](https://github.com/vllm-project/vllm) - A high-throughput and memory-efficient inference and serving engine for LLMs. - [mlx-lm](https://github.com/ml-explore/mlx-lm) - Run and fine-tune large language models on Apple Silicon with MLX. + - [viento](https://github.com/abhinav00anand/viento) - Distributed AI inference runtime SDK connecting local LLMs to a cloud mesh. - LLM Gateways - [LiteLLM](https://github.com/BerriAI/litellm) - Call 100+ LLMs using OpenAI format. - Image and Video Generation