Skip to content

Add viento to AI and Agents -> LLM Inference and Serving - #3329

Closed
abhinav00anand wants to merge 1 commit into
vinta:masterfrom
abhinav00anand:add-viento
Closed

Add viento to AI and Agents -> LLM Inference and Serving#3329
abhinav00anand wants to merge 1 commit into
vinta:masterfrom
abhinav00anand:add-viento

Conversation

@abhinav00anand

Copy link
Copy Markdown

Project

viento

Checklist

  • I read CONTRIBUTING.md - awesome-python is a shortlist, not a catalog
  • One project per PR
  • PR title format: Add project-name
  • Entry format: - [pypi-name](https://github.com/owner/repo) - Description ending with period.
  • Display name is the PyPI package name
  • Placed in an existing use case (new sections and subcategories are maintainer-only)
  • Meets all Quality Requirements: active, stable, documented, at least 1 month old

Which Tier

Pick one:

  • Obvious choice - a tool an experienced Python developer would name when asked "what do I use for this?"
  • Challenger - not yet the obvious choice, but a credible successor to one. Give adoption-trajectory evidence, not popularity alone.

Explain:
Viento is a lightweight distributed AI inference runtime SDK that connects local inference backends (Ollama, vLLM, llama.cpp) across edge devices and cloud GPUs to a unified OpenAI-compatible mesh without requiring inbound port forwarding or public static IPs.

Displacement

Not applicable — the LLM Inference and Serving use case currently has 3 entries (sglang, vllm, mlx-lm) and adding viento brings it to 4 entries (below the 5-entry cap).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant