Popular repositories Loading

1. llm-d-inference-scheduler llm-d-inference-scheduler Public

   Forked from llm-d/llm-d-router

   Inference scheduler for llm-d

   Go

2. gateway-api-inference-extension gateway-api-inference-extension Public

   Forked from kubernetes-sigs/gateway-api-inference-extension

   Gateway API Inference Extension

   Go

3. workload-variant-autoscaler workload-variant-autoscaler Public

   Forked from llm-d/llm-d-workload-variant-autoscaler

   Variant optimization autoscaler for distributed inference workloads

   Go

4. llm-d-async llm-d-async Public

   Forked from llm-d-incubation/llm-d-async

   Asynchronous Processor for Inference Gateway. Orchestrator of queues.

   Go

5. llm-d llm-d Public

   Forked from llm-d/llm-d

   Achieve state of the art inference performance with modern accelerators on Kubernetes

   Shell

6. llm-d-batch-gateway-operator llm-d-batch-gateway-operator Public

   Forked from opendatahub-io/llm-d-batch-gateway-operator

   Go