LLM examples

This repository contains some examples of LLM deployments in Aalto University premises.

Use local models on Triton

Huggingface transformers

See this document.

Batch inference via vLLM

See this document.

Server via vLLM

See this document.

Use Aalto's open-source LLM API

See this document.

Agent configurations

See this document for configuration examples for AI coding agents using Aalto's Azure and LLM Gateway endpoints.