Skip to content

cld2labs/TinyLlama-1.1B-Chat-v1.0#94

Open
arpannookala-12 wants to merge 6 commits into
opea-project:mainfrom
cld2labs:cld2labs/TinyLlama-1.1B-Chat-v1.0
Open

cld2labs/TinyLlama-1.1B-Chat-v1.0#94
arpannookala-12 wants to merge 6 commits into
opea-project:mainfrom
cld2labs:cld2labs/TinyLlama-1.1B-Chat-v1.0

Conversation

@arpannookala-12
Copy link
Copy Markdown
Contributor

Summary

  • Adds model card for TinyLlama-1.1B-Chat-v1.0 (TinyLlama Project) under third_party/Dell/model-deployment/TinyLlama-1.1B-Chat-v1.0/
  • Adds Helm-based deployment guide for deploying TinyLlama-1.1B-Chat-v1.0 via vLLM on CPU (Xeon) with Keycloak OIDC and APISIX ingress

…r Dell EI

Signed-off-by: arpannookala-12 <ganesh.arpan.nookala@cloud2labs.com>
@alexsin368 alexsin368 self-requested a review April 29, 2026 04:17
Comment thread third_party/Dell/model-deployment/TinyLlama-1.1B-Chat-v1.0/deployment.md Outdated
Comment thread third_party/Dell/model-deployment/TinyLlama-1.1B-Chat-v1.0/deployment.md Outdated
Comment thread third_party/Dell/model-deployment/TinyLlama-1.1B-Chat-v1.0/deployment.md Outdated
Comment thread third_party/Dell/model-deployment/TinyLlama-1.1B-Chat-v1.0/deployment.md Outdated
Comment thread third_party/Dell/model-deployment/TinyLlama-1.1B-Chat-v1.0/deployment.md Outdated
Comment thread third_party/Dell/model-deployment/TinyLlama-1.1B-Chat-v1.0/deployment.md Outdated
Comment thread third_party/Dell/model-deployment/TinyLlama-1.1B-Chat-v1.0/deployment.md Outdated
Comment thread third_party/Dell/model-deployment/TinyLlama-1.1B-Chat-v1.0/deployment.md Outdated
Copy link
Copy Markdown
Collaborator

@alexsin368 alexsin368 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Reviewed TinyLlama. Suggested methods for cleaner user experience.

Comment thread third_party/Dell/model-deployment/TinyLlama-1.1B-Chat-v1.0/deployment.md Outdated
Comment thread third_party/Dell/model-deployment/TinyLlama-1.1B-Chat-v1.0/deployment.md Outdated
@alexsin368
Copy link
Copy Markdown
Collaborator

Everything works. Waiting on SDLE scans.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants