Repository navigation
feat(gallery): add Saluki abliterated variants - #12688
Open
localai-org-maint-bot wants to merge 1 commit into
Open
localai-org-maint-bot wants to merge 1 commit into
localai-org-maint-bot wants to merge 1 commit into
Conversation
mudler
force-pushed
the
gallery/20261014-second-pass
branch
from
October 14, 2026 21:33
ab95e69 to
8c537bc
Compare
localai-org-maint-bot
force-pushed
the
gallery/20261014-second-pass
branch
2 times, most recently
from
October 23, 2026 08:09
207a16e to
9d9beab
Compare
Add Kujira's mixed IQ2 Saluki fine-tune for llama.cpp with plain and MTP decoding. Pin the weights and document the text-only entries. Assisted-by: Codex:gpt-6 Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
localai-org-maint-bot
force-pushed
the
gallery/20261014-second-pass
branch
from
October 23, 2026 12:06
9d9beab to
24f23a6
Compare
This branch has not been deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Description
Add Kujira's abliterated Underdog Saluki 27B 1.0 GGUF for llama.cpp, with plain decoding and an MTP variant that drafts up to two tokens. Both entries use the publisher's sampling settings and embedded chat template. They are text-only and share the pinned weight file. Only the enabled variant has the
mtpranking tag.This fine-tune is distinct from the original Saluki MTP build in #12662. Existing gallery entries are unchanged. Usage is documented under
docs/content/features/model-gallery.md.Notes for Reviewers
c1d826d73831efcb819d9d64c625f0fab56ae8fc.b9b231748c94e13ecc0f841942798eb36b27eaea60014fea896218bc86742bbcmatches both HF LFS metadata and the pinned download'sx-linked-etagheader.qwen35architecture metadata, draft-mtp support in LocalAI's pinned llama.cpp, and LocalAI'sspec_type/spec_n_maxoptions.git diff --checkpassed.go test ./core/gallery -run Test -count=1cannot start because generatedpkg/grpc/protofiles are absent in this checkout. No inference test was run.Signed commits