Repository navigation
release: 0.63.2 — Moonshine streaming external encoder hook - #521
Merged
Merged
Conversation
An encoder path of that form replaces the frontend, encoder and adapter graphs with a dlopen'ed library exporting moonshine_ext_encoder() (ABI 1: one whole window of audio in, the window's 64 memory rows out), so an accelerator outside IREE can run the encoder side while the decoder stays on the IREE device. Without the prefix nothing changes. moonshine_stream_check takes the encoder path from MOONSHINE_ENC. Checked on an arm32 Mali device over 444 German commands with an external encoder: transcripts scored 13.1 % WER against 13.9 % for the all-Vulkan library from the same source.
…cument the ext: form Rebuilt libskainet_moonshine_stream.so for arm64-v8a and armeabi-v7a from the hook commit; IreeMoonshineStream's KDoc describes encoderVmfb = "ext:<library.so>|<model dir>" (a bare library name resolves among the app's own native libraries).
… against engine 0.62.0
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Prepares 0.63.2 against engine 0.62.0. It is transformers-only and additive.
moonshine_stream_jni.c,libskainet_moonshine_stream.soboth ABIs). An encoder path of the formext:<library.so>|<model dir>replaces the frontend, encoder and adapter graphs with adlopen'ed library exportingmoonshine_ext_encoder()(ABI 1: one window of audio in, 64 memory rows out), so an accelerator outside IREE can run the encoder side while the decoder stays on the IREE device. Without the prefix nothing changes, and the Kotlin API is unchanged (IreeMoonshineStreampasses the path through). On an arm32 Mali device, 444 German commands with an external encoder: 13.1 % WER against 13.9 % for the all-Vulkan path from the same library.moonshine_stream_check:MOONSHINE_ENCreplaces the encoder path.runtime-iree-androidstill depends only on kotlin-stdlib.Changes besides the hook:
VERSION_NAME0.63.2, the CHANGELOG section, the README current-release line and the BOM version in the docs. Pushing the tag0.63.2after the merge publishes to Maven Central.