Skip to content

Latest commit

 

History

History
68 lines (54 loc) · 17.1 KB

File metadata and controls

68 lines (54 loc) · 17.1 KB

English | 简体中文

FunASR Community Integrations

This page lists maintained projects where FunASR, Fun-ASR-Nano, SenseVoice, or an official FunASR model is already integrated upstream. Each entry below was checked against the project's default branch and, where available, a linked merged change.

These integrations are community-maintained. Their release cadence, hardware support, and API stability are controlled by the upstream project, not by the FunASR maintainers.

Voice agents and applications

Project What is integrated Start here
Pipecat A local FunASRSTTService backed by SenseVoice for voice and multimodal agent pipelines, with transcription and voice-agent examples. FunASR service docs, transcription example, voice-agent example, and merged #4844.
xiaozhi-esp32-server The default local ASR provider uses FunASR with SenseVoiceSmall; recognition language can be set to auto, zh, en, ja, ko, or yue. A separate FunASR runtime-server provider is also available. Provider implementation, configuration, and merged #3255.
AutoSubs An on-device int8 ONNX SenseVoice engine for subtitle generation in DaVinci Resolve, Premiere, and After Effects. SenseVoice model notes, engine source, and merged #629.
TMSpeech A Windows meeting subtitle and translation app that can run Fun-ASR-Nano INT8 through its external-command recognizer. Silero VAD completes each utterance before Nano decoding, while the existing low-cost C# streaming recognizer remains available. Fun-ASR-Nano setup, recognizer source, and merged #110.
clowder-ai A local AI service launcher whose whisper-stt slot now includes Qwen3-ASR as a backend model variant, making local ASR setup visible without adding a separate speech service. Service manifest, recommendation matrix, and merged #1083.
QuQu A Chinese desktop voice-to-text workflow and open-source Wispr Flow alternative with a local FunASR Paraformer pipeline, bundled funasr_server.py, VAD, punctuation restoration, and optional LLM text optimization. Project README, FunASR server, and package metadata.
OpenLess An open-source macOS and Windows voice input app whose unified Bailian ASR provider exposes Fun-ASR-Flash recorded-file transcription alongside realtime ASR choices for cursor dictation and AI-prompt workflows. Project README, DashScope multimodal ASR provider, provider settings copy, and merged #793.
OmniVoice Studio A local voice-cloning, dubbing, dictation, and audiobook app with both an OpenAI-compatible remote ASR backend for self-hosted FunASR/SenseVoice servers and a native FunASR/SenseVoice + CAM++ path that keeps speaker identities consistent across whole recordings. OpenAI-compatible ASR guide, FunASR backend, merged #1003, and merged #1167.
GPT-SoVITS Dataset preparation and WebUI transcription with Fun-ASR-Nano, SenseVoice, and classic FunASR models. funasr_asr.py, runtime fallback #2801, and backend documentation #2803.
AudioNotes Audio and video note extraction to structured Markdown with Fun-ASR-MLT-Nano routed through the Fun-ASR Nano inference profile, including cache, batch size, and list-based hotwords. Project README, FunASR service, and merged #65.
Stet A macOS local dictation app with an in-process Fun-ASR Nano engine, a universal static runtime derived from FunASR's llama.cpp path, Settings-managed encoder/decoder/VAD downloads, runtime reuse, and hotword support from the personal dictionary. FunASR package notes, Fun-ASR Nano spec, and merged release #44.
NarratoAI An AI video narration and editing app whose OpenAI-compatible transcription endpoint can point subtitle generation at a self-hosted FunASR service. FunASR subtitle service, configuration example, and merged #259.
wyoming-faster-whisper A Wyoming protocol speech-to-text server with an optional FunASR backend, making SenseVoice/FunASR available to local voice-assistant deployments that speak Wyoming. FunASR handler, model registry, and merged #95.
Dify official plugins An official Dify speech-to-text model provider for self-hosted FunASR endpoints, with presets for SenseVoice, Fun-ASR-Nano, Paraformer, and Paraformer English. FunASR plugin README, provider implementation, speech-to-text adapter, and merged #3281.
RAGFlow A Retrieval-Augmented Generation and agent platform with a local FunASR / SenseVoice speech-to-text provider for self-hosted document and media ingestion workflows, plus hosted Fun-ASR-Flash speech-to-text through the Tongyi-Qianwen provider. Provider registration, supported models docs, merged #16473, and merged #16844.
LiveTalking A real-time interactive digital-human server with a local FunASR/SenseVoice ASR server path; the merged fix serializes shared model access so concurrent requests do not race during lazy model loading or generate(). ASR server, project README, and merged #611.
Sokuji A live speech translation app whose local inference sidecar supports GPU-native SenseVoice through FunASR plus built-in offline Fun-ASR-Nano and Fun-ASR-MLT-Nano catalog cards for CPU/GPU ASR. Sidecar model catalog, native model catalog, merged #268, merged #270, and merged #329.
VocaLinux An offline Linux dictation app whose remote ASR engine can connect to self-hosted FunASR or SenseVoice OpenAI-compatible endpoints. Remote ASR guide, recognition manager, and merged #468.
TranscriptionSuite A local private speech-to-text desktop/server app with a SenseVoice/FunASR backend, OpenAI-compatible audio routes, and CAM++ diarization support. SenseVoice backend, OpenAI audio route, merged #198, and merged #201.

Model serving and runtimes

Project What is integrated Start here
Xinference Built-in audio model specifications for SenseVoiceSmall, Fun-ASR-Nano-2512, and Fun-ASR-MLT-Nano-2512 through Xinference's unified inference API. Audio model specifications and the FunASR 1.3 compatibility update in merged #5140.
Optimum Intel OpenVINO export and inference support for Fun-ASR models through Hugging Face Optimum Intel, including FunASR-specific modeling and ASR/export/quantization coverage. FunASR OpenVINO modeling, supported models docs, and merged #1801.
OpenVINO Notebooks Official OpenVINO tutorial material for FunASR-Nano, including helper code and NPU device fixes for running the notebook on Intel acceleration paths. FunASR-Nano notebook, OpenVINO FunASR helper, merged #3497, and NPU fix #3517.
SGLang Omni A multi-stage pipeline runtime for omni models with built-in Fun-ASR model support, OpenAI-compatible serving, cookbook docs, benchmark tasks, and formatted stream-output tests. Fun-ASR cookbook, Fun-ASR model runtime, merged #1078, and merged review-fix #1079.
Fun-ASR-vLLM Community vLLM inference for Fun-ASR-Nano and Fun-ASR-MLT-Nano, including batch evaluation and NVIDIA Triton deployment. Setup and benchmarks and the deterministic ASR decoding fix in merged #20.
vad-burn FSMN VAD inference in pure Rust with Python bindings, including offline, streaming, and CPU-only modes. Project README and the FunASR showcase in #3106.

Discovery lists

Project What is integrated Start here
awesome-python SenseVoice is listed in the Speech Recognition section of one of the largest Python resource directories, making it easier for Python developers to discover local multilingual ASR. Project README and merged #3246.
speech-trident SenseVoice is listed among speech/audio language models in a curated speech LLM, representation learning, and codec model directory. Project README and merged #31.
voiceai A voice-AI agent resource map that lists FunASR and SenseVoice in its Speech-to-text (STT / ASR) section, pointing agent builders toward self-hosted local ASR and multilingual speech understanding options. English README, Chinese README, and merged #16.
Large-Audio-Models An audio-domain foundation-model directory that lists the FunAudioLLM voice understanding and generation paper with SenseVoice code, helping speech, singing, and music model readers discover the project. Project README and merged #26.
Neural-Codec-and-Speech-Language-Models A neural codec, TTS, and speech-language-model directory that lists both Fun-ASR-Nano and SenseVoice for readers comparing ASR and speech-understanding models. Project README and merged #4.

Before adopting an integration

  • Follow the upstream project's installation and release notes; do not assume its dependency versions match FunASR main.
  • Validate the exact model, language, audio format, and hardware path you plan to deploy.
  • Report application or adapter bugs to the integration project. Report reproducible core FunASR model or runtime bugs to FunASR issues.

Add your project

If you maintain a FunASR integration, open a showcase issue with:

  • repository link and maintenance status
  • supported FunASR model or runtime path
  • install and minimal usage instructions
  • a merged change, release, benchmark, or other reproducible validation
  • a note about whether the project is official, community-maintained, or experimental