Commit 9d86a49
feat(plugins): add Parakeet TDT speech-to-text plugin
Add a new native plugin for fast English speech recognition using NVIDIA's
Parakeet TDT (Token-and-Duration Transducer) 0.6B model via sherpa-onnx.
Parakeet TDT is approximately 10x faster than Whisper on consumer hardware
with competitive accuracy (#1 on HuggingFace ASR leaderboard).
Plugin implementation:
- Offline transducer recognizer (encoder/decoder/joiner) via sherpa-onnx C API
- Silero VAD v6 for streaming speech segmentation
- Recognizer caching keyed on (model_dir, num_threads, execution_provider)
- Configurable VAD threshold, silence duration, and max segment length
- 16kHz mono f32 audio input, transcription output
Justfile additions:
- build-plugin-native-parakeet: build the plugin
- download-parakeet-models: download INT8 quantized model (~660MB)
- setup-parakeet: full setup (sherpa-onnx + models + VAD)
- Added parakeet to copy-plugins-native loop
Includes sample oneshot pipeline (parakeet-stt.yml) and plugin.yml manifest.
Signed-off-by: StreamKit Devin <devin@streamkit.dev>
Co-Authored-By: Claudio Costa <cstcld91@gmail.com>1 parent 4552035 commit 9d86a49
File tree
11 files changed
+2616
-1
lines changed- plugins/native/parakeet
- src
- samples/pipelines/oneshot
11 files changed
+2616
-1
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
723 | 723 | | |
724 | 724 | | |
725 | 725 | | |
| 726 | + | |
| 727 | + | |
| 728 | + | |
| 729 | + | |
| 730 | + | |
| 731 | + | |
| 732 | + | |
| 733 | + | |
| 734 | + | |
| 735 | + | |
| 736 | + | |
| 737 | + | |
| 738 | + | |
| 739 | + | |
| 740 | + | |
| 741 | + | |
| 742 | + | |
| 743 | + | |
| 744 | + | |
| 745 | + | |
| 746 | + | |
| 747 | + | |
| 748 | + | |
| 749 | + | |
| 750 | + | |
| 751 | + | |
| 752 | + | |
| 753 | + | |
| 754 | + | |
| 755 | + | |
| 756 | + | |
| 757 | + | |
| 758 | + | |
| 759 | + | |
| 760 | + | |
| 761 | + | |
| 762 | + | |
726 | 763 | | |
727 | 764 | | |
728 | 765 | | |
| |||
1042 | 1079 | | |
1043 | 1080 | | |
1044 | 1081 | | |
1045 | | - | |
| 1082 | + | |
1046 | 1083 | | |
1047 | 1084 | | |
1048 | 1085 | | |
| |||
0 commit comments