Distil-Whisper in Rust 🦀 #28

sanchit-gandhi · 2023-11-09T10:39:23Z

sanchit-gandhi
Nov 9, 2023

Through an integration with Hugging Face Candle 🕯️, Distil-Whisper is now available in the Rust library 🦀

Benefit from:

Optimised CPU backend with optional MKL support for x86 and Accelerate for Macs.
CUDA backend for efficiently running on GPUs, multiple GPU distribution via NCCL.
WASM support, run Distil-Whisper in a browser!

Here's an example running distil-medium.en on Mac M1:

jfk.mov

Steps for getting started:

git clone https://github.com/huggingface/candle.git

cd candle/candle-examples/examples/whisper

cargo run --example whisper --release -- --model distil-medium.en

cargo run --example whisper --release -- --model distil-medium.en --input audio.wav