A simple live translation app that transcribes German audio to text using a local model (Faster-Whisper) and provides a word-by-word English translation using a local dictionary.
- Python 3.8+
- Node.js 16+
ffmpeg(required forfaster-whisperaudio processing)- Mac:
brew install ffmpeg - Linux:
sudo apt install ffmpeg - Windows: Download and add to PATH
- Mac:
-
Backend Setup
cd backend python3 -m pip install -r requirements.txt -
Frontend Setup
cd frontend npm install
-
Start the Backend
cd backend python3 main.pyThe server will start at
http://0.0.0.0:8000. -
Start the Frontend
cd frontend npm run devOpen the URL shown (usually
http://localhost:5173) in your browser.
- Allow microphone access when prompted.
- Click the Mic button to start recording.
- Speak in German.
- The app will transcribe your speech and show word-by-word translations below the German text.
- Click the Stop button to stop recording.
- The first time you run the backend, it will download the
faster-whispermodel (approx. 500MB - 1GB depending on the model size). - The "live" translation works by sending audio chunks every 3 seconds.
- The dictionary is loaded from
backend/dictionary.json.