[translate:A real-time caption generator for videos and YouTube, supporting multiple Indian languages with open-source Whisper ASR and LibreTranslate for translations.]
- Upload mp4 videos or paste YouTube links to generate captions live.
- Supports multiple Indian languages including Hindi, Tamil, Bengali, Telugu, Malayalam, Marathi & English.
- Uses OpenAI Whisper for speech-to-text.
- Translates English transcripts to Hindi using LibreTranslate API.
- Real-time caption streaming with Flask backend and React frontend.
- Accessible and privacy focused.
To be added - link or GIF of demo UI.
- Python 3.9+
- Node.js & npm
- FFmpeg installed and accessible globally
- Git
cd Backend python -m venv venv
Activate virtual environment Windows: .\venv\Scripts\activate
Linux/Mac: source venv/bin/activate
pip install -r requirements.txt
text
cd Frontend npm install npm start
text
Open browser at http://localhost:3000
- Windows:
choco install ffmpeg(if you use Chocolatey) - Mac:
brew install ffmpeg - Linux:
sudo apt install ffmpeg
- Upload video or paste YouTube URL in UI.
- Select language.
- Start transcription.
- View live captions and download transcript.
- LibreTranslate API is used for free translation, subject to latency.
- English speech is transcribed in English; Hindi language selection will translate post transcription.
- YouTube processing can take longer due to download and extraction steps.
- Make sure backend (port 5000) and frontend (port 3000) run simultaneously.
Contributions welcome! Fork repo, make changes, create pull requests.