celery-video-transcoder

FastAPI and Celery pipeline for bulk video transcode - to simulate YouTube uploads.

This repository is a part of my blog on Distributed Computing with Python: Unleashing the Power of Celery for Scalable Applications. Follow it for detailed instructions.

Install Redis and RabbitMQ in your system or run the given docker-compose.yml

docker compose up

Once the containers are stated, Redis will be available at redis://localhost:6379 and RabbitMQ will be available at rabbitmq://localhost:5672

Install ffmpeg in your system

sudo apt install ffmpeg # Assuming ubuntu / debian system

For other os, please follow the official guide.

Create python a virtual environment

python -m venv venv
source venv/bin/activate

Install dependencies

pip install -r requirements.txt

Run the FastAPI server

fastapi run api.py

Run the Celery worker

celery -A celery_worker worker