E-Commerce Price Comparison Scraper

This project builds a scraping pipeline + API + React UI for comparing product prices across Nigerian e-commerce sites.

Repo Layout

• backend/ FastAPI API, database models, scrapers, and scheduler
• frontend/ React UI
• docs/ short guides for scraping and workflows

Quick Start (Local)

Backend:

cd backend
python -m venv .venv
source .venv/bin/activate
pip install -r requirements.txt
cp .env.example .env
python -m app.scripts.init_db
python -m app.scripts.seed
uvicorn app.main:app --reload

Konga (JS-rendered) requires Playwright:

python -m playwright install chromium

Frontend:

cd frontend
npm install
npm run dev

Next Steps

• Add real scrapers per site in backend/app/scrapers/.
• Update the query list in .env for scheduled scraping.
• Replace seeded data with real scraped listings.

See docs/scraping-guide.md for a quick DOM + selector workflow.