An oral-first guide for Rohingya refugees in Canada, using audio and visual workflows to navigate daily life.
sahayyo-demo.mp4
- Home screen — tap a category (Food, Doctor, etc.) or use Ask AI to describe any need in your own words
- Venue picker — choose what kind of place you're looking for (grocery, restaurant, pharmacy…)
- AI custom flow (Ask AI only) — Gemini generates 2–4 culturally-aware options; tap one to continue
- Recommend screen — the nearest matching place is shown with distance, duration, and a photo; switch between walking and transit
- Step-by-step guidance — turn-by-turn walking route, then in-store instructions; each step has:
- Emoji icons matched to the instruction
- Bengali/Rohingya text as the primary heading
- English subtitle for helpers or support workers
- Audio playback — tap to hear the instruction read aloud (translated + AI-generated speech)
| Layer | Technology |
|---|---|
| Frontend | React 19, Vite, Tailwind CSS |
| Backend | Node.js, Express |
| Navigation | Google Maps Places API + Directions API |
| AI (Logic) | Google Gemini 2.5 Flash |
| AI (Language) | OpenAI GPT-4o-mini (Translation) + OpenAI TTS-1 (Audio) |
git clone https://github.com/hojundev/Sahayyo.git
cd Sahayyo
npm run install:allCreate backend/.env:
GOOGLE_MAPS_API_KEY=your_key_here
GEMINI_API_KEY=your_key_here
OPENAI_API_KEY=your_key_here
PORT=3001
No keys? The app falls back to demo mode — fake directions are returned so you can test the full UI without any API calls.
npm run devOpen http://localhost:5173 in your browser (or on your phone via your local network IP).
| Category | Status | Notes |
|---|---|---|
| 🥬 Grocery / Supermarket | ✅ Full | Walking route + in-store steps |
| 🍽️ Restaurant | ✅ Full | Includes tipping + menu guidance |
| ☕ Café | ✅ Full | Counter ordering flow |
| 🍞 Bakery | ✅ Full | Browse at your own pace |
| 🏪 Convenience Store | ✅ Full | Higher prices warning included |
| 💊 Pharmacy | ✅ Full | Health card + no appointment needed |
| 🏥 Hospital / Emergency | ✅ Full | 24hr, interpreter rights, health card |
| 🩺 Doctor / Walk-in Clinic | ✅ Full | Sign-in process, wait time |
| ❓ Ask AI (anything) | ✅ Full | Gemini generates options for any request |
- Implement Few-Shot Voice Cloning (RVC) using native Rohingya speaker samples
- Modularize the JSON schema to support new low-resource languages (Pashto, Dari, Tigrinya)
- Offline mode — cache routes and audio for areas with poor connectivity
- Add additional task categories including Bus and School task flows