AI-powered multimodal assistant for receipt management, Google wallet integration, and sustainable spending. Built with Flutter, Python, and Vertex AI Agents on Google Cloud.
- Upload receipts as image, document, video, or audio
- Uses Document AI, Gemini 2.5, and Speech-to-Text
- Extracted data is structured as JSON and stored in Firestore
- Auto-classifies products with Gemini 2.5 Pro
- Constructs entity-relation graphs stored in Firestore
- Flags warranty and expiration items
- Schedules Google Calendar reminders for returns, insurance, expiry
- Generates Wallet Passes: summaries, shopping lists, reminders
- Pushes updates via the Google Wallet API
- Detects recurring purchases
- Suggests eco-friendly, cost-saving alternatives
- Predicts product shelf life and performs Firestore cleanup
- Multilingual & voice-based querying
- Google Calendar integration for automated reminders
- Spending graph visualizations and insights
- Suggests nearby recycling/pre-owned stores via Places API
- Modular design with Vertex AI Agents for scalable orchestration
| Layer | Technology |
|---|---|
| Frontend | Flutter |
| Backend | Python (FastAPI/Flask) |
| AI/Cloud | Vertex AI, Gemini 2.5, Document AI, Firestore |
| API | Wallet API, Calendar API, Google Places API |
|
Sajeev Senthil |
Charuvarthan |
Suganth |
Abiruth |
Siva Prasanth Sivaraj |
Presented at the Google Agentic AI Day Hackathon for outstanding innovation in agentic AI applications.
- 🌍 57,000+ developers signed up globally
- 💡 9,100+ ideas submitted
- ✅ Top 700 teams shortlisted — including 650+ professional teams and 50+ student teams
- 🎯 For our problem statement, we were the only student team to reach the Top 15 finalists
- 🥇 Honored with the Concept Award for pushing boundaries in multimodal AI and sustainable tech