Malaika: Companion that actually says things.

Malaika isn't just a companion, she's a presence. Inspired by the minimalist elegance of "Her" and the high-energy aesthetic of modern social interfaces, Malaika combines a 3D persona with a cutting-edge neural architecture. No sidebars, no clutter just one immersive screen where classical beauty meets the edge of what's possible.

Tech Stack

Frontend

Backend

Tools & Platforms

Quick Start

Prerequisites

• Python 3.9+
• Node.js 18+
• Docker & Docker Compose
• Hugging Face API Token

Project Structure

• frontend/: Contains the React application with TypeScript and Three.js 3D rendering.
• backend/: Contains the FastAPI backend with ChromaDB memory integration.

Setup and Installation

Backend

1. Navigate to the backend directory:

   cd backend

2. Install the required Python packages:

   pip install -r requirements.txt

3. Set your Hugging Face API key as an environment variable:

   export HUGGINGFACE_API_KEY='your_huggingface_api_key'

4. Run the backend server:

   uvicorn app.main:app --reload --port 8000

Frontend

1. Navigate to the frontend directory:

   cd frontend

2. Install the required npm packages:

   npm install --legacy-peer-deps

3. Start the React development server:

   npm start

Docker Setup (Alternative)

1. Run with Docker Compose:

   docker-compose up --build

Features

• Multi-modal Memory: Integrated with ChromaDB for hybrid semantic/chronological retrieval of conversations.
• Proactive Visual Awareness: Powered by Moondream2 for visual context awareness.
• Emotional Depth: Dual-layered emotion engine analyzing facial expressions and message sentiment.
• Natural Speech Synthesis: Edge-TTS with natural prosody and conversational flow.

Usage

1. Open your web browser and navigate to http://localhost:3000.
2. Interact with Malaika through voice or text.
3. Experience a living, breathing AI companion.

I need coffee to stay alive. Yes i'm that Dumb.

License

This project is licensed under the MIT License.

Support

If you have any questions or issues, please open an issue on GitHub or contact mwalyangashadrack@gmail.com

Companion that actually says things!