DeliteAI is a powerful on-device AI platform for building agentic workflows that enables developers to deliver secure, privacy-aware, and high-performance AI native experiences and applications across multiple platforms and devices.
- Unified and simplified APIs for seamless AI agents integration in Android/iOS applications
- Python interface for orchestrating complex AI agentic workflows via tool calling, memory and LLMs on-device
- Streamlined development process for both new and existing applications
- Cross-platform compatibility across operating systems
- Support for various compute platforms and runtimes
- Abstracted development layer for the fragmented device landscape
- Optimized for resource-constrained environments with efficient CPU/memory usage
- Privacy-first approach with on-device processing
- Hardware-accelerated model execution
- Easy integration of custom Python operators
- Flexible runtime support (ONNX or ExecuTorch)
To get started you can:
- Follow the steps in coreruntime to build and test the core C++ SDK with Python bindings
- Build and try out the Android and iOS SDK and sample app
- Explore the available agents in the agents directory.
Visit the assistant repo to see it all in action.
[Coming Soon]
We welcome any feedback or suggestions - please join our Discord to engage with the community.
We welcome contributions from the community! Whether you're interested in:
- Adding new Python operators
- Enhancing runtime support
- Improving documentation
- Reporting bugs or suggesting features
Please read our Contributing Guidelines to get started.
This project is licensed under the Apache License 2.0 - see the LICENSE file for details.