🧠 ort – ONNX Runtime for Rust Maintained by @kaydeewrld

ort is an unofficial Rust wrapper for ONNX Runtime 1.22, built to accelerate machine learning inference and training on both CPU and GPU using the power of Rust and ONNX. It's based on the now-inactive onnxruntime-rs project and has been reimagined to support modern ML workloads with efficiency and flexibility.

🚀 Features Bindings for ONNX Runtime 1.22

CPU and GPU acceleration support

Safe, idiomatic Rust APIs

Active support and community via GitHub and Discord

📚 Documentation Getting Started Guide

API Reference

Migration Guide: v1.x → v2.0

Examples

💬 Community & Support 💬 Discord: #ort-discussions

GitHub Discussions

🌟 Projects Using ort Have a cool project that uses ort? Open a PR to get featured here!

Bloop – Semantic code search

Spacedrive – Cross-platform file manager with AI

Supabase – Edge functions without cold starts

Aftershoot – AI-assisted image editing

FastEmbed-rs – Local embedding generation

Lantern – Embedding inference in Postgres

...and more!

❤️ Sponsors & Contributions Support ort on Open Collective to help maintain fast, open, and secure machine learning tools in Rust.

📦 Crates.io 📦 ort on crates.io