NiLLM

The Professional Model Arena.

NiLLM is a high-performance desktop arena designed for developers and AI researchers to benchmark LLMs side-by-side.

Live Benchmarking: Real-time tracking of TTFT, TPS, and total duration.
Side-by-side: Concurrent streaming responses for instant cross-comparison.
AI Judging: Automated quantitative scoring powered by frontier models.
Global Control: Unified management of system prompts and generation parameters.

Built with Tauri, React, and Tailwind CSS.

pnpm install
pnpm tauri dev

Simplicity is the ultimate sophistication.

Name		Name	Last commit message	Last commit date
Latest commit History 29 Commits
.github		.github
.husky		.husky
assets		assets
public		public
scripts		scripts
src-tauri		src-tauri
src		src
.env.example		.env.example
.gitignore		.gitignore
.prettierignore		.prettierignore
LICENSE		LICENSE
README.md		README.md
components.json		components.json
eslint.config.js		eslint.config.js
index.html		index.html
package.json		package.json
pnpm-lock.yaml		pnpm-lock.yaml
pnpm-workspace.yaml		pnpm-workspace.yaml
prettier.config.js		prettier.config.js
tsconfig.json		tsconfig.json
tsconfig.node.json		tsconfig.node.json
vite.config.ts		vite.config.ts

Provide feedback