Skip to content

BlackRoad-AI/ollama-models

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

5 Commits
 
 
 
 
 
 
 
 
 
 
 
 

ollama models

Part of BlackRoad OS — Sovereign Computing for Everyone

BlackRoad OS BlackRoad-AI

ollama models is part of the BlackRoad OS ecosystem — a sovereign, distributed operating system built on edge computing, local AI, and mesh networking by BlackRoad OS, Inc.

BlackRoad Ecosystem

Org Focus
BlackRoad OS Core platform
BlackRoad OS, Inc. Corporate
BlackRoad AI AI/ML
BlackRoad Hardware Edge hardware
BlackRoad Security Cybersecurity
BlackRoad Quantum Quantum computing
BlackRoad Agents AI agents
BlackRoad Network Mesh networking

Website: blackroad.io | Chat: chat.blackroad.io | Search: search.blackroad.io


Local LLM inference with custom model configurations

Quick Start

# Install Ollama
curl -fsSL https://ollama.com/install.sh | sh

# Pull BlackRoad models
./scripts/pull-all.sh

# Run a model
ollama run blackroad-coder

Custom Models

BlackRoad Coder (Code Generation)

ollama create blackroad-coder -f models/blackroad-coder.Modelfile

BlackRoad Analyst (Data Analysis)

ollama create blackroad-analyst -f models/blackroad-analyst.Modelfile

BlackRoad Agent (Task Execution)

ollama create blackroad-agent -f models/blackroad-agent.Modelfile

Model Configurations

Model Base Size Quantization Purpose
blackroad-coder codellama:34b 19GB Q4_K_M Code gen
blackroad-analyst mistral:7b 4.1GB Q4_0 Analysis
blackroad-agent llama3:8b 4.7GB Q4_0 Tasks
blackroad-phi phi3:mini 2.3GB Q4_0 Fast inference

API Usage

import ollama

response = ollama.chat(model='blackroad-coder', messages=[
    {'role': 'user', 'content': 'Write a Python function for Fibonacci'}
])
print(response['message']['content'])

Fleet Deployment

Deploy across all BlackRoad devices:

for host in cecilia lucidia alice aria; do
  ssh $host 'ollama pull mistral:7b'
done

BlackRoad OS - Local AI Power

About

ollama models — BlackRoad AI. Local-first artificial intelligence, LLMs on your hardware. No cloud, no API keys. BlackRoad OS.

Topics

Resources

License

Code of conduct

Contributing

Security policy

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors

Languages