Full End-To-End Inference Flow and Gateway Node Implementation by samherring99 · Pull Request #487 · PsycheFoundation/nousnet

Updating protocol with InferenceMessage and InferenceGossipMessage types, adding initial skeleton of inference-node main loop, wiring inference-node up to iroh gossip updates, updating Cargo toml

samherring99

committed

Adding gateway node binary file source and adding protocol handler to shared crate

samherring99

committed

Adding additional protocols vec to P2PNetwork init, updating protocol param type to be optional, single protocol, and generic, adding justfile commands and test script to test inference

samherring99

committed

Bootstrapping from file and env variable, adding direct connection P2P response handling

samherring99

committed

Adding stop tokens and chat templating to rust bridge, updating Cargo.lock

samherring99

committed

Migrating all code to OpenAI API compatible chat completions endpoint

samherring99

committed

Updating init method changes for shared network to have an optional ProtocolHandler method and custom protocol code path

samherring99

committed

Moving bootstrap logic to new lib file in inference crate and changing to single node selection for request routing

samherring99

committed

Removing gateway feature flag, adding task set for tracking spawned tasks

samherring99

committed

Updating scripts and justfile to use nix run

samherring99

committed

Changing relay and discovery mode to be defaulted CLI args

samherring99

committed

fix weird bash devshell

arilotter

authored and

samherring99

committed

Fixing merge conflicts

samherring99

committed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Full End-To-End Inference Flow and Gateway Node Implementation#487

Full End-To-End Inference Flow and Gateway Node Implementation#487
samherring99 wants to merge 13 commits intomainfrom
inference_networking_gateway

Commits on Feb 5, 2026

Updating protocol with InferenceMessage and InferenceGossipMessage types, adding initial skeleton of inference-node main loop, wiring inference-node up to iroh gossip updates, updating Cargo toml

Adding gateway node binary file source and adding protocol handler to shared crate

Adding additional protocols vec to P2PNetwork init, updating protocol param type to be optional, single protocol, and generic, adding justfile commands and test script to test inference

Bootstrapping from file and env variable, adding direct connection P2P response handling

Adding stop tokens and chat templating to rust bridge, updating Cargo.lock

Migrating all code to OpenAI API compatible chat completions endpoint

Updating init method changes for shared network to have an optional ProtocolHandler method and custom protocol code path

Moving bootstrap logic to new lib file in inference crate and changing to single node selection for request routing

Removing gateway feature flag, adding task set for tracking spawned tasks

Updating scripts and justfile to use nix run

Changing relay and discovery mode to be defaulted CLI args

fix weird bash devshell

Fixing merge conflicts