Skip to content

README.md

Latest commit

 

History

History
50 lines (39 loc) · 1.14 KB

README.md

File metadata and controls

50 lines (39 loc) · 1.14 KB

Hancock Node.js Client

Interact with NVIDIA NIM models directly from Node.js.

Setup

cd clients/nodejs
npm install
export NVIDIA_API_KEY=nvapi-YOUR_KEY_HERE

Usage

Interactive CLI

node hancock.js                    # security mode (Mistral 7B)
node hancock.js --mode code        # code mode (Qwen 2.5 Coder 32B)

One-shot

node hancock.js --task "explain Log4Shell CVE-2021-44228"
node hancock.js --mode code --task "write a YARA rule for Emotet"

In-session commands

/mode security    Switch to security analyst mode
/mode code        Switch to code generation mode  
/model qwen-coder Change model by alias
/exit             Quit

Models

Alias Model
mistral-7b mistralai/mistral-7b-instruct-v0.3
qwen-coder qwen/qwen2.5-coder-32b-instruct
llama-8b meta/llama-3.1-8b-instruct
mixtral-8x7b mistralai/mixtral-8x7b-instruct-v0.1

Environment Variables

Var Default
NVIDIA_API_KEY (required)
HANCOCK_MODEL mistralai/mistral-7b-instruct-v0.3
HANCOCK_CODER_MODEL qwen/qwen2.5-coder-32b-instruct