File tree Expand file tree Collapse file tree 1 file changed +33
-0
lines changed
Expand file tree Collapse file tree 1 file changed +33
-0
lines changed Original file line number Diff line number Diff line change 1+ # quantum-llama.cpp
2+
3+ quantum-llama.cpp is a modified [ llama.cpp] ( https://github.com/ggml-org/llama.cpp )
4+ that uses Quantum World Corporation (QWC) / ComScire QRNGs (Quantum Random
5+ Number Generators) to generate the tokens. While the output may be
6+ indistinguishable from the original llama.cpp, it introduces a poetic idea,
7+ _ "the output is co-authored by the universe itself."_
8+
9+ To use quantum-llama.cpp, you need to have a running [ psirng] ( https://github.com/nullspook/psirng )
10+ server. Set ` PSIRNG_HOST ` , ` PSIRNG_GRPC_PORT ` , and ` PSIRNG_CERT_PATH `
11+ environment variables before running ` llama-* ` programs.
12+
13+ ** Example:**
14+
15+ ``` bash
16+ # Build
17+ cmake -B build
18+ cmake --build build --config Release
19+
20+ # Set environment variables
21+ export PSIRNG_HOST=192.0.2.10
22+ export PSIRNG_GRPC_PORT=50051
23+ export PSIRNG_CERT_PATH=/path/to/cert.pem
24+
25+ # Run
26+ cd build/bin
27+ ./llama-cli -m /path/to/model.gguf -p " I believe the meaning of life is" -n 128
28+ ```
29+
30+ ** Note:** quantum-llama.cpp must be built using ` cmake ` .
31+
32+ ---
33+
134# llama.cpp
235
336![ llama] ( https://user-images.githubusercontent.com/1991296/230134379-7181e485-c521-4d23-a0d6-f7b3b61ba524.png )
You can’t perform that action at this time.
0 commit comments