Skip to content

Commit 86f8f93

Browse files
committed
Update readme
1 parent af7f819 commit 86f8f93

File tree

1 file changed

+33
-0
lines changed

1 file changed

+33
-0
lines changed

README.md

Lines changed: 33 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,36 @@
1+
# quantum-llama.cpp
2+
3+
quantum-llama.cpp is a modified [llama.cpp](https://github.com/ggml-org/llama.cpp)
4+
that uses Quantum World Corporation (QWC) / ComScire QRNGs (Quantum Random
5+
Number Generators) to generate the tokens. While the output may be
6+
indistinguishable from the original llama.cpp, it introduces a poetic idea,
7+
_"the output is co-authored by the universe itself."_
8+
9+
To use quantum-llama.cpp, you need to have a running [psirng](https://github.com/nullspook/psirng)
10+
server. Set `PSIRNG_HOST`, `PSIRNG_GRPC_PORT`, and `PSIRNG_CERT_PATH`
11+
environment variables before running `llama-*` programs.
12+
13+
**Example:**
14+
15+
```bash
16+
# Build
17+
cmake -B build
18+
cmake --build build --config Release
19+
20+
# Set environment variables
21+
export PSIRNG_HOST=192.0.2.10
22+
export PSIRNG_GRPC_PORT=50051
23+
export PSIRNG_CERT_PATH=/path/to/cert.pem
24+
25+
# Run
26+
cd build/bin
27+
./llama-cli -m /path/to/model.gguf -p "I believe the meaning of life is" -n 128
28+
```
29+
30+
**Note:** quantum-llama.cpp must be built using `cmake`.
31+
32+
---
33+
134
# llama.cpp
235

336
![llama](https://user-images.githubusercontent.com/1991296/230134379-7181e485-c521-4d23-a0d6-f7b3b61ba524.png)

0 commit comments

Comments
 (0)