Search results

will it support 4GB RTX3050 with 40GB RAM i5 12th gen

Status: Open.

#18 In kuleshov/minillm;

· rahulmr opened on Nov 8, 2024

Is this project still alive?

Status: Open.

#17 In kuleshov/minillm;

· allenyllee opened on Oct 24, 2023

wget https://huggingface.co/kuleshov/llama-7b-4bit/resolve/main/llama-7b-4bit.pt 404 error

Status: Open.

#15 In kuleshov/minillm;

· otakutyrant opened on Jun 29, 2023

Issue installing requirement "sentencepiece" until I ran the following

Status: Open.

#14 In kuleshov/minillm;

· salamanders opened on Jun 26, 2023

Curious - would this run faster using some of vllm-project/vllm?

Status: Open.

#13 In kuleshov/minillm;

· salamanders opened on Jun 26, 2023

Strange behavior of models on GPU a100

Status: Open.

#12 In kuleshov/minillm;

· Vldub opened on May 23, 2023

How to?

Status: Open.

#11 In kuleshov/minillm;

· javierp183 opened on May 6, 2023

Alpaca-native-4bit support

Status: Open.

#7 In kuleshov/minillm;

· TheHamkerCat opened on Mar 25, 2023

40 GB model

Status: Open.

#6 In kuleshov/minillm;

· DHOFM opened on Mar 23, 2023

Does not work out of the box in Windows 10

Status: Open.

#4 In kuleshov/minillm;

· 3dluvr opened on Mar 18, 2023

Dockerfile/docker image to quickly test (initial work provided)

Status: Open.

#1 In kuleshov/minillm;

· awesomebytes opened on Mar 17, 2023