Search results

Bug in RoPE

Status: Open.

#10 In NVIDIA/ngpt;

· gvlassis opened on Mar 5, 2025

nGPT and small models (100M-300M)

Status: Open.

#9 In NVIDIA/ngpt;

· shashwat14 opened on Mar 5, 2025

How was the validation split created?

Status: Open.

#8 In NVIDIA/ngpt;

· akash-kamalesh opened on Jan 19, 2025

Curious why F.normalize() is commented in the training script?

Status: Open.

#7 In NVIDIA/ngpt;

· ChloeL19 opened on Jan 8, 2025

Question when reproducing the experiment in the paper

Status: Open.

#6 In NVIDIA/ngpt;

· Kevinstone-199898 opened on Dec 12, 2024

[Not a Bug] Regarding nGPT and Quantization

Status: Open.

#5 In NVIDIA/ngpt;

· akhilkedia opened on Dec 6, 2024

Checkpoints for best 1B models at 8K context

Status: Open.

#4 In NVIDIA/ngpt;

· Thiggel opened on Nov 30, 2024