nGPT and small models (100M-300M)

Hi, thanks for sharing this amazing work! I am wondering if you guys have run nGPT on smaller models (approx 100M-200M)? I tried running nGPT on a 360M with 2k context and saw negligible benefit. I am wondering if this effect only gets pronounced around 500M models with 4k context?