Training Environment Details and Time

[shashacks]

Thank you for the great work and for sharing everything!

1. Could you please share the dependencies you used to train the model—such as the Python version, and the versions of PyTorch, Flash-Attention, Transformers, etc.?

2. I'd also really appreciate it if you could share the GPU setup you used (e.g., GPU type and count), along with an estimate of training time (e.g., how long one training step takes).