This will depend on if we have enough time to actually tune the hyperparameters. We can evaluate this once we know exactly how much data we will train on and how long it takes. We can use a library like [Optuna](https://optuna.org/).