Separate validation from inference

[adjavon]

Validation

• Runs on a smaller dataset
• Creates a log of performance:
  • confusion matrices
  • balanced accuracy
• Does not need to store the predictions

Inference

• Runs on a larger dataset
• Should store the predictions

Organization

• Inference code should be shared
• Saving/wrangling of the obtained results should be specific to each