Skip to content

Implement metric parameter for cross_validation_across_time #1

@skjerns

Description

@skjerns

it would be nice to have a parameter with which we can use a different scoring algorithm for the function.

The parameter should accept either a string keyword or alternatively a function. if it's a string, it should take a function from https://scikit-learn.org/stable/modules/model_evaluation.html with the corresponding name

for the top-N you can use https://scikit-learn.org/stable/modules/generated/sklearn.metrics.top_k_accuracy_score.html

so you can call cross_validation_across_time(..., metric='top-3')

the default should be metric='accuracy'

Best,
Simon

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions