We want to extend Armory Library to support the evaluation of text models, particularly LLMs. Supporting text evaluations will require the classes below.
- Text data set and data loader
- Text model wrapper
- Text evaluation metrics
LLM model sources:
Text evaluations and metrics:
We want to extend Armory Library to support the evaluation of text models, particularly LLMs. Supporting text evaluations will require the classes below.
LLM model sources:
Text evaluations and metrics: