Skip to content

Performance evaluation script #16

@puria-radmard

Description

@puria-radmard
  • Load in finetuned model
  • Generate a bunch of text
  • Check how many layers were skipped
  • Put generated text into a inspect-style prompt asking for coherence (<coherence_score> </coherence_score>)

Metadata

Metadata

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions