Skip to content

Comments

add tool to dump prompt from opencompass dataset#3

Open
IJtLJZ8Rm4Yr wants to merge 3 commits intoIndustryEssentials:mainfrom
IJtLJZ8Rm4Yr:main
Open

add tool to dump prompt from opencompass dataset#3
IJtLJZ8Rm4Yr wants to merge 3 commits intoIndustryEssentials:mainfrom
IJtLJZ8Rm4Yr:main

Conversation

@IJtLJZ8Rm4Yr
Copy link

Dataset(commonsenseqa) used MDLRetriever, which will OOM after a few loop.

Add torch.no_grad to save memory.

@IJtLJZ8Rm4Yr IJtLJZ8Rm4Yr changed the title Fix OOM while using MDLRetriever add tool to dump prompt from opencompass dataset Nov 7, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants