-
Notifications
You must be signed in to change notification settings - Fork 0
Open
Labels
enhancementNew feature or requestNew feature or request
Description
The current tokenization is not done in batch and it takes forever. We could change the dataloader helpers to tokenize examples in batch and that would speed things up a lot. We'd at least need to change the code here: https://github.com/jscuds/rf-bert/blob/master/dataloaders/helpers.py#L58-L62
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
enhancementNew feature or requestNew feature or request