-
Notifications
You must be signed in to change notification settings - Fork 42
Converter to tf.record improvements #118
Copy link
Copy link
Open
Description
iislucas
opened on Jul 1, 2018
Issue body actions
- The current CSV to tf.record converter has hard-wired field selectors. These should be specified on the command line.
- CSV is a bad format: there are multiple usually incompatible and badly supported 'standards'. If people use CSV, print out a warning, that CSVs are fragile, and the user should consider a more robust format like jsonlines, or json.
- Support jsonlines, and json input, and when we do that, maybe rename script appropriately.
- Consider: make our dataset class natively support and convert examples inline instead of requiring pre-processing.
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
No labels