SummaryWriter

[Rowan-McKereghan]

Adding gutenberg-updates summary generation into ebookconverter workflow.

Needs OpenAI API key in .env file to work.

[eshellman]

Good start.

1. if you inherit from ebookmaker.writers.TxtWriter, you can pull off the txt directly from the source using the code that makes the txt file. (hint: the text is wrapped in a TxtParser)
2. important to use ORM to load untrusted data. the code I used to load summaries from Johannes is here: https://github.com/JohannesSeikowsky/gutenberg_updates/blob/eric/load_summaries_from_table.py

[eshellman]

Might be good to load the prompt from a txt file.

[Rowan-McKereghan]

replaced database + SQL with ORM, got text from parser (job.url was None running locally, but when I tested with manually set url var, it worked – let me know if I need to debug further)

[Rowan-McKereghan]

added prompts to local py file classes

[Rowan-McKereghan]

added wikipedia summaries (in native languages if possible)

[Rowan-McKereghan]

add wiki urls to database if summary comes from wikipedia

[Rowan-McKereghan]

if wiki article already exists in database, pull from there (if link is still valid)