Skip to content

Periodically write data to file while scraping #11

@ChrisMuir

Description

@ChrisMuir

This was suggested in issue #10 by addieg. Currently, all of the scraped data is written to file as the last step in the process. It makes sense to write scraped data to file at some regular interval while the script is running....should probably dump to file after each individual search term.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions