Feature request : allow a file cache to be configured

[bperel]

Especially for long series, it would be quite useful to be able to configure a file cache, in order not to have to download the whole data each time a program using bedetheque-scraper is run.

When the cache config is enabled, bedetheque-scraper should check if a cache file exists for a given series or album, and if not store the data into it, as HTML. If the program is run a 2nd time with the cache still enabled, the HTML file stored locally should be read instead of re-downloaded.

[givka]

Can you give me a serie that takes a long time to scrape ?
https://www.bedetheque.com/serie-12842-BD-Picsou-Magazine.html with 586 albums took approx 4sec to scrape for me.

The previous version of this project used probe-image-size, which added a lot of time to fetch image sizes.

[bperel]

It's not really about the time that the scrape takes, but more about avoiding to access Bedetheque unnecessarily. I understand that it would be a minor feature.

[givka]

This can be done independently of this project, but be careful, the pages will change with time.