Asphalt is a web scraper for aggregating articles from a blog or news website and use it for context in various AI.
Created by: Niccolò Agnoletti License: GPL v2.0 or greater Language: Python 3 Version: 0.1a System: MacOS
For a specific website, edit the file selectors.json with the corect html structure. Blog is for the blog home page where the scraper will gather links, Article is for the single article structure where the scraper will gather the content.
python3 -m venv venv
source venv/bin/activatedeactivate