Skip to content

README.md

Latest commit

 

History

History
37 lines (27 loc) · 1.08 KB

README.md

File metadata and controls

37 lines (27 loc) · 1.08 KB

What is it?

Pack of scripts allowing fast and automated population of PrestaShop database with categories, products and images. Data is scraped from www.udemy.com. Script is developed for university project.

Scripts:

  • Data scraper - get_courses_info_from_udemy.py
  • Database population - import_data_to_prestashop.py

How to execute it?

Python:
  • Python 3.7 or newer required.
  • To install all required dependencies: pip install -r requirements.txt
WebDriver:

Script uses Firefox webdriver for automated web browsing. Path of the webdriver needs to be specified in system's PATH

Scripts execution:

  • python get_courses_info_from_udemy.py
Script scraping www.udemy.com for ~500 courses required for University Project. 
Prepared data can be later imported with the second script.

  • python import_data_to_prestashop.py -k KEY
Script importing categories, courses and images to PrestaShop

optional arguments:
  -h, --help         show this help message and exit
  
required arguments:
  -k KEY, --key KEY  Key for PrestaShop webservice