Scraping the web using Selenium, Beautifulsoup and requests in python
The selenium package is used to automate web browser interaction from Python.
pip install -U selenium
or
pip install -r setup.py
i.e touch setup.py with 'selenium' in it
ChromeDriver lets you perform tasks in the browser
I have included ChromeDriver in the 'include' folder, but if you want to create your own project download ChromeDriver and include your path in your code
Virtualenv is a tool to create isolated Python environments.
[sudo] pip install virtualenv
virtualenv webscraping
pip install -r setup.py
The setup.py file should contain dependency 'selenium'
Source webscraping/bin/activate
i.e source and the location of your activate file in the bin
pip install pandas
pip install requests
pip install bs4