Parsing Automation App

This repository contains a parsing automation app. The main scripts are main.py and open_page_retry.py.

Installation

1. Clone the repository:

   git clone https://github.com/yourusername/selenium_tutorial.git
   cd selenium_tutorial

2. Create a virtual environment:

   python3 -m venv venv
   source venv/bin/activate  # On Windows use `venv\Scripts\activate`

3. Install the required packages:

   pip install -r requirements.txt

Configuration

1. Create a .env file in the root directory of the project:

   touch .env

2. Add your credentials to the .env file:

   USERNAME=your_username
   PASSWORD=your_password
   LOGIN_URL=your_login_url
   ROUTE_TO_PARSE=route_you_want_to_parse
   CLASS_TO_PARSE=class_of_html_tag
   FILE_NAME=file_name.json

Usage

Run the main script:

python main.py

Files

• main.py: The main script to run the parsing automation.
• open_page_retry.py: Contains functions to handle page opening with retry logic.

License

This project is licensed under the MIT License.