Skip to content

ETL_HOME_WORK-PHILIP EFEM#26

Open
pefem wants to merge 1 commit intoHedgeApple:masterfrom
pefem:master
Open

ETL_HOME_WORK-PHILIP EFEM#26
pefem wants to merge 1 commit intoHedgeApple:masterfrom
pefem:master

Conversation

@pefem
Copy link
Copy Markdown

@pefem pefem commented Sep 12, 2023

The code below makes use of the pandas library to achieve the required transformations as highlighted in the Readme file. Although the CSV reader from the standard python could have been used, the option to use pandas is majorly due to the large size of the dataset.

The program comprises of two python files; app.py, which serves as the main entry point to the program and transformations.py which handles all required transformations. To run this file simply install the requirements for the requirements.txt file(NB: Only pandas is required, other libraries found in the file were installed in the process of installing pandas), open a terminal of your choice and run the the app.py file. This triggers the the necessary transform functions and loads a formatted version of the formatted CSV into the formatted file folder.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant