etl

This ETL (Extract, Transform, Load) aims to generate data that can be loaded directly to a Flask application.

Data Extraction

• requests - extracting raw data over http
• json
• urllib3 - http client for python
• certifi
- this will generate/ validate the trustworthiness of certificates

Data Transformation

• pandas - for various data cleaning, transformation and aggregation processes
• re - python regex library for string cleaning

Data Load

• Flask - this will act as a backend for the visualization data
• json - will aid the loaded data frometl to flask application