Skip to content

Data Warehouse tech stack using Postgres database, dbt, Airflow, Redash and Docker.

License

Notifications You must be signed in to change notification settings

KaydeeJR/traffic-dwh-tech-stack

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

10 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Data warehouse tech stack for city traffic data 👋

The pNeuma dataset was used for this project. The data was generated by drones that recorded trajectory information for different vehicles. This information was then saved in CSV files that are available for download from Downloads - pNeuma. More information about the pNeuma experiment can be found at About - pNeuma.

Project Structure

traffic-dwh-tech-stack
├─ .gitignore
├─ LICENSE
├─ README.md
├─ airflow-traffic
│  ├─ airflow.cfg
│  ├─ airflow.db
│  ├─ dags
│  │  └─ dag_tasks
│  │     ├─ create_tables.py
│  │     ├─ db_connect.py
│  │     └─ upload_to_db.py
│  ├─ docker-compose.yaml
│  ├─ plugins
│  ├─ postgresql
│  │  └─ db_schema.sql
│  └─ webserver_config.py
└─screenshots
   ├─ airflow-screenshot1.png
   ├─ airflow-screenshot2.png
   ├─ airflow-screenshot3.png
   └─ airflow-screenshot4.png

Author

👤 Janerose Nyambura Njogu

About

Data Warehouse tech stack using Postgres database, dbt, Airflow, Redash and Docker.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages