This Repo holds information about various Azure data engineering project
Project Name: Olympic Data Analytics | Azure End-To-End Data Engineering Project
1.Architecture Diagram: https://github.com/vinaykm5758/Azure_Data_Engineering_Project/blob/main/Azure_Olympic_Data_Tranformation_Architecture_Diagram.PNG 2.Data Factory CI/CD Branch: https://github.com/vinaykm5758/Azure_Data_Engineering_Project/tree/azure-tokyo-olympic-datafactory-pipeline 3.Databricks Pyspark Code: https://github.com/vinaykm5758/Azure_Data_Engineering_Project/blob/main/V_Databricks_TokyoOlympic_Pyspark_Transformation.ipynb 4.Synapse Analytics CI/CD Branch: https://github.com/vinaykm5758/Azure_Data_Engineering_Project/tree/azure-synapse-analytics-workspace 5.Sample Synapse SQL Queries: https://github.com/vinaykm5758/Azure_Data_Engineering_Project/blob/main/azure_synapse_analytics_tables_SQL_queries.txt 6.Sample Visualizations/Charts: https://github.com/vinaykm5758/Azure_Data_Engineering_Project/blob/main/Average_Male_Female_by_Discipline.jpeg 7.Programming Languages Used:
- Python
- Pyspark
- SQL