Home
Week 1 - Six weeks to go
1. Discussed an initial model for the project, We still dont know what is flask and what it can provide so that needs to be addressed
2.Decided to set up a common environment which will be pycharm
3.Made github pro for pvt repo
4.Learn Scrum
5.IN 2 DAYS WE PLAN ON MAKING A GITHUB PAGE WHICH OUTPUTS INFORMATION FROM JDCAUX
6.NEXT MEETUP ON THURSDAY
Date:13 February 2020
Sprint: 1
Scrum Master : Sachin Soman
- Talked with product owner Giovanni
- Set up trello scrum board
- Got API key for JCD and Open weather
- Made Scrapper for Weather
- Made Scrapper for JCD
- Freddie made an RDS server
2. Run Scrappers in EC2
3. Initialize and run RDS
Week 2 - five weeks to go
Scrum Master : Sachin Soman
1. Made scrappers both weather and JDx
2. Made schema
3. RDS updated with scrappper
4. Basic front end developed
Week 3 - four weeks to go
Sprint: sprint 2
Scrum Master : Yingjie Niu
1. Tried to run scrapper on EC2 instance continuously
2. Created 2 schema for weather info and station info separetely
3. Connect RDS with EC2
4. Created schema on RDS
5. Created a Github repository and began to share member's work so far
6. Added the Google Map API into the front page, but it can't work yet
1. Tried to use a while(true) loop to run scrapper on EC2 and failed
2. Figure out how to make the Google Map API work, like apply an API key
1. Use crontab to schedule tasks on EC2
2. Combine station scrapper and weather scrapper together
3. Host the front page on EC2.
4. Learn Flask.
Week 4 - three weeks to go
Sprint: sprint 2
Scrum Master : Yingjie Niu
1. Managed to use crontab and scrapper is running on EC2 continuously now and it will run for at least 2 weeks
2. Bike station data is downloading to the DB on RDS every 5 minutes
3. Got an Google Map API key and google map API is working
4. Hosted the front page with EC2, and the URL is:http://ec2-3-80-6-206.compute-1.amazonaws.com/dublin_bikes_website/
5. Everyone learned Flask and got a basic understand of it
1. The website on EC2 is the old version without google map API
1. Make the website on EC2 up to date
2. Combine station scrapper and weather scrapper together
3. Except for the scrapper for downloading, we need another one for accessing realtime data
4. Write Flask script to build communication between DB and front page.
Break week - three weeks to go
Sprint: sprint 2
Scrum Master : Yingjie Niu
1. Uploaded the latest version front page on EC2
2. Created a realtime data scrapper by combining and modifying the bike station scrapper and weather scrapper
3. Created another schema to save and update realtime data, and this is for showing realtime data on the front page
4. Finished a basic Flask script that can catch realtime data from DB and show it on the front page
5. Managed to show the info for each station when the user clicked the marker on the map.
6. The new URL is: http://ec2-3-80-6-206.compute-1.amazonaws.com:5000
7. Finished the task for Sprint 2
1. Some blocks of the front page are not used at all. Need a better design
1. Design a better front page
2. Learn ML models
Two weeks to go
Sprint: sprint 3
Scrum Master : HaoBo Liu
1. Learnt about machine learning
2. Data combination and analysis
3. Discussed which ML model to use
4. Discussed and Decided on the design for the last prediction part
1. Visualize weather data with charts on the front page
2. Embed ML model into flask
3. Update the front page with functions related to prediction
4. Request weather forecast information from openweather: https://openweathermap.org/forecast5
5. Display predication information on the front page
One week to go
Sprint: sprint 3
Scrum Master : HaoBo Liu
1. Data visualization: daily data
2. Front page upgraded
3. Make ML model work with weather forecast info
1. Visualization hourly data
2. Design additional features
3. Optimize the ML model and clean up the code
-
Prediction Numbers
-
Daily Data
Down the stretch
Sprint: sprint 4
Scrum Master : HaoBo Liu
1. Additional features
1. Make sure all parts work well on ec2
2. Finish report