GitHub - edi-rose/carbon_tracking: tracking the various prices of the nz ETS

edi-rose / carbon_tracking Public

Notifications You must be signed in to change notification settings
Fork 0
Star 1

tracking the various prices of the nz ETS - front end only

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 32 Commits
api		api
.gitignore		.gitignore
calculations.py		calculations.py
data_helpers.py		data_helpers.py
db_connect.py		db_connect.py
geckodriver.log		geckodriver.log
historical_auctions.py		historical_auctions.py
historical_carbon_prices.csv		historical_carbon_prices.csv
historical_carbon_prices.py		historical_carbon_prices.py
historical_nzx.py		historical_nzx.py
historical_salt_prices.py		historical_salt_prices.py
main.py		main.py
nohup.out		nohup.out
readme.txt		readme.txt
reporting.py		reporting.py

Repository files navigation

This project tracks and analyses the New Zealand Carbon Market. 

Referenced in Carbon News: https://www.carbonnews.co.nz/story.asp?storyID=28838&fbclid=IwAR3l9Sw3wd9WjaeRYV5DFKCgCfC43xfwzrkFij3YDrWx8rQUmTYhYLfcttI

The file db_connect.py makes calls to a mySQL database which is not available to the public. 
In theory any one could pull my work and start scraping prices and storing them in their own DB. 
The getters.py file uses selenium to webscrape the following: 
    - Carbon Spot Price (https://www.carbonnews.co.nz (daily) and https://www.commtrade.co.nz/ (high frequency *broken))
    - Salt Share Price (https://www.nzx.com/instruments/CO2)
    - Carbon Auction Announcements (https://www.etsauctions.govt.nz/public/auction_noticeboard)

The Carbon and Salt scrapers can only get current prices. So for all the data before I started scraping we 
needed another source. 

Salt is quite easy. Sharesies prints the daily price for all their records in their network tab.
Carbon has been manually scraped by github user theecanmole and his data is publicly available here: https://github.com/theecanmole/nzu
theecanmole if you're reading this please get in touch, I'd love to buy you a beer. 

reporting.py holds the function which create the graphs I've made so far.