infc-processing

Scripts to produce standardized JSON files from several data sources.

Generator

1. Manually complete generator/variablemap.csv.
2. Run json generator script to create JSONs for all data sources (outputs one for each).

Processor

1. Place data files under appropriate processing/input/region/municipality/.
   • region folder is labelled "00-PP" where 00 is the 2-digit Standard Geographical Code code and PP is the 2-letter Alpha code. For more information see Table D.
   • municipality subfolder is named in title case with no spaces between text.
2. Run json processing script to create GeoJSON output files for each source (separated into biking/, walking/, and multi-use/ folders) with:
   • standardized field names
   • columns not mentioned in schema dropped
   • data filtered according to filter keys and values
   • fixed source_url, licence, municipality, prov/terr, provider, class fields appended

Usage

> python jsongenerator.py
> python jsonprocessor.py ../generator/json/filename.json

To process all data sources at once...

> ./run_all.sh