Code

explore NTD non-revenue vehicles#1355

Code

Merged

csuyat-dot merged 24 commits intomaincal-itp/data-analyses:mainfrom non_rev_vhccal-itp/data-analyses:non_rev_vhcCopy head branch name to clipboardJan 21, 2025

+3,953

Commits

Commits on Jan 2, 2025

• start notebook

  csuyat-dot

  committed
  838e2c6

  Copy full SHA for 838e2c6

Commits on Jan 3, 2025

• fetching data from api, trying to access the elements in the JSON response, but struggling with hitting the different list and dictionaires

  csuyat-dot

  committed
  04cdc2d

  Copy full SHA for 04cdc2d

• exploring JSON of blackcat api to scrape a35 data. was able to get a list of org name and a35 entries

  csuyat-dot

  committed
  73c3ef9

  Copy full SHA for 73c3ef9

Commits on Jan 4, 2025

• more explore work

  csuyat-dot

  committed
  b1576dd

  Copy full SHA for b1576dd

Commits on Jan 6, 2025

• testing using pd.json_normalize() to turn JSON into dataframe

  csuyat-dot

  committed
  39fb2e2

  Copy full SHA for 39fb2e2

• comparing results from .json_normalize() and list comprehension method

  csuyat-dot

  committed
  9daf550

  Copy full SHA for 9daf550

• test querying fct_vehicles_type_count_by_agency since it has service and revenue veh

  csuyat-dot

  committed
  bfc4e3f

  Copy full SHA for bfc4e3f

• test mering the fct_vehilces_type_count_by_agency and fct_metrics

  csuyat-dot

  committed
  ba7e4e1

  Copy full SHA for ba7e4e1

Commits on Jan 7, 2025

• test comparing upt against nrv count

  csuyat-dot

  committed
  339503a

  Copy full SHA for 339503a

• testing out removing outlier and plotting a regression chart, just for fun

  csuyat-dot

  committed
  282d3a8

  Copy full SHA for 282d3a8

Commits on Jan 8, 2025

• trying to read in service hours from digest, but need schedule names. so copy/pasting code from proposed changes to get schedule name > org name > ntd id crosswalk

  csuyat-dot

  committed
  5e770d8

  Copy full SHA for 5e770d8

• moving some things around, trying to aggregate gtfs service hours by schedule name. also trying to setup VRH columns to analyze

  csuyat-dot

  committed
  63c50bb

  Copy full SHA for 63c50bb

Commits on Jan 9, 2025

• attempt to crosswalk between ntd ID to schedule

  csuyat-dot

  committed
  66f0339

  Copy full SHA for 66f0339

Commits on Jan 10, 2025

• cleaned up some cells, cleaned up outlier identification and scatterplot

  csuyat-dot

  committed
  a0ef631

  Copy full SHA for a0ef631

• testing ratios for service veh:upt & veh:vrh

  csuyat-dot

  committed
  3bbe6d0

  Copy full SHA for 3bbe6d0

• found there are a lot of agencies with zero service vehicles, testing to see what it looks like when these are removed

  csuyat-dot

  committed
  2875ba5

  Copy full SHA for 2875ba5

Commits on Jan 13, 2025

• spoke with Evan, he showed me some NTD data products for rev and service vehicles to use

  csuyat-dot

  committed
  c8a8440

  Copy full SHA for c8a8440

• cleaning some of the NTD products, need to filter by CA

  csuyat-dot

  committed
  a5cffca

  Copy full SHA for a5cffca

Commits on Jan 14, 2025

• using CA ntd ID, upt, vrm, vrh from dim_annual_agency_information

  csuyat-dot

  committed
  7edaa80

  Copy full SHA for 7edaa80

• minor changes

  csuyat-dot

  committed
  3d5c084

  Copy full SHA for 3d5c084

Commits on Jan 18, 2025

• removed old work about fetching the blackcat api and .mart_ntd_annual_annual_reporting tables. exploring more about the service vehicles ntd data

  csuyat-dot

  committed
  c7b8136

  Copy full SHA for c7b8136

Commits on Jan 21, 2025

• minor cleaning, peaking into the serv veh inv data to see what kind of vehicles it mentions

  csuyat-dot

  committed
  91836f1

  Copy full SHA for 91836f1

• minor changes

  csuyat-dot

  committed
  6f9d505

  Copy full SHA for 6f9d505

• major cleanup, got rid of old tables, updated variable name. will pick up again later

  csuyat-dot

  committed
  3681fa4

  Copy full SHA for 3681fa4