Skip to content

Latest commit

 

History

History
59 lines (51 loc) · 1.95 KB

readme.md

File metadata and controls

59 lines (51 loc) · 1.95 KB
Raw

Collegiate Times Salaries

URL = http://www.collegiatetimes.com/test/salaries-database/html_d0a84430-cd43-11e6-b213-d72b8da397ba.html

The Python Script iterates through the first two dropdowns to get all the years for all the schools, and then iterates through all the results to get all the available salary data. It creates a CSV a series of CSVs that take the form of school_year.csv. For instance, virginia_tech_2016.csv, virginia_tech_2015.csv, etc. The CSV has 4 columns Name, Position, Department, Salary

Running the Script

pip install -r requirements.txt
python collegiateScraper.py

The final set of 7zipped CSVs includes data from following university--years:

  1. ASU 2008
  2. Christopher Newport University 2009--2011
  3. George Mason University 2007--2011
  4. Iowa State University 2008--2009
  5. James Madison University 2008
  6. Longwood University 2008--2011
  7. Miami University 2008
  8. Michigan State University 2009
  9. Ohio State 2008--2010
  10. Old Dominion 2008--2011
  11. Purdue 2008
  12. Radford 2008--2010
  13. Rutgers 2008--2010
  14. SUNY Buffalo 2008--2010
  15. SUNY Stony Brook 2008--2009
  16. Texas A & M 2008--2010
  17. Texas Southern 2008--2010
  18. Texas Tech. 2010
  19. UC, Berkeley 2008
  20. UC Davis 2008
  21. UC Irvine 2008
  22. UCLA 2008
  23. UC Merced 2008
  24. UC Riverside 2008
  25. UCSD 2008
  26. UCSF 2008
  27. UCSB 2008
  28. USSC 2008
  29. University of Florida 2009
  30. University of Illinois 2008--2009
  31. University of Mary Washington 2009
  32. University of Michigan, Ann Arbor 2002-2009
  33. University of Michigan, Dearborn 2002--2009
  34. University of Missouri, Columbia 2008--2009
  35. UNC Chapel Hill 2008, 2010
  36. University of Texas, Austin 2008--2010
  37. University of Virginia 2008--2010
  38. University of Wisconsin, Madison 2008--2009
  39. Virginia Military Institute 2009
  40. Virginia State University 2009--2010
  41. Virginia Tech. 2007--2016
  42. William and Mary 2009--2011