title	author	date
CSV Data Ingester for The Best 50 Years in Gaming site	Steven Ng	2025-03-18

Ingesting CSV for The Best 50 Years in Gaming site to SolrCloud

System Requirements

Requires Ruby 3.3.0+

This Blacklight instance requires SolrCloud. A local version of SolrCloud may be run by using the TULibraries Ansible SolrCloud Playbook: https://github.com/tulibraries/ansible-playbook-solrcloud

Getting started

Install

Install the gem dependencies (generally we do this in an rvm gemset)

bundle install

Create the application file

cp .env.example .env

and edit the .env content's SOLR_URL enviornment variable.

Configure for Solr

Configure dotenv to use SolrWrapper

cp .env.example .env

Ensure .env contains

SOLR_URL="http://localhost:8090/solr/gencon50-1.0.0"

Start up SolrCloud

cd ../ansible-playbook-solrcloud
make up-lite
cd ../gencon50

Ingest some data

To seed the database with a csv file form the command line ,use the following command. Replace path/to/datafile.csv with the path to the file to upload.

bin/csv2solr harvest path/to/datafile.csv --mapfile=solr_map.yml