#Pipo - Pit Importer Part One
Web application to create valid ndjson files to upload to the Histograph Core. Histograph is a historical geocoder for search and standardization of place names throughout history, more on histograph.io.
-
git clone this repository to a directory
-
In a terminal: move into your directory
-
Download Composer
curl -sS https://getcomposer.org/installer | php
-
And run
php composer.phar install
-
Create a database based on the file:
sql/pipo.sql
-
Rename the
./app/config/parameters.php.dist
to parameters.php and change the configuration settings for db, email etc. according to your setup -
Create a virtual host or point your browser to the location you set up for this site. You'll need a rewrite rule for the app to work, as described here: http://silex.sensiolabs.org/doc/web_servers.html
-
Composers post install script should have created the following dirs and made them writeable for the web server: app/storage/cache, app/storage/log, app/storage/uploads If the last step failed do this manually:
sudo chmod 777 app/storage/cache app/storage/log app/storage/uploads
-
On going to production; change the run mode in
/web/index.php
to use the http_cache
De data importer vervangt de custom scripts die nu voor elke dataset gemaakt worden om csv naar ndjson om te zetten. Elk teamlid moet dit proces in het vervolg eenvoudig kunnen doorlopen.
- upload csv
- map velden naar ontologie histograph
- valideer data waar nodig (datums, geojson)
- beschrijf de bron (naam, url, licentie, beschrijving, bewerkingen, etc)
- sla alle mappings en bronbeschrijving op in database
- opslaan data zelf in database niet nodig
- exporteer ndjson files voor pits, relaties en bron