Register Transformer DK is a data transformer for the OpenOwnership Register project. It processes bulk data published to AWS S3, such as emitted from AWS Kinesis Data Firehose, converts them into the Beneficial Ownership Data Standard (BODS) format, and stores records in Elasticsearch. Optionally, it can also use AWS Kinesis for processing streamed data (rather than bulk data published to AWS S3), or for publishing newly-transformed records to a different stream.
The transformation schema is BODS 0.2.
Install and boot Register.
Configure your environment using the example file:
cp .env.example .envCreate the Elasticsearch indexes:
docker compose run transformer-dk create-indexesRun the tests:
docker compose run transformer-dk testTo transform the bulk data from a prefix in AWS S3:
docker compose run transformer-dk transform-bulk raw_data/source=DK/year=2023/month=10/