Dynamically set Glue job script column mappings on terraform apply
The signatures_job.py
script is now generated with the column mappings between CSV files and Redshift based on the signatures
table schema as returned by the /api/bulk_data/schema.json
API endpoint.
This should make it easier to update the script whenever there are schema changes in the signatures
table, just by running terraform apply
.