BFI - IIIF Load Balancer

Introduction

This project introduces a load balancer appliance for use with BFI's IIIF services.

The project is built using GitHub Actions, and the produced containers are persisted in GitHub Container Registry.

Getting Started

Repository Layout

The repository is split into the following components:

• Dockerfile and docker/
  • Using the NGINX Proxy Manager as the base image, this Dockerfile introduces a number of small but significant customisations.
  • Specifically, it provides an NGINX configuration file(server_proxy.conf) which introduces BFI's IIIF root certificate authority (used for backend SSL validation), and an entrypoint script (entrypoint.sh) which moves both this NGINX configuration file, and the root CA (provided separately), into the correct places on the running containers mounted data volume.
• ssl
  • Contains all SSL / TLS related assets, including:
    • BFI's IIIF root certificate authority, certificate and serial file.
    • Certificate signing requests, keys and certificates for backend services for which the load balancer proxies requests.
• deploy
  • Contains the folder structure and configuration files required to deploy the load balancer. Specifically:
    • /etc/opt/bfi/iiif-load-balancer: contains configuration files and assets used by the load balancer.
    • /etc/systemd/system/iiif-load-balancer.service: the systemd unit used for starting and stopping the underlying NGINX Proxy Manager instance.
    • /opt/bfi/iiif-load-balancer: the Docker Compose manifest, defining the load balancer application, dependencies and relationships therein.
    • /var/opt/bfi/iiif-load-balancer/mounts: directory where the various mounted volumes used by the containers are located.

Secrets Management

All secrets checked in as part of the repository have been encrypted using git-secret.io. This includes the contents of the ssl directory, which contains various SSL / TLS related certificates and keys.

Existing users who already exist in the keyring can decrypt secrets with the following command:

git secret reveal

To decrypt secrets, you must first be added to the keyring by an existing user (assuming a key for [email protected] already exists in your local GPG keyring):

git secret reveal
git secret tell [email protected]
git secret hide

New secrets can be added with the following commands:

git secret add path/to/my/secret.txt
git secret hide

Building

The Dockerfile can be built by executing:

docker build -t bfi-iiif-load-balancer .

Local Development

A Docker Component manifest docker-compose.dev.yml is provided for facilitate local development.

This manifest requires that the secret ssl/bfi-iiif-root-ca.crt is available (i.e. has been decrypted), as it is made available to the running container as a Docker Compose secret.

git secret reveal
docker-compose -f docker-compose.dev.yml up --remove-orphans

The manifest additionally deploys two instances of karthequian/helloworld, which can be used as test proxy targets.

Deployment

Prerequisites

The application requires Docker and Docker Compose. It is recommended that these are installed from the official Docker repositories:

• https://docs.docker.com/engine/install/
• https://docs.docker.com/compose/install/

The application deployment should mirror the contents of the deploy/ directory. Start by creating the necessary directories:

Deploy Configuration

sudo -i
mkdir -p /etc/opt/bfi/iiif-load-balancer/secrets
mkdir -p /etc/opt/bfi/iiif-load-balancer/ssl
mkdir -p /opt/bfi/iiif-load-balancer
mkdir -p /var/opt/bfi/iiif-load-balancer/mounts
chmod 775 /var/opt/bfi/iiif-load-balancer/mounts

Create the MySQL database passwords:

cat /dev/urandom | tr -dc '_A-Z-a-z-0-9' | head -c${1:-32} > /etc/opt/bfi/iiif-load-balancer/secrets/mysql_password
cat /dev/urandom | tr -dc '_A-Z-a-z-0-9' | head -c${1:-32} > /etc/opt/bfi/iiif-load-balancer/secrets/mysql_root_password

Deploy BFI's IIIF root certificate authority:

cp bfi-iiif-root-ca.crt /etc/opt/bfi/iiif-load-balancer/ssl

Update /etc/opt/bfi/iiif-load-balancer/config.env to use the desired image tags:

LOAD_BALANCER_IMAGE_TAG=1.0.0
MYSQL_IMAGE_TAG=5.7.33

Add the Docker Compose manfiest:

cp docker-compose.yml /opt/bfi/iiif-load-balancer

Add the systemd unit:

cp iiif-load-balancer.service /etc/systemd/system

Start Load Balancer

Enable the systemd unit to start at boot:

systemctl enable iiif-load-balancer

Start the load balancer:

systemctl start iiif-load-balancer

The NGINX Proxy Manager instance can now be accessed on port 81.

Contributors

Versioning

We use SemVer for versioning. For the versions available, see the tags on this repository.

License

This project is licensed under the MIT license - see the LICENSE file for details