LAMP is a collection of applications used to measure performance of the MBTA transit system.
LAMP application architecture is managed and described using Terraform
in the MBTA Devops github repository.
Link to Miro Diagram
LAMP uses asdf to mange runtime versions using the command line. Once installed, run the following in the root project directory:
# add project plugins
asdf plugin-add python
asdf plugin-add direnv
asdf plugin-add poetry
# install versions of plugins specified in .tool-versions
asdf install
poetry
is used by LAMP python applications to manage dependencies.
docker
and docker-compose
are required to run containerized versions of LAMP applications for local development.
LAMP applications require permissions to access MBTA/CTD AWS resources.
To get started with AWS, install the AWS Command Line Interface. Then, follow the instructions for configuring the AWS cli to associate a local machine with an AWS account. Finally, associate the AWS Account with the Lamp Team User Group found in the MBTA devops terraform repository.
The LAMP ingestion application has a Microsoft SQL Server datasource. To query the Microsoft SQL Server, on Linux, two pre-requisites are required.
- Install the Mirosoft ODBC 18 driver for SQL Server.
- Configure
openssl
to allow TLS V1.0 connections.
Project environmental variables are stored in .env and managed for command line usage with direnv
.
Using direnv
, whenever a shell moves into any project directory, the environmental variables defined in .env are loaded automagically.
Additionally, docker-compose.yml is configured to use .env, so that running containerized applications will load the same environmental variables.
To ensure code quality, linting, type checking, static analysis and unit tests are automatically run via github actions when pull requests are opened.
CI for LAMP python applications can be run locally, in the root project directory, with the following poetry
commands:
# black for Formatting
poetry run black .
# mypy for Type Checking
poetry run mypy .
# pylint for Static Analysis
poetry run pylint src tests
# pytest for Unit Tests
poetry run pytest
Images for LAMP applications are hosted by AWS on the Elastic Container Registry (ECR). Updates to application images are pushed to ECR via automated github actions.
LAMP applications are hosted by AWS and run on Elastic Container Service (ECS) instances. Deployment of LAMP applications, to ECS instances, occur via automated github actions.
LAMP uses docker
and docker-compose
to run local instances of applications for development purposes. Please refer to the README
page of invidiual applications for instructions.
This repository contains all LAMP source code used to run, test and deploy LAMP applications.
Source code for LAMP python applications can be found in the src/ directory.