README.md

DevOps Reference

Changelog | Contributing

This repository contains different infrastructure components, CI/CD pipelines, automation tools among other resources that are used in different projects here at NaN Labs.

Contents

• Applications

• Examples

  • DevOps
    • A/B Testing
    • Shell Scripting and CLI Tools
    • Continuous Integration, Delivery and Deployment
    • Containers, Orchestration and Serverless
      • Containers and Compositions (Docker, Docker Compose, Buildpacks and more)
      • DevContainers and Codespaces
      • Kubernetes
    • Infrastructure as Code
      • AWS Amplify
      • Serverless Framework, SAM and CloudFormation
      • Terraform

• Contributing

• Contributors

Applications

• Complete AWS Glue ETL - A complete example of an AWS Glue application that uses the Serverless Framework to deploy the infrastructure and DevContainers and/or Docker Compose to run the application locally with AWS Glue Libs, Spark, Jupyter Notebook, AWS CLI, among other tools. It provides jobs using Python Shell and PySpark. Keywords: Python, AWS, Glue, ETL, Serverless, DevContainers, Docker Compose

Examples

DevOps

A/B Testing

• AWS CloudWatch Evidently - A complete analysis of the service and a Proof of Concept on how to integrate it with a Node.js application. Keywords: Node.js, AWS, CloudWatch, CloudWatch Evidently, A/B Testing, Feature Flags
• Feature flags post - How to progressively expose your features with feature flags by IAN BUCHANNAN. Keywords: Feature Flags

Shell Scripting and CLI Tools

• Bash as a Wrapper Utility - Bash as a wrapper utility for other languages and tools. Keywords: Shell Scripting, Utilities
• Bash as a Wrapper Utility with Easy Options - Bash as a wrapper utility for other languages and tools using Easy Options. Keywords: Shell Scripting, Utilities, Easy Options
• Easy Options - Easy options for shell scripts. Keywords: Shell Scripting, Utilities, Easy Options
• When to use shell - A guide from Google on when to use shell scripts. Keywords: Shell Scripting, Utilities

Continuous Integration, Delivery and Deployment

• Actionlint Playground - Static checker for GitHub Actions workflow files. Keywords: GitHub Actions, Actionlint
• Automate Pull Requests Reviews using Danger - This workflow automates the initial review of Pull Requests using Danger.js. This provides another logical step in your build, through this Danger can help lint your rote tasks in daily code review. You can use Danger to codify your teams norms. Leaving humans to think about harder problems. Keywords: GitHub Actions, Danger.js
• Automation Seed example - Different workflows to validate the code and deploy an automation report page. Keywords: GitHub Actions, Automation
• Markdown Lint - This workflow validates the Markdown files in the repository using the markdownlint action. Keywords: GitHub Actions, Markdown Lint
• React Boilerplate - Different workflows to validate the code and deploy a React application. Keywords: GitHub Actions, React
• Shell Check - This workflow validates the shell scripts in the repository using the shellcheck action. Keywords: GitHub Actions, Shell Check
• Terraform Check - This workflow validates the Terraform files in the repository using the terraform action. Keywords: GitHub Actions, Terraform
• Todo to Issue - This workflow scans new commits on the main branch looking for TODOs in the code and creates new GitHub issues. Keywords: GitHub Actions, Todo

Containers, Orchestration and Serverless

Containers and Compositions (Docker, Docker Compose, Buildpacks and more)

• Airflow and Spark environment using Docker and Docker Compose - Dockerfile and compose.yml to run Airflow locally with initialization scripts. Keywords: Docker, Docker Compose, Airflow, Spark
• AWS Cognito local using Docker Compose - compose.yml to run Cognito locally. Keywords: Docker, Docker Compose, Cognito, AWS
• AWS Glue using Docker and Docker Compose - Dockerfile and compose.yml for AWS Glue development with AWS Glue Libs, Spark, Jupyter Notebook, AWS CLI among other tools. Keywords: Docker, Docker Compose, AWS Glue, Spark, Jupyter Notebook, AWS CLI
• AWS Neptune using Docker and Docker Compose - Dockerfile and compose.yml to run AWS Neptune locally with initialization scripts. Keywords: Docker, Docker Compose, AWS Neptune
• Localstack using Docker and Docker Compose - Dockerfile and compose.yml to run Localstack locally with all the necessary services. This example also includes a script to create the necessary resources in Localstack. The provided examples are for DynamoDB, S3, SQS and Kinesis. Keywords: Docker, Docker Compose, Localstack, DynamoDB, S3, SQS, Kinesis
• Microsoft SQL Server using Docker and Docker Compose - Dockerfile and compose.yml to run Microsoft SQL Server locally with initialization scripts. Keywords: Docker, Docker Compose, Microsoft SQL Server
• MongoDB + Mongo Express using Docker and Docker Compose - Dockerfile and compose.yml to run MongoDB and Mongo Express locally with initialization scripts. Keywords: Docker, Docker Compose, MongoDB, Mongo Express
• PostgreSQL using Docker and Docker Compose - Dockerfile and compose.yml to run PostgreSQL locally with initialization scripts. Keywords: Docker, Docker Compose, PostgreSQL
• Python Buildpack - Buildpack example for Python applications. Keywords: Buildpack, Python

DevContainers and Codespaces

• AWS Glue - DevContainer for AWS Glue development. Uses docker-compose to run VSCode attached to a container with all the necessary tools to develop AWS Glue jobs such us AWS Glue Libs, Spark, Jupyter Notebook, AWS CLI among other tools. Keywords: Docker, Docker Compose, DevContainer, VSCode DevContainer, GitHub Codespaces, AWS Glue, Spark, Jupyter Notebook, AWS CLI
• Node.js - DevContainer for Node.js development. Uses docker-compose to run VSCode attached to a container with all the necessary tools to develop Node.js applications. Keywords: Docker, Docker Compose, DevContainer, VSCode DevContainer, GitHub Codespaces, Node.js

Kubernetes

• Ingress - Ingress example using NGINX Ingress Controller. You can run this example locally using Minikube. Keywords: Kubernetes, Ingress, NGINX Ingress Controller

Infrastructure as Code

AWS Amplify

• AWS Amplify + NextJS 13 - AWS Amplify example to deploy a NextJS v13 application to the Cloud. Keywords: AWS Amplify, NextJS, NextJS 13

Serverless Framework, SAM and CloudFormation

• AWS AppSync + Python - Serverless Framework example to deploy an AWS AppSync API using Python. It also has a local development environment using Serverless Offline. Keywords: Serverless Framework, AWS AppSync, Python
• AWS AppSync + TypeScript - Serverless Framework example to deploy an AWS AppSync API using TypeScript. It also has a local development environment using Serverless Offline. Keywords: Serverless Framework, AWS AppSync, TypeScript
• AWS Cognito Local Example - AWS Cognito local enviroment with Docker and Serverless offline Keywords: Serverless Framework, Serverless Offline, AWS, Cognito, Docker
• AWS Glue with Python Shell and PySpark Jobs - Serverless Framework example to deploy an AWS Glue job using Python Shell and PySpark. Keywords: Serverless Framework, AWS Glue, Python Shell, PySpark
• DocumentDB Cluster - Serverless Framework example to deploy a DocumentDB cluster with all the necessary resources. Keywords: Serverless Framework, DocumentDB
• Neo4j in EC2 - Serverless Framework example to deploy a Neo4j instance in EC2. Keywords: Serverless Framework, Neo4j, EC2
• RDS Postgres Instance - Serverless Framework example to deploy a RDS Postgres cluster with all the necessary resources. Keywords: Serverless Framework, RDS Postgres
• Serverless Middy - Serverless Framework example to deploy a lambda function using Middy, the stylish Node.js middleware engine for AWS Lambda. Keywords: Serverless Framework, Middy
• Serverless Middy with Custom Middleware - Serverless Framework example to deploy a lambda function using Middy, the stylish Node.js middleware engine for AWS Lambda. Keywords: Serverless Framework, Middy, Custom Middleware
• Serverless Nest Application with TypeScript - Serverless Framework example to deploy a NestJS application using TypeScript. Keywords: Serverless Framework, NestJS, TypeScript
• Serverless S3 Local - Serverless Framework example to run a lambda function locally using Serverless S3 Local. Keywords: Serverless Framework, Serverless S3 Local
• Serverless SQS offline + Python + Localstack Example - Serverless Framework example to run lambda functions locally using Serverless Offline SQS with Localstack. It provides a full local development environment using Serverless Offline. Keywords: Serverless Framework, SQS, Serverless Offline, Serverless Offline SQS, Localstack, Python
• Serverless SQS offline + TypeScript + ElasticMQ Example - Serverless Framework example to run lambda functions locally using Serverless Offline SQS with ElasticMQ. It provides a full local development environment using Serverless Offline. Keywords: Serverless Framework, SQS, Serverless Offline, Serverless Offline SQS, ElasticMQ
• Serverless Twilio + Typescript Lambda example - Serverless Framework example to deploy a lambda function using Twilio and TypeScript. Keywords: Serverless Framework, Serverless Offline, AWS, Twilio, TypeScript
• Start and Stop EC2 Instances with AWS Lambda - Serverless Framework example to start and stop EC2 instances using AWS Lambda. Keywords: Serverless Framework, EC2, AWS Lambda

Terraform

• Terraform AWS Minecraft Server - Terraform example to deploy a Minecraft server in AWS EC2 instance using Docker. Keywords: Terraform, AWS, Minecraft, Docker, EC2

Contributing

• Contributions make the open source community such an amazing place to learn, inspire, and create.
• Any contributions you make are truly appreciated.
• Check out our contribution guidelines for more information.

Contributors

Made with contributors-img.