Skip to content

Releases: samtecspg/mason

1.6.6

30 Apr 14:44
5c12a49
Compare
Choose a tag to compare
  • Fix up issues in docker file, make base image match gh actions (ubuntu)
  • Add asynchronous execution for operators
  • Add database list
  • Add local metastore client
  • Clean up spark execution engine
  • Add table summary job (spark, local)

1.6.0

01 Sep 18:05
Compare
Choose a tag to compare

1.6.0 Format Operator and Dask

(1) Finishing out dask implementation
(2) Adding format implementation for dask. mason operator table format
(3) Cleaning up some concepts in schemas
(4) Added local execution client (WIP)

1.5.2

14 Aug 04:00
Compare
Choose a tag to compare
  1. Several hotfixes
  2. Starting to add airflow client implementation code
  3. Allowing schedule (cron currently) to be passed through to glue client implementation.

1.5.0

23 Jun 13:35
Compare
Choose a tag to compare
  • Reworking imports to improve performance of cli commands
  • Added NotebookEnvironment which makes mason more friendly to run in python notebooks.
  • Added LocalClient and LocalSchedulerClient (synchronous scheduler for local run)
  • Finished wiring up workflow "step" definitions.
  • Added validated_infer to examples, 5 step workflow that cleans up if table is not queryable
  • Added OperatorDefinition and WorkflowDefinition to enforce that operators and workflows are defined correctly at a type/signature level.
  • Changed register cli command to accept operators and workflows, removed register code from workflow endpoint

v1.03

29 Apr 18:44
Compare
Choose a tag to compare
  • Significant improvements to testing frameworks and mock implementations
  • Add table query operator with Athena execution support
  • Add job get Athena client execution support
  • Add table delete operator with glue metastore support
  • Add schedule delete operator with glue scheduler support
  • Add demo script for 1.03: https://github.com/samtecspg/mason/blob/v1.03/demos/1.03.sh

v1.02

21 Apr 04:39
Compare
Choose a tag to compare

Version 1.02

  1. Adding CSV, JSON and JSONL support to s3 metastore
  2. Adding CSV, JSON and JSONL support to merge operator
  3. Added interactive demo scripts

v1.01

20 Apr 12:32
Compare
Choose a tag to compare
v1.01 Pre-release
Pre-release

First official release number

  • Glue metastore
  • Glue scheduler
  • S3 metastore
  • Spark Execution Engine