Releases: tubular/sparkly
Releases · tubular/sparkly
v2.3.0
- Overwrite existing tables in the metastore.
- Add functions module and provide switch_case column generation and multijoin.
- Add implicit test target import and extended assertEqual variation.
- Support writing to redis:// and rediss:// URLs.
- Add LRU cache that persists DataFrames under the hood.
- Add ability to check whether a complex type defines specific fields.
v2.2.1
v2.2.0
- Add instant iterative development mode.
sparkly-testing --help
for more details. - Use in-memory db for Hive Metastore in
SparklyTest
(faster tests). spark.sql.shuffle.partitions = 4
forSparklyTest
(faster tests).spark.sql.warehouse.dir = <random tmp dir>
forSparklyTest
(no side effects)
v2.1.1
- Fix: remove backtick quoting from catalog utils to ease work with different databases.