v0.48.0

Changelog

• Support multiple AWS regions for underlying buckets (#2245, #2325, #2326)
• Make S3 Gateway DNS settings optional
• Fix lakectl upload fails on big uploads (#2280)
• Fix blank screen bug in UI (#1908)
• Actions secrets support with env vars (#2333)
• Reduce the number of database connections used on startup
• Validate required configuration keys blockstore.type, auth.encrypt.secret_key. This breaks existing configurations that assume a default blockstore.type of "local". But no such configuration may be for production.
• Fix incorrect time logged on DB get operations (#2341) thanks @holajiawei
• API with an unknown path should return an error (#2190) thanks @DataDavD
• Retry DB connection on Migration (#2017)

v0.47.0

Changelog

• Hooks: support triggering Airflow DAGs (#2266)
• Metastore tool: fix --continue-on-error flag on copy and import (#2267)
• API: Return gone response (410) in case physical data was removed (#2264)

v0.46.0

Note

This release requires running database migration.
The lakeFS service will not run if the migration version isn't compatible with the binary.
Before running the new version you will require to run migrate, with the new version:

$ lakefs migrate up

Changelog

• [Feature] Support post-merge and post-commit events
• [Feature] UI - add garbage collection policy configuration
• [Bugfix] Fix LakeFS startup with Azure storage type
• [Feature] Metastore tool - add flag to support DBFS location
• [Feature] Metastore tool - handle Spark placeholder on copy
• [Feature] Metastore tool - add import-all command
• [Feature] Deployment of lakeFS (docker-compose) with: MinIO, Hive metastore, Hive server, Trino and Spark
• [Bugfix] Python client: upload now works with most BaseIO types, not just FIle.

v0.45.0

Changelog

This release requires running database migration.
The lakeFS service will not run if the migration version isn't compatible with the binary.
Before running the new version you will require to run migrate, with the new version:

$ lakefs migrate up

Bugfixes

8288f4f Fix Authentication migration for garbage collection.

v0.44.1

Changelog

1a93ef5 Changelog (#2194)
efb8af6 Docs: Better roadmap structure (#2179)
80405c0 GC combine to one command and handle deduplications (#2196)
e9d302b Release Metadata Client (#2193)
bf2ef64 Update branching-model.md (#2208)
8288f4f auto policies setup fix (#2195)
1dd4f18 document how to disable multi-cluster writes (#2207)
be902b2 hadoop-lakefs without dedicated s3 client (#2198)
9ceed49 ui: getting started guides (#2109)
febc95e update docs swagger
56025a1 url parse and resolve split (#2178)

v0.44.0

Changelog

Garbage Collection! Set retention rules for deleted objects. See issue: #1932

v0.43.0

Note

This release requires running database migration.
The lakeFS service will not run if the migration version isn't compatible with the binary.
Before running the new version you will require to run migrate, with the new version:

$ lakefs migrate up

Changelog

• Server-side support for the upcoming garbage collection functionality (#2069)
• Add lakeFS version to the UI (#2088)
• Update lakectl branch create output to include branch name (#2130)
• Warn about using "local" adapter for use in production (#2159)
• Explicit handling of mismatch in block store config and repository namespace according to a user setting (#2126)
• Initial database connect retry (#2131)
• Web UI Vite build tool upgrade to v2.3.7 (#2108)

Bugfixes

• Fix lakectl read environment variables in absence of lakectl.yml config file, this bugfix unlocks the Kubeflow-lakeFS integration (#2143)
• Add UI error reporting on action failure during a commit (#2120)
• Reset the state of the delete repository dialog when it is dismissed (#2117)

v0.42.0

Changelog

Features

• Support common prefix listing of diffs (uncommitted, commit view, compare view) (#2051)
• Export using spark-submit (#2036)

Bugfixes

• Make authorization errors readable in the UI (#2056)
• Verify paths used in the local block adapter are under its base dir (#2003)
• Fix dump refs JSON output (#2040)
• Fix adapter qualified key format to not use path.Join (#1994)

Breaking Changes

• Object listing API: previously, not specifying a delimiter would default to using "/". The default is now "" (empty string)
• The /config API endpoint that returns storage configuration (used mainly in lakeFS UI), is now under /config/storage
• Accessing the /config/storage endpoint now requires the fs:ReadConfig permission instead of auth:ReadConfig

v0.41.1

Changelog

36eb6ae Bugfix/parquet inventory failure (#1979)
4c9b404 Filesystem: non-atomic files rename (#1972)
37a52ce Fix unexpected merge conflicts bug (#1958)
13de272 Short timeout on fetch AWS account ID (#1987)
2a55322 Support Spark SQL tables in metastore copy (#1997)
4589933 gateway on get without version should return after error (#1990)
7307f5a hadoopfs listFiles (#1922)
7226588 lakectl control logging (#1954)
931be4a lakectl log copy and update metastore operation information (#1986)
4bfead3 use a worker pool to ingest entries faster (#1964)

v0.41.0

Changelog

2e2e005 ingest cmd Importing data from an object store without actually copying it (#1864)
851f02a Don't upload chunks smaller than 8192 bytes while streaming (#1885)
1a81228 Fix multipart upload failure in Azure (#1896)
9ebab7a Fix broken Clipboard copy button (#1904)
984cc68 lakeFS filesystem add "create" method (#1907)
5996edf lakeFS filesystem add "open" method (#1895)
7c22cd5 Add Java OpenAPI client up-to-date validation (#1870)
4ea6571 Add conflict response and use it when creating an existing resource (#1900)
0fad6a9 Use React with Vite (#1874)
ad188b6 Implement lakefsFS delete method (#1920)
ca96271 Mark operations unsupported by LakeFS filesystem (#1881)
f592298 Publish Java API client to Sonatype repository (#1869)
be53f58 Remove unsupported reset-to-commit option (#1946)