Skip to content

Commit

Permalink
[3.3] Add Documentation for Vacuum LITE (#3987)
Browse files Browse the repository at this point in the history
#### Which Delta project/connector is this regarding?

- [X] Spark
- [ ] Standalone
- [ ] Flink
- [ ] Kernel
- [ ] Other (fill in here)

## Description

Adds Documentation for Vacuum LITE
 


## How was this patch tested?
N/A

## Does this PR introduce _any_ user-facing changes?

NO
  • Loading branch information
rajeshparangi authored Dec 18, 2024
1 parent 8c18520 commit 2c210de
Showing 1 changed file with 8 additions and 2 deletions.
10 changes: 8 additions & 2 deletions docs/source/delta-utility.md
Original file line number Diff line number Diff line change
Expand Up @@ -31,7 +31,13 @@ default retention threshold for the files is 7 days. To change this behavior, se
.. lang:: sql

```sql
VACUUM eventsTable -- vacuum files not required by versions older than the default retention period

VACUUM eventsTable -- This runs VACUUM in ‘FULL’ mode and deletes data files outside of the retention duration and all files in the table directory not referenced by the table.

VACUUM eventsTable LITE -- This VACUUM in ‘LITE’ mode runs faster.
-- Instead of finding all files in the table directory, `VACUUM LITE` uses the Delta transaction log to identify and remove files no longer referenced by any table versions within the retention duration.
-- If `VACUUM LITE` cannot be completed because the Delta log has been pruned a `DELTA_CANNOT_VACUUM_LITE` exception is raised.
-- This mode is available only in <Delta> 3.3 and above.

VACUUM '/data/events' -- vacuum files in path-based table

Expand Down Expand Up @@ -719,4 +725,4 @@ CREATE OR REPLACE TABLE <target_table_name> SHALLOW CLONE iceberg.`/path/to/data
.. <PrestoAnd> replace:: Presto and Athena

.. <Delta> replace:: Delta Lake
.. <AS> replace:: Apache Spark
.. <AS> replace:: Apache Spark

0 comments on commit 2c210de

Please sign in to comment.