Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

docs: minor fixes to the architecture documentation #2934

Merged
merged 3 commits into from
Oct 11, 2024
Merged

docs: minor fixes to the architecture documentation #2934

Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
e78644c
Minor fixes to the doc
Oct 9, 2024
3a5c07e
Fix MR comment (overwrite -> append)
Oct 11, 2024
ae1eee1
Merge branch 'main' into minor-fixes-to-the-doc
0x26res Oct 11, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
8 changes: 4 additions & 4 deletions docs/how-delta-lake-works/architecture-of-delta-table.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -12,7 +12,7 @@ Start by creating a pandas DataFrame and writing it out to a Delta table.

```python
import pandas as pd
from deltalake import DeltaTable, write_deltalake
from deltalake import write_deltalake

df = pd.DataFrame({"num": [1, 2, 3], "letter": ["a", "b", "c"]})
write_deltalake("tmp/some-table", df)
Expand Down Expand Up @@ -86,7 +86,7 @@ Create another pandas DataFrame and append it to the Delta table to see how this

```python
df = pd.DataFrame({"num": [8, 9], "letter": ["dd", "ee"]})
write_deltalake(f"{cwd}/tmp/delta-table", df, mode="append")
write_deltalake("tmp/some-table", df, mode="append")
```

Here are the files in storage:
Expand Down Expand Up @@ -132,7 +132,7 @@ Now create a third pandas DataFrame and overwrite the Delta table with the new d

```python
df = pd.DataFrame({"num": [11, 22], "letter": ["aa", "bb"]})
write_deltalake(f"{cwd}/tmp/delta-table", df, mode="append")
write_deltalake("tmp/some-table", df, mode="overwrite")
```

Here are the files in storage:
Expand Down Expand Up @@ -202,7 +202,7 @@ Data lakes consist of data files persisted in storage. They don't have a transac

Data lakes perform transactions differently than Delta tables.

When you perform an overwrite tranasction with a Delta table, you logically delete the exiting data without physically removing it.
When you perform an overwrite transaction with a Delta table, you logically delete the exiting data without physically removing it.

Data lakes don't support logical deletes, so you have to physically delete the data from storage.

Expand Down
Loading