Skip to content

Conversation

alamb
Copy link
Contributor

@alamb alamb commented Oct 17, 2025

Related to

We are trying to figure out what is taking disk space. This PR is an attempt to gather telemetry and test

I don't intend to merge this

@alamb alamb changed the title Alamb/find space taker TESTING: what is taking disk space Oct 17, 2025
@github-actions github-actions bot added the development-process Related to development process of DataFusion label Oct 17, 2025
@comphead
Copy link
Contributor

looks like the image become larger, and it contains lots of things we dont need. like different Pythons, codeQL, etc

@comphead
Copy link
Contributor

comphead commented Oct 17, 2025

Disk space before cleanup:
Filesystem      Size  Used Avail Use% Mounted on
overlay          72G   54G   19G  75% /
tmpfs            64M     0   64M   0% /dev
shm              64M     0   64M   0% /dev/shm
/dev/root        72G   54G   19G  75% /__w
tmpfs           3.2G  1.2M  3.2G   1% /run/docker.sock
tmpfs           7.9G     0  7.9G   0% /proc/acpi
tmpfs           7.9G     0  7.9G   0% /proc/scsi
tmpfs           7.9G     0  7.9G   0% /sys/firmware
742M	/__t/node
1.6G	/__t/CodeQL
520M	/__t/PyPy
24K	/__t/Java_Temurin-Hotspot_jdk
1.5G	/__t/Python
1.1G	/__t/go
218M	/__t/Ruby
5.5G	/__t
170M	/__e/node20
214M	/__e/node24
99M	/__e/node20_alpine
130M	/__e/node24_alpine
611M	/__e
92K	/__w/_temp
953M	/__w/datafusion
16K	/__w/_PipelineMapping
14M	/__w/_actions
966M	/__w



Disk space after cleanup:
Filesystem      Size  Used Avail Use% Mounted on
overlay          72G   49G   23G  69% /
tmpfs            64M     0   64M   0% /dev
shm              64M     0   64M   0% /dev/shm
/dev/root        72G   49G   23G  69% /__w
tmpfs           3.2G  1.2M  3.2G   1% /run/docker.sock
tmpfs           7.9G     0  7.9G   0% /proc/acpi
tmpfs           7.9G     0  7.9G   0% /proc/scsi
tmpfs           7.9G     0  7.9G   0% /sys/firmware

Saved 4G it might be enough

@comphead
Copy link
Contributor

We are good here, I'll polish my PR and we can go ahead

@alamb
Copy link
Contributor Author

alamb commented Oct 18, 2025

Thanks for the help @comphead

@alamb alamb closed this Oct 18, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

development-process Related to development process of DataFusion

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants