Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Iceberg performance improvement #11182

Draft
wants to merge 28 commits into
base: master
Choose a base branch
from
Draft

Iceberg performance improvement #11182

wants to merge 28 commits into from
+282 −127

Commits on Aug 14, 2024

  1. Initial approach to boosting and measuring iceberg performance

    @skrydal
    skrydal committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    437038a View commit details
    Browse the repository at this point in the history

Commits on Aug 15, 2024

  1. Fixing catalog init

    @skrydal
    skrydal committed Aug 15, 2024
    Configuration menu
    Copy the full SHA
    6e62afe View commit details
    Browse the repository at this point in the history

  2. Linting

    @skrydal
    skrydal committed Aug 15, 2024
    Configuration menu
    Copy the full SHA
    71e8990 View commit details
    Browse the repository at this point in the history

  3. Linting

    @skrydal
    skrydal committed Aug 15, 2024
    Configuration menu
    Copy the full SHA
    f8881f0 View commit details
    Browse the repository at this point in the history

  4. Removing unused import

    @skrydal
    skrydal committed Aug 15, 2024
    Configuration menu
    Copy the full SHA
    a099eea View commit details
    Browse the repository at this point in the history

  5. Merge branch 'datahub-project:master' into iceberg_performance

    @skrydal
    skrydal authored Aug 15, 2024
    Configuration menu
    Copy the full SHA
    7b51e21 View commit details
    Browse the repository at this point in the history

Commits on Aug 16, 2024

  1. Added warning comment, TODO

    @skrydal
    skrydal committed Aug 16, 2024
    Configuration menu
    Copy the full SHA
    71baf6f View commit details
    Browse the repository at this point in the history

Commits on Aug 21, 2024

  1. Improving parallel handling, added verbosity

    @skrydal
    skrydal committed Aug 21, 2024
    Configuration menu
    Copy the full SHA
    b04324d View commit details
    Browse the repository at this point in the history

  2. Linting

    @skrydal
    skrydal committed Aug 21, 2024
    Configuration menu
    Copy the full SHA
    a7c842f View commit details
    Browse the repository at this point in the history

  3. Merge branch 'master' into iceberg_performance

    @skrydal
    skrydal authored Aug 21, 2024
    Configuration menu
    Copy the full SHA
    0320a23 View commit details
    Browse the repository at this point in the history

  4. Better logging

    @skrydal
    skrydal committed Aug 21, 2024
    Configuration menu
    Copy the full SHA
    63457cc View commit details
    Browse the repository at this point in the history

  5. Improving error handling

    @skrydal
    skrydal committed Aug 21, 2024
    Configuration menu
    Copy the full SHA
    0309a00 View commit details
    Browse the repository at this point in the history

  6. Linting

    @skrydal
    skrydal committed Aug 21, 2024
    Configuration menu
    Copy the full SHA
    598d1d2 View commit details
    Browse the repository at this point in the history

  7. Commenting out a sleep

    @skrydal
    skrydal committed Aug 21, 2024
    Configuration menu
    Copy the full SHA
    1b2d6e7 View commit details
    Browse the repository at this point in the history

  8. Back to thread local

    @skrydal
    skrydal committed Aug 21, 2024
    Configuration menu
    Copy the full SHA
    eda1ee6 View commit details
    Browse the repository at this point in the history

Commits on Sep 26, 2024

  1. Merge branch 'master' into iceberg_performance

    @skrydal
    skrydal authored Sep 26, 2024
    Configuration menu
    Copy the full SHA
    7ab737f View commit details
    Browse the repository at this point in the history

Commits on Oct 21, 2024

  1. Merge branch 'master' into iceberg_performance

    @skrydal
    skrydal authored Oct 21, 2024
    Configuration menu
    Copy the full SHA
    609eddf View commit details
    Browse the repository at this point in the history

  2. Added graceful handling of some errors

    @skrydal
    skrydal committed Oct 21, 2024
    Configuration menu
    Copy the full SHA
    75851fb View commit details
    Browse the repository at this point in the history

  3. Merge branch 'master' into iceberg_performance

    @skrydal
    skrydal authored Oct 21, 2024
    Configuration menu
    Copy the full SHA
    750508c View commit details
    Browse the repository at this point in the history

  4. Increased verbosity for listing namespaces

    @skrydal
    skrydal committed Oct 21, 2024
    Configuration menu
    Copy the full SHA
    15c3a1d View commit details
    Browse the repository at this point in the history

  5. Added threading info dump

    @skrydal
    skrydal committed Oct 21, 2024
    Configuration menu
    Copy the full SHA
    47ee246 View commit details
    Browse the repository at this point in the history

Commits on Nov 4, 2024

  1. Merge branch 'master' into iceberg_performance

    @skrydal
    skrydal authored Nov 4, 2024
    Configuration menu
    Copy the full SHA
    fad02ec View commit details
    Browse the repository at this point in the history

Commits on Nov 7, 2024

  1. Merge branch 'master' into iceberg_performance

    @skrydal
    skrydal authored Nov 7, 2024
    Configuration menu
    Copy the full SHA
    a297551 View commit details
    Browse the repository at this point in the history

  2. Reverting exhaustive logging in threaded executor

    @skrydal
    skrydal committed Nov 7, 2024
    Configuration menu
    Copy the full SHA
    0c53eb8 View commit details
    Browse the repository at this point in the history

Commits on Nov 8, 2024

  1. Reducing verbosity

    @skrydal
    skrydal committed Nov 8, 2024
    Configuration menu
    Copy the full SHA
    f5489cf View commit details
    Browse the repository at this point in the history

  2. Further improvements

    @skrydal
    skrydal committed Nov 8, 2024
    Configuration menu
    Copy the full SHA
    43e703e View commit details
    Browse the repository at this point in the history

  3. Removed unused import

    @skrydal
    skrydal committed Nov 8, 2024
    Configuration menu
    Copy the full SHA
    5649bcc View commit details
    Browse the repository at this point in the history

  4. Linting

    @skrydal
    skrydal committed Nov 8, 2024
    Configuration menu
    Copy the full SHA
    0f9d412 View commit details
    Browse the repository at this point in the history