Code

feat(mito): parquet memtable reader#4967

Code

Merged

waynexia merged 20 commits intoGreptimeTeam:mainGreptimeTeam/greptimedb:mainfrom v0y4g3r:refactor/separate-paraquet-readerv0y4g3r/greptimedb:refactor/separate-paraquet-readerCopy head branch name to clipboardDec 24, 2024

+1,061-245

Commits

Commits on Dec 24, 2024

• wip: row group reader base

  v0y4g3r

  committed
  57e7e6d

  Copy full SHA for 57e7e6d

• wip: memtable row group reader

  v0y4g3r

  committed
  3ddec65

  Copy full SHA for 3ddec65

• Refactor MemtableRowGroupReader to streamline data fetching

  Show description for 2f339c0
  v0y4g3r

  committed
  2f339c0

  Copy full SHA for 2f339c0

• wip: row group reader

  v0y4g3r

  committed
  09d2f6a

  Copy full SHA for 09d2f6a

• wip: reuse RowGroupReader

  v0y4g3r

  committed
  1bd4eef

  Copy full SHA for 1bd4eef

• wip: bulk part reader

  v0y4g3r

  committed
  1b595ca

  Copy full SHA for 1b595ca

• Enhance BulkPart Iteration with Filtering

  Show description for cd23239
  v0y4g3r

  committed
  cd23239

  Copy full SHA for cd23239

• chore: add prune test

  v0y4g3r

  committed
  fbd7c6c

  Copy full SHA for fbd7c6c

• fix: clippy

  v0y4g3r

  committed
  cc7af2e

  Copy full SHA for cc7af2e

• fix: introduce prune reader for memtable and add more prune test

  v0y4g3r

  committed
  9b413cf

  Copy full SHA for 9b413cf

• Enhance BulkPart read method to return Option<BoxedBatchIterator>

  Show description for a3dc12b
  v0y4g3r

  committed
  a3dc12b

  Copy full SHA for a3dc12b

• refactor/separate-paraquet-reader: Add helper function to parse parquet metadata and integrate it into BulkPartEncoder

  v0y4g3r

  committed
  a6f3528

  Copy full SHA for a6f3528

• refactor/separate-paraquet-reader:

  Show description for 310bb7b
  v0y4g3r

  committed
  310bb7b

  Copy full SHA for 310bb7b

• refactor/separate-paraquet-reader: Add context module for bulk memtable iteration and refactor part reading

  Show description for 49a0581
  v0y4g3r

  committed
  49a0581

  Copy full SHA for 49a0581

• refactor/separate-paraquet-reader: Refactor RowGroupReader traits and implementations in memtable and parquet reader modules

  Show description for ca5b603
  v0y4g3r

  committed
  ca5b603

  Copy full SHA for ca5b603

• refactor/separate-paraquet-reader: Refactor column page reader creation and remove unused code

  Show description for 1388811
  v0y4g3r

  committed
  1388811

  Copy full SHA for 1388811

• chore: rebase main and resolve conflicts

  v0y4g3r

  committed
  8641243

  Copy full SHA for 8641243

• fix: some comments

  v0y4g3r

  committed
  d093584

  Copy full SHA for d093584

• chore: resolve conflicts

  v0y4g3r

  committed
  10b01c3

  Copy full SHA for 10b01c3

• chore: resolve conflicts

  v0y4g3r

  committed
  db0054a

  Copy full SHA for db0054a