Code

PactDB Compaction#1680

Code

Merged

chessai merged 85 commits intomasterkadena-io/chainweb-node:masterfrom chessai/compactionkadena-io/chainweb-node:chessai/compactionCopy head branch name to clipboardNov 16, 2023

+2,263-219

Commits

Commits on Jul 11, 2023

• PactDB: compute sha3 checksums

  

  larskuhtz

  authored and

  chessai

  committed
  7994f59

  Copy full SHA for 7994f59

• fix build

  

  sirlensalot

  authored and

  chessai

  committed
  3eb1f48

  Copy full SHA for 3eb1f48

• compact system tables

  

  sirlensalot

  authored and

  chessai

  committed
  31eebfa

  Copy full SHA for 31eebfa

• refactor

  

  sirlensalot

  authored and

  chessai

  committed
  33d5884

  Copy full SHA for 33d5884

• docs

  

  sirlensalot

  authored and

  chessai

  committed
  f5714ba

  Copy full SHA for f5714ba

• test verifies hashes

  

  sirlensalot

  authored and

  chessai

  committed
  106db3f

  Copy full SHA for 106db3f

• return global hash

  

  sirlensalot

  authored and

  chessai

  committed
  a6c1682

  Copy full SHA for a6c1682

• dedicated test

  

  sirlensalot

  authored and

  chessai

  committed
  b90251c

  Copy full SHA for b90251c

• Code-complete with cw-tool

  

  sirlensalot

  authored and

  chessai

  committed
  27e6329

  Copy full SHA for 27e6329

• test comments

  

  sirlensalot

  authored and

  chessai

  committed
  21d4385

  Copy full SHA for 21d4385

• cleanup sql

  

  sirlensalot

  authored and

  chessai

  committed
  8a063c5

  Copy full SHA for 8a063c5

• cleanup

  

  sirlensalot

  authored and

  chessai

  committed
  2282f20

  Copy full SHA for 2282f20

• cleanup

  

  sirlensalot

  authored and

  chessai

  committed
  0a65092

  Copy full SHA for 0a65092

• fix build

  

  sirlensalot

  authored and

  chessai

  committed
  59e9934

  Copy full SHA for 59e9934

• Hashing no longer in checkpointer, internal to compaction

  

  sirlensalot

  authored and

  chessai

  committed
  614baeb

  Copy full SHA for 614baeb

• cleanup

  

  sirlensalot

  authored and

  chessai

  committed
  cc7198e

  Copy full SHA for cc7198e

• fix drop table, add vacuum

  

  sirlensalot

  authored and

  chessai

  committed
  d4b8bde

  Copy full SHA for d4b8bde

• test TODOs

  

  sirlensalot

  authored and

  chessai

  committed
  ecbfd3e

  Copy full SHA for ecbfd3e

• optparse cleanups

  chessai

  committed
  f123fe6

  Copy full SHA for f123fe6

• remove flag addition in chainweb.cabal

  chessai

  committed
  4b8a48d

  Copy full SHA for 4b8a48d

• clean up imports

  chessai

  committed
  b7c701f

  Copy full SHA for b7c701f

• make relevant fields strict

  chessai

  committed
  0269ed1

  Copy full SHA for 0269ed1

• minor src cleanups

  chessai

  committed
  870db50

  Copy full SHA for 870db50

• add some docs to compaction functions

  chessai

  committed
  0ddb865

  Copy full SHA for 0ddb865

• first test stuff

  chessai

  committed
  0f5f38c

  Copy full SHA for 0f5f38c

• more compaction haddocks/add blockheight to invalid block height exception

  chessai

  committed
  5f97870

  Copy full SHA for 5f97870

• remove redundant import

  chessai

  committed
  559101e

  Copy full SHA for 559101e

• add flag to not drop new tables

  chessai

  committed
  a232790

  Copy full SHA for a232790

• compact concurrently, add log directory for per-chain logs

  chessai

  committed
  e4d1a29

  Copy full SHA for e4d1a29

• debugging doRestore

  chessai

  committed
  a969717

  Copy full SHA for a969717

• compaction: just don't drop new tables at all, ever

  chessai

  committed
  2ca8f49

  Copy full SHA for 2ca8f49

• change compact log file name prefix from compact-log- to compact-chain-

  chessai

  committed
  484cf42

  Copy full SHA for 484cf42

• Revert "compaction: just don't drop new tables at all, ever"

  Show description for 1f8a72f
  chessai

  committed
  1f8a72f

  Copy full SHA for 1f8a72f

• undo residual changes from rebase

  chessai

  committed
  5b41d58

  Copy full SHA for 5b41d58

• undo redundant logging

  chessai

  committed
  26f17f1

  Copy full SHA for 26f17f1

• use new chainweb version code

  chessai

  committed
  b39a6cc

  Copy full SHA for b39a6cc

• print compaction hash in base64

  chessai

  committed
  c6d0d80

  Copy full SHA for c6d0d80

• fix compactSystemTables

  chessai

  committed
  5a19423

  Copy full SHA for 5a19423

Commits on Jul 14, 2023

• Add --threads option and use pooledMapConcurrentlyN_ in compaction

  

  Evgenii Akentev

  committed
  beb57fe

  Copy full SHA for beb57fe

Commits on Aug 18, 2023

• Merge branch 'master' into chessai/compaction

  edmundnoble

  committed
  ee96fe7

  Copy full SHA for ee96fe7

• Merge branch 'master' into chessai/compaction

  chessai

  authored
  1d00f06

  Copy full SHA for 1d00f06

• compaction logging: create directory and files before attempting to log. not sure why this stopped working?

  chessai

  committed
  fb0953d

  Copy full SHA for fb0953d

Commits on Aug 21, 2023

• add new test idea from John

  chessai

  committed
  ac065a7

  Copy full SHA for ac065a7

• add NoGrandHash flag

  chessai

  committed
  3d049bf

  Copy full SHA for 3d049bf

• fix type error

  chessai

  committed
  0c680cb

  Copy full SHA for 0c680cb

• fix compact flag for no grand hash

  chessai

  committed
  01f0cb0

  Copy full SHA for 01f0cb0

• don't verifyTable when NoGrandHash is set

  chessai

  committed
  ffd68d3

  Copy full SHA for ffd68d3

Commits on Sep 14, 2023

• Merge branch 'master' into chessai/compaction

  chessai

  committed
  d04943a

  Copy full SHA for d04943a

• fix compile error in tests from prior change

  chessai

  committed
  4dd62be

  Copy full SHA for 4dd62be

Commits on Sep 21, 2023

• make PactService exit if rosetta is enabled and we don't have the full history (#1736)

  Show description for 89eaa22
  chessai

  authored
  89eaa22

  Copy full SHA for 89eaa22

• Merge branch 'master' into chessai/compaction

  chessai

  committed
  e330bd4

  Copy full SHA for e330bd4

Commits on Sep 25, 2023

• Merge branch 'master' into chessai/compaction

  chessai

  committed
  01e71a8

  Copy full SHA for 01e71a8

• informative error message if you try to rewind before min(blockheight) (#1726)

  Show description for cc742f7
  

  chessai

  and

  edmundnoble

  authored
  cc742f7

  Copy full SHA for cc742f7

Commits on Sep 27, 2023

• Merge branch 'master' into chessai/compaction

  chessai

  committed
  67c8710

  Copy full SHA for 67c8710

• MultiNode compaction test (#1742)

  Show description for 51f8e05
  chessai

  authored
  51f8e05

  Copy full SHA for 51f8e05

Commits on Oct 2, 2023

• Merge branch 'master' into chessai/compaction

  chessai

  committed
  012f28f

  Copy full SHA for 012f28f

Commits on Oct 12, 2023

• Merge branch 'master' into chessai/compaction

  chessai

  committed
  a5ca07f

  Copy full SHA for a5ca07f

Commits on Oct 13, 2023

• refactor compaction code

  chessai

  committed
  a450f9a

  Copy full SHA for a450f9a

Commits on Oct 16, 2023

• STM-based chain selection algo for mining

  

  edmundnoble

  authored and

  chessai

  committed
  d6cd8e8

  Copy full SHA for d6cd8e8

Commits on Oct 18, 2023

• compact-resume test: move to singletonChainGraph

  chessai

  committed
  f4fc0e9

  Copy full SHA for f4fc0e9

• Merge branch 'master' into chessai/compaction

  chessai

  committed
  457a0ee

  Copy full SHA for 457a0ee

Commits on Oct 19, 2023

• Merge branch 'master' into chessai/compaction

  chessai

  committed
  70dc4f1

  Copy full SHA for 70dc4f1

Commits on Oct 20, 2023

• compaction idempotency test (#1759)

  Show description for 0601a9e
  chessai

  authored
  0601a9e

  Copy full SHA for 0601a9e

• Merge branch 'master' into chessai/compaction

  chessai

  committed
  eb34fb2

  Copy full SHA for eb34fb2

• compaction pre-and-post active row test (#1756)

  Show description for 97b5a42
  chessai

  authored
  97b5a42

  Copy full SHA for 97b5a42

Commits on Oct 27, 2023

• Merge branch 'master' into chessai/compaction

  chessai

  committed
  e44ae36

  Copy full SHA for e44ae36

Commits on Nov 3, 2023

• Merge branch 'master' into chessai/compaction

  chessai

  committed
  cef87dc

  Copy full SHA for cef87dc

• benchmark newBlock after compaction (#1774)

  chessai

  authored
  bc0bc51

  Copy full SHA for bc0bc51

• [test] compaction tables created after target blockheight are dropped (#1768)

  Show description for 2ed9345
  chessai

  authored
  2ed9345

  Copy full SHA for 2ed9345

Commits on Nov 6, 2023

• Merge branch 'master' into chessai/compaction

  chessai

  committed
  c06e1b8

  Copy full SHA for c06e1b8

Commits on Nov 7, 2023

• add latest option for chain compaction

  chessai

  committed
  cadb781

  Copy full SHA for cadb781

Commits on Nov 13, 2023

• Merge branch 'master' into chessai/compaction

  chessai

  authored
  e9e5279

  Copy full SHA for e9e5279

• Revert "STM-based chain selection algo for mining"

  Show description for 7bf673f
  chessai

  committed
  7bf673f

  Copy full SHA for 7bf673f

Commits on Nov 15, 2023

• compaction compare pact state tool (#1764)

  Show description for ec4e7fa
  chessai

  authored
  ec4e7fa

  Copy full SHA for ec4e7fa

• remove redundant/bad old Compaction.hs test

  chessai

  committed
  de12389

  Copy full SHA for de12389

• respond to some review

  chessai

  committed
  4997e25

  Copy full SHA for 4997e25

• finish responding to Austin's review

  chessai

  committed
  9939c07

  Copy full SHA for 9939c07

• respond to first round of Edmund's reviews

  chessai

  committed
  a6f8e7d

  Copy full SHA for a6f8e7d

• respond to Edmund's second wave of review

  chessai

  committed
  1fb2d6c

  Copy full SHA for 1fb2d6c

• Revert "compact-resume test: move to singletonChainGraph"

  Show description for 2093ede
  chessai

  committed
  2093ede

  Copy full SHA for 2093ede

Commits on Nov 16, 2023

• make compact function take a TargetBlockHeight instead of a BlockHeight

  chessai

  committed
  205a992

  Copy full SHA for 205a992

• get rid of redundant ITxId type

  chessai

  committed
  ae02900

  Copy full SHA for ae02900

• fix index of getLatestBlockHeight query log

  chessai

  committed
  bf274a4

  Copy full SHA for bf274a4

• respond to more review

  chessai

  committed
  1e24675

  Copy full SHA for 1e24675

• compaction test txlogs (#1780)

  Show description for f7ca60d
  chessai

  authored
  f7ca60d

  Copy full SHA for f7ca60d