Code

HDFS benchmarks#567

Code

Draft

tammam1998 wants to merge 46 commits intofuturebinpash/pash:futurefrom hdfs_benchmarksbinpash/pash:hdfs_benchmarksCopy head branch name to clipboard

+2,681

Commits

Commits on Apr 26, 2022

• porting some of the for loops to hdfs

  tammam1998

  committed
  229c91c

  Copy full SHA for 229c91c

• porting oneliners to use hdfs

  tammam1998

  committed
  a11812d

  Copy full SHA for a11812d

• added gitingore for dependecy_untagling

  tammam1998

  committed
  748f7ab

  Copy full SHA for 748f7ab

Commits on Apr 27, 2022

• add stateless and pure function annotations

  Show description for f89cbdd
  tammam1998

  committed
  f89cbdd

  Copy full SHA for f89cbdd

• improve oneliners hdfs setup script

  Show description for ab5c3b9
  tammam1998

  committed
  ab5c3b9

  Copy full SHA for ab5c3b9

Commits on May 1, 2022

• fix path bug in spell.sh

  tammam1998

  committed
  32a0b86

  Copy full SHA for 32a0b86

• allow varying replication factor in tests

  tammam1998

  committed
  2b0876b

  Copy full SHA for 2b0876b

Commits on May 4, 2022

• improve benchmark scripts

  tammam1998

  committed
  9060742

  Copy full SHA for 9060742

Commits on May 8, 2022

• fix small bug

  tammam1998

  committed
  bc03de7

  Copy full SHA for bc03de7

Commits on May 25, 2022

• Merge branch 'future' into hdfs_benchmarks

  tammam1998

  committed
  d3246da

  Copy full SHA for d3246da

• Merge remote-tracking branch 'origin/future' into hdfs_benchmarks

  tammam1998

  committed
  cc106bc

  Copy full SHA for cc106bc

Commits on May 30, 2022

• port nlp scripts to distributed exec

  tammam1998

  committed
  e933a36

  Copy full SHA for e933a36

• replace non parallelizable tr with parallelizable variation

  tammam1998

  committed
  3f65e42

  Copy full SHA for 3f65e42

• Merge branch 'hdfs_benchmarks' of https://github.com/binpash/pash into hdfs_benchmarks

  tammam1998

  committed
  c884fff

  Copy full SHA for c884fff

• nlp eval script

  tammam1998

  committed
  9d11dd6

  Copy full SHA for 9d11dd6

• Merge branch 'hdfs_benchmarks' of https://github.com/binpash/pash into hdfs_benchmarks

  tammam1998

  committed
  0d9c1d8

  Copy full SHA for 0d9c1d8

• fix incorrect flags

  tammam1998

  committed
  eecff28

  Copy full SHA for eecff28

Commits on Jun 2, 2022

• fixed small issues in eval scripts

  tammam1998

  committed
  4749aa4

  Copy full SHA for 4749aa4

• added gitignores to outputs and inputs

  tammam1998

  committed
  747527d

  Copy full SHA for 747527d

• use temp ffiles n pure functions

  tammam1998

  committed
  18f0a08

  Copy full SHA for 18f0a08

• minor nlp fixes

  tammam1998

  committed
  fd06883

  Copy full SHA for fd06883

• Merge remote-tracking branch 'origin/future' into hdfs_benchmarks

  tammam1998

  committed
  c95e7e8

  Copy full SHA for c95e7e8

Commits on Jun 3, 2022

• ported unix50 for distributed exec

  tammam1998

  committed
  051df82

  Copy full SHA for 051df82

• ported analytics mts to distributed exec

  tammam1998

  committed
  be3fae2

  Copy full SHA for be3fae2

• added gitingore

  tammam1998

  committed
  170e7cd

  Copy full SHA for 170e7cd

• fix trigrams nlp

  tammam1998

  committed
  017ef55

  Copy full SHA for 017ef55

Commits on Jun 6, 2022

• some fixes

  tammam1998

  committed
  039334b

  Copy full SHA for 039334b

• port some dependency untagling scripts to hdfs

  tammam1998

  committed
  99c3dbb

  Copy full SHA for 99c3dbb

• small changes to eval scripts

  tammam1998

  committed
  6f0f5f3

  Copy full SHA for 6f0f5f3

Commits on Jun 7, 2022

• improve oneliners eval and setup scripts

  tammam1998

  committed
  9d82499

  Copy full SHA for 9d82499

• fix du installation scripts

  tammam1998

  committed
  c6c2c38

  Copy full SHA for c6c2c38

• Add newly added benchmarks to the run all script

  tammam1998

  committed
  a056c46

  Copy full SHA for a056c46

Commits on Jun 8, 2022

• Merge branch 'hdfs_benchmarks' of https://github.com/binpash/pash into hdfs_benchmarks

  tammam1998

  committed
  bce37cf

  Copy full SHA for bce37cf

• use gzip instead of zip for better streaming support

  tammam1998

  committed
  9ee0791

  Copy full SHA for 9ee0791

• small changes to setup script

  tammam1998

  committed
  63fe614

  Copy full SHA for 63fe614

• fix bug in pcap.sh

  tammam1998

  committed
  badea8d

  Copy full SHA for badea8d

Commits on Jun 11, 2022

• Add max-temp benchmark

  tammam1998

  committed
  bb3f2e0

  Copy full SHA for bb3f2e0

• fix typo

  tammam1998

  committed
  8124626

  Copy full SHA for 8124626

• fixes to eval scripts

  tammam1998

  committed
  732c78c

  Copy full SHA for 732c78c

Commits on Jun 12, 2022

• small bug

  tammam1998

  committed
  55aee24

  Copy full SHA for 55aee24

Commits on Jun 15, 2022

• Merge branch 'hdfs_benchmarks' of https://github.com/binpash/pash into hdfs_benchmarks

  tammam1998

  committed
  ea2e06e

  Copy full SHA for ea2e06e

• fix small issues

  tammam1998

  committed
  e22dd83

  Copy full SHA for e22dd83

Commits on Jun 16, 2022

• change bigrams to be consistant and add hdfs put annotation

  tammam1998

  committed
  6fc191d

  Copy full SHA for 6fc191d

• Merge branch 'hdfs_benchmarks' of https://github.com/binpash/pash into hdfs_benchmarks

  tammam1998

  committed
  c2a60db

  Copy full SHA for c2a60db

• fix leftover merge conflict

  tammam1998

  committed
  26ce867

  Copy full SHA for 26ce867

• Merge branch 'hdfs_benchmarks' of https://github.com/binpash/pash into hdfs_benchmarks

  tammam1998

  committed
  0dfd6f8

  Copy full SHA for 0dfd6f8