Code

Scratch prefix caching#218

Code

Merged

quic-rishinr merged 17 commits intoquic:mainquic/efficient-transformers:mainfrom ochougul:scratch_prefix_cachingochougul/efficient-transformers:scratch_prefix_cachingCopy head branch name to clipboardJan 11, 2025

+212-9

Commits

Commits on Jan 10, 2025

• first commit scrach prefix caching with continuous batching

  Show description for c88629e
  ochougul

  committed
  c88629e

  Copy full SHA for c88629e

• added test file

  Show description for 72928bf
  ochougul

  committed
  72928bf

  Copy full SHA for 72928bf

• bugfix for any cache multiplier

  Show description for c79031c
  ochougul

  committed
  c79031c

  Copy full SHA for c79031c

• formatted

  Show description for 986ccf9
  ochougul

  committed
  986ccf9

  Copy full SHA for 986ccf9

• added header to example file

  Show description for 28f5661
  ochougul

  committed
  28f5661

  Copy full SHA for 28f5661

• formatting

  Show description for 662522c
  ochougul

  committed
  662522c

  Copy full SHA for 662522c

• removed example script

  Show description for 1280850
  ochougul

  committed
  1280850

  Copy full SHA for 1280850

• format and bugfix for CB execution

  Show description for 95298e5
  ochougul

  committed
  95298e5

  Copy full SHA for 95298e5

• formatted

  Show description for c3ad9b5
  ochougul

  committed
  c3ad9b5

  Copy full SHA for c3ad9b5

• finetune file restore

  Show description for cc8f51e
  ochougul

  committed
  cc8f51e

  Copy full SHA for cc8f51e

• restoring files

  Show description for 917e372
  ochougul

  committed
  917e372

  Copy full SHA for 917e372

• restoring files

  Show description for a466109
  ochougul

  committed
  a466109

  Copy full SHA for a466109

• removed parallel execution for Jenkins

  Show description for 99f4145
  ochougul

  committed
  99f4145

  Copy full SHA for 99f4145

• adding markers

  Show description for e11cf6a
  ochougul

  committed
  e11cf6a

  Copy full SHA for e11cf6a

• enabling multithreading for qaic tests

  Show description for a657cb3
  ochougul

  committed
  a657cb3

  Copy full SHA for a657cb3

• fixed default device ids in Auto classes

  Show description for 7cf607d
  ochougul

  committed
  7cf607d

  Copy full SHA for 7cf607d

• reverted onnx file dynamic axes names for QNN

  Show description for 485bc73
  ochougul

  committed
  485bc73

  Copy full SHA for 485bc73