Code

[torchao float8tensor] #1415

Code

Draft

crcrpar wants to merge 67 commits intocrpa/subclass-tensor-opsLightning-AI/lightning-thunder:crpa/subclass-tensor-opsfrom crpa/subclass-torchao_float8tensorLightning-AI/lightning-thunder:crpa/subclass-torchao_float8tensorCopy head branch name to clipboard

+813-77

Commits

Commits on Dec 12, 2024

• add path of SubclassTensorProxy in tensorproxy

  Show description for f2ef54d
  crcrpar

  committed
  f2ef54d

• phase 1 for backward test

  Show description for 927f8e8
  crcrpar

  committed
  927f8e8

• check backward is runnable with subclass arguments

  Show description for a22e253
  crcrpar

  committed
  a22e253

• bwd run with tensor creation inside of trace

  Show description for b70dd8c
  crcrpar

  committed
  b70dd8c

• flatten Function.apply of converter

  Show description for 7fe8e14
  crcrpar

  committed
  7fe8e14

• torchao small test

  Show description for b779d0f
  crcrpar

  committed
  b779d0f

• placeholder-ish attributes/methods for _make_wrapper_subclass

  Show description for 2159a7e
  crcrpar

  committed
  2159a7e

• [autograd.Function lookaside] dce to wipe out redundant bsyms

  Show description for 9a6c97a
  crcrpar

  committed
  9a6c97a

• Give unpack bsyms to traces generated inside Function lookaside

  Show description for 8cba048
  crcrpar

  committed
  8cba048

• some tweaks

  Show description for 48b2bba
  crcrpar

  committed
  48b2bba

• revert pytree changes

  Show description for a577af0
  crcrpar

  committed
  a577af0

• imports for tensor subclass ctor

  Show description for fa0204a
  crcrpar

  committed
  fa0204a

• define bind-postprocess

  Show description for de6d491
  crcrpar

  committed
  de6d491

• xfail, for now

  Show description for 52045f1
  crcrpar

  committed
  52045f1

• fix type set creation and add bsym postprocess for torchex

  Show description for 1e20363
  crcrpar

  committed
  1e20363

• printer translating thunder dtype/device to torchs

  Show description for 5e08e44
  crcrpar

  committed
  5e08e44

• meticulously set import_ctx of cls

  Show description for 64e476e
  crcrpar

  committed
  64e476e

• dry

  Show description for 0810f83
  crcrpar

  committed
  0810f83

• test failure info update

  Show description for 65a7960
  crcrpar

  committed
  65a7960

• cosmetic

  Show description for e7c6fb1
  crcrpar

  committed
  e7c6fb1

• better repr & type string

  Show description for 88cec40
  crcrpar

  committed
  88cec40

• use transpose instead of permute

  Show description for 2e03eea
  crcrpar

  committed
  2e03eea

• better typestring

  Show description for b86e762
  crcrpar

  committed
  b86e762

• num bsyms check

  Show description for 29787ee
  crcrpar

  committed
  29787ee

• allow tensor subclasses with non-empty metadata

  Show description for 5257439
  crcrpar

  committed
  5257439

• bsyms is a list inside trace_from_bsym_or_bsyms

  Show description for 8beffec
  crcrpar

  committed
  8beffec

• the typestring has syntactic mistake; remove for now

  Show description for 9d062d6
  crcrpar

  committed
  9d062d6

• better error message for missing support of ops

  Show description for f66792a
  crcrpar

  committed
  f66792a

• add torch._scaled_mm to auto register

  Show description for 12d83ed
  crcrpar

  committed
  12d83ed

• update error message of missing op

  Show description for 3905bb8
  crcrpar

  committed
  3905bb8

• tree_flatten tensor subclass metadata values

  Show description for b357b7a
  crcrpar

  committed
  b357b7a

• make error msg verbose

  Show description for aac5d9c
  crcrpar

  committed
  aac5d9c

• better effor message for failing map from fx node to ltorch op

  Show description for 034331a
  crcrpar

  committed
  034331a

• better error message

  Show description for f915053
  crcrpar

  committed
  f915053

• register scaled_mm

  Show description for 4736a14
  crcrpar

  committed
  4736a14

• note where new bsyms come from, especially torch dispatch

  Show description for 4d60fcc
  crcrpar

  committed
  4d60fcc

• cast fx.immutable_{dict, list} to dict/list

  Show description for f32f6d4
  crcrpar

  committed
  f32f6d4

• printer and bind_postprocess for __tensor_flatten__ & __tensor_unflatten__

  Show description for db44b75
  crcrpar

  committed
  db44b75

• [pre-commit.ci] auto fixes from pre-commit.com hooks

  Show description for 6497038
  

  pre-commit-ci[bot]

  authored and

  crcrpar

  committed
  6497038

• xfail reason

  Show description for 385a2eb
  crcrpar

  committed
  385a2eb

• cosmetic

  Show description for 88982cb
  crcrpar

  committed
  88982cb

• simplify subclass output handling

  Show description for 182d227
  crcrpar

  committed
  182d227

• Unrolling tensor subclasses in fwd/bwd split (#1489)

  Show description for 6c33446
  

  crcrpar

  and

  pre-commit-ci[bot]

  committed
  6c33446

• reduce return values by one

  Show description for 6e90fc3
  crcrpar

  committed
  6e90fc3

• clarify the error is numeric

  Show description for a1cea76
  crcrpar

  committed
  a1cea76

• add bfloat16 to test parametrization

  Show description for f3c6cef
  crcrpar

  committed
  f3c6cef

• torch_compile_ex style transform for execution

  Show description for 008021c
  crcrpar

  committed
  008021c

• update test

  Show description for 4163f01
  crcrpar

  committed
  4163f01

• clarify nothing is put into thunder.jit when thunderfx

  Show description for 13409ef
  crcrpar

  committed
  13409ef

• [pre-commit.ci] auto fixes from pre-commit.com hooks

  Show description for b14e8c1
  

  pre-commit-ci[bot]

  authored and

  crcrpar

  committed
  b14e8c1

• shorter header for torch dispatch result

  Show description for 36d6bbf
  crcrpar

  committed
  36d6bbf

• try to tell if the trace is backward or not by checking certain bsyms

  Show description for 293af4d
  crcrpar

  committed
  293af4d

• update test

  Show description for fbc56fd
  crcrpar

  committed
  fbc56fd

• check bsym.args itself before its first name

  Show description for 12cf478
  crcrpar

  committed
  12cf478

• warn tensor subclass support

  Show description for f42f41e
  crcrpar

  committed
  f42f41e

• test update

  Show description for 34dc785
  crcrpar

  committed
  34dc785

• more meticulous bsym check to tell if the trace is bwd

  Show description for e71c47b
  crcrpar

  committed
  e71c47b

• [pre-commit.ci] auto fixes from pre-commit.com hooks

  Show description for 2085e4d
  

  pre-commit-ci[bot]

  authored and

  crcrpar

  committed
  2085e4d

• remove flat_trace_args_spec

  Show description for dfed7c5
  crcrpar

  committed
  dfed7c5

• fix wrong rebase output

  Show description for 651c7b0
  crcrpar

  committed
  651c7b0

• fix typo

  Show description for 832bf79
  crcrpar

  committed
  832bf79

• add tensor subclass transform output to traces

  Show description for 6b73636
  crcrpar

  committed
  6b73636

Commits on Dec 13, 2024

• bring back unexpectedly deleted line

  Show description for 751227a
  crcrpar

  committed
  751227a

• add note about the behavioral difference

  Show description for 53d28a7
  crcrpar

  committed
  53d28a7

• DCE for tensor.__tensor_flatten__

  Show description for 97416e2
  crcrpar

  committed
  97416e2

• update regex of assert raises

  Show description for 4b7832c
  crcrpar

  committed
  4b7832c

• [pre-commit.ci] auto fixes from pre-commit.com hooks

  Show description for 574703e
  pre-commit-ci[bot]

  committed
  574703e