Skip to content

Commit

Permalink
[TE/JAX] XLA FFI calls for layer norm and RMS norm (#1290)
Browse files Browse the repository at this point in the history
* Add LayerNormForwardFFI(); add FFI calls in Python

Signed-off-by: Hua Huang <[email protected]>

* Add FFI for RMS norm, all tests passed

Signed-off-by: Hua Huang <[email protected]>

* Simplify layer & RMS norm FFI calls

Signed-off-by: Hua Huang <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Simplify tensor size calculations

Signed-off-by: Hua Huang <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: Hua Huang <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Phuong Nguyen <[email protected]>
  • Loading branch information
3 people authored Nov 4, 2024
1 parent d725686 commit df94903
Show file tree
Hide file tree
Showing 4 changed files with 748 additions and 427 deletions.
Loading

0 comments on commit df94903

Please sign in to comment.