Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Dev][TL] Decouple 3rdparty TileLang Backend with TVM #217

Open
wants to merge 54 commits into
base: main
Choose a base branch
from

Conversation

LeiWang1999
Copy link
Contributor

@LeiWang1999 LeiWang1999 commented Oct 10, 2024

This pull request includes updates to submodule configurations and references. The changes primarily involve adding a new submodule and updating existing submodule references.

Submodule reference updates:

  • 3rdparty/tile-lang: Added a subproject commit reference for the new submodule.
  • 3rdparty/tvm: Updated the subproject commit reference to a new commit hash.

TODO Items must be done before this pull request be merged:

  • Make sure we merge the latest update of upstream tvm.tl (e.g. ThreadPartialSync and tl.Simplify)
  • Refactor all tl related items with tilelang
  • Test Pass
  • Ensure that both the PyPI and local release build scripts function correctly after this pull request.

The select_scheduler function in the dense/__init__.py module has been refactored to use a fine-grained interface. This change provides more flexibility and enables the implementation of high-performance kernels.

Update MatmulScheduler class in matmul_tensorcore.py

The MatmulScheduler class in the matmul_tensorcore.py module has been updated to calculate the number of threads based on the block size and warp size. This ensures optimal GPU warp configuration for NVIDIA GPUs.

Improve test_general_matmul_tilelang_kernel.py

The test_general_matmul_tilelang_kernel.py module has been improved to include additional test cases and assertions for correctness.
…_tilelang_kernel.py to use centered random values for input tensors
@LeiWang1999 LeiWang1999 marked this pull request as ready for review October 11, 2024 15:00
@LeiWang1999
Copy link
Contributor Author

We came across some segment related bugs during the test.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant