Merge Cutlass version 3.6 #162
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
* Fix unrelated MSVC build warnings * Fix use of isnan in functional.h Correct namespace qualification of isnan in functional.h so that it invokes cutlass::isnan for half_t, instead of converting half_t to float and invoking std::isnan (on host, or ::isnan on device).
Co-authored-by: dePaul Miller <[email protected]>
Without this I get compilation error when the extended shapes are enabled
Co-authored-by: dePaul Miller <[email protected]>
update 3.5.1 readme/changelog
* Add couple configs into generator.py for mixed input MM * change one unit test name; reenable 128x32 in the profiler * Added U8/BF16 tests. --------- Co-authored-by: Haicheng Wu <[email protected]> Co-authored-by: Haicheng Wu <[email protected]>
fix uint128
…IA#1700) * Query pfn to driver api * use default for older toolkits --------- Co-authored-by: shunfans <[email protected]>
* Add support for mixed 4-bit/8-bit data types GEMM * fix ( and ) --------- Co-authored-by: Aleksandar Samardžić <[email protected]> Co-authored-by: Haicheng Wu <[email protected]>
Co-authored-by: Jiayu Sun <[email protected]>
Fixes llvm buld error.
…gue Visitor Tree’ (NVIDIA#1526) Co-authored-by: Haicheng Wu <[email protected]>
* add print_svg for mma * correct the code indentation
Co-authored-by: Alexander Zinoviev <[email protected]>
* Include of regular_tile_iterator.h fixed for NVRTC * More include fixed for NVRTC
…s/gemm/device/gemm_universal.h" (NVIDIA#1569) fix compile with `cmake .. -DCUTLASS_ENABLE_TESTS=ON -DCUTLASS_TEST_LEVEL=2`
…A#1894) Co-authored-by: Siyuan Fu <[email protected]>
…_Traits support (NVIDIA#1856) * fix wrong A/BLayout in MMA_Traits<SM80_16x8x256_S32U1U1S32_TN_XORPOPC> and append support for m8n8k128, m16n8k128 mma.and.popc in MMA_Traits instantiation * add "print" template for subbyte_reference<T>
…rs (NVIDIA#1931) * move two warpgroup_wait * merge main --------- Co-authored-by: Siyuan Fu <[email protected]>
* Fix `cutlass` python library with cuda `12.6.2.post1`
Previously we had this error:
```
File "/storage/home/cutlass/python/cutlass/backend/operation.py", line 39, in <listcomp>
_version_splits = [int(x) for x in __version__.split("rc")[0].split(".")]
^^^^^^
ValueError: invalid literal for int() with base 10: 'post1'
```
* Update sm90_utils.py
* Update generator.py
* Update python/cutlass_library/generator.py
Co-authored-by: Jack Kosaian <[email protected]>
* Update python/cutlass_library/sm90_utils.py
Co-authored-by: Jack Kosaian <[email protected]>
---------
Co-authored-by: Jack Kosaian <[email protected]>
# Conflicts: # examples/CMakeLists.txt # include/cute/arch/copy_sm90_desc.hpp # include/cute/arch/util.hpp # include/cute/atom/mma_traits.hpp # include/cute/numeric/numeric_types.hpp # include/cutlass/arch/barrier.h # include/cutlass/epilogue/collective/collective_epilogue.hpp # include/cutlass/gemm/collective/collective_builder.hpp # include/cutlass/gemm/device/gemm.h # include/cutlass/gemm/device/gemm_universal_adapter.h # include/cutlass/gemm/kernel/sm90_gemm_array_tma_warpspecialized_cooperative.hpp # include/cutlass/gemm/kernel/sm90_gemm_tma_warpspecialized.hpp # include/cutlass/gemm/kernel/sm90_tile_scheduler_stream_k.hpp # include/cutlass/platform/platform.h # tools/library/CMakeLists.txt # tools/util/include/cutlass/util/device_memory.h
aacostadiaz
force-pushed
the
aacosta/3.6
branch
from
6fa4521 to
a119855
Compare
mehdi-goli
approved these changes
Dec 3, 2024
t4c1
approved these changes
Dec 4, 2024
# Conflicts: # test/unit/gemm/device/gemm_testbed_3x.hpp
joeatodd
approved these changes
Dec 5, 2024
joeatodd
approved these changes
Dec 5, 2024
aacostadiaz
force-pushed
the
aacosta/3.6
branch
from
174c0b9 to
ce8d683
Compare
mehdi-goli
approved these changes
Dec 5, 2024
Merged
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This PR merges the changes from cutlass version 3.6