Implement SplitK and StreamK algorithm for Intel PVC (codeplaysoftwar…

…e#132)

* WIP: Introduce StreamK for PVC

* fixed starting index calculation

* Fixed barrier count update

* Fixed compilation for normal GEMM

* Perform fixup using threadid instead of subgroup_id

* Fixed the k_idx offset for MMA atom and corrected the reduction offset calculation

* Use log2 for available_xecores

* SplitK working

* Minor cleanup
* Need to fix splitK for batch > 1

* Fixed splitK for batch > 1

* Re-enabled GEMM Universal Adater specialization

* Update split barrier arguments

* Minor cleanup

* Changed initialization to workspace only

* Fix CI failure

* Added support for scheduling non-uniform tiles

* Only include split barrier flags for PVC

* Test

* Code cleanup

* Add separate example for StreamK

* Address feedback for split barrier

* Fix address space for atomicAdd

* Instantiate new accumulator registers per iteration

* Renamed the pipeline file

* Renamed files to xe_*

* Removed l2 workspace alignment

* Update the example to reduce caching effects

* Refactor pipeline code

* Add the option to invoke data parallel decomposition

* Fixing bugs post merge

* Address PR feedback

* Fix tile size

* Fix performance for streamk

* Match the number of workgroups to the available XeCores

* Fix performance for pvc_gemm example

* Address comments

---------

Co-authored-by: Mehdi Goli <[email protected]>
Co-authored-by: Alejandro Acosta <[email protected]>

cmake/FindDPCPP.cmake

@@ -57,6 +57,10 @@ if(NOT "${DPCPP_SYCL_ARCH}" STREQUAL "")
   endif()
 endif()
 
+if("${DPCPP_SYCL_TARGET}" STREQUAL "intel_gpu_pvc")
+  list(APPEND DPCPP_FLAGS "-Xspirv-translator;--spirv-ext=+SPV_INTEL_split_barrier")
+endif()
+
 if(UNIX)
   set_target_properties(DPCPP::DPCPP PROPERTIES
     INTERFACE_COMPILE_OPTIONS "${DPCPP_FLAGS};${DPCPP_COMPILE_ONLY_FLAGS}"

examples/sycl/pvc/CMakeLists.txt

@@ -41,3 +41,8 @@ cutlass_example_add_executable(
   pvc_collective_builder
   pvc_collective_builder.cpp
 )
+
+cutlass_example_add_executable(
+  pvc_gemm_streamk
+  pvc_gemm_streamk.cpp
+)