Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[GPU] Serialize micro kernel settings #25319

Merged
merged 2 commits into from
Jul 2, 2024
Merged

[GPU] Serialize micro kernel settings #25319

merged 2 commits into from
Jul 2, 2024

Conversation

vladimir-paramuzov
Copy link
Contributor

@vladimir-paramuzov vladimir-paramuzov commented Jul 2, 2024 •
edited
Loading

Details:

  • Add microkernels settings serialization/deserialization logic to be able to use it after model import in update dispatch data functions
  • Limit head size for micro SDPA by 256.

Tickets:

@vladimir-paramuzov vladimir-paramuzov added the category: GPU OpenVINO GPU plugin label Jul 2, 2024
@vladimir-paramuzov vladimir-paramuzov added this to the 2024.3 milestone Jul 2, 2024
@vladimir-paramuzov vladimir-paramuzov requested review from a team as code owners July 2, 2024 07:34
@vladimir-paramuzov vladimir-paramuzov force-pushed the micro_sdpa_fixes branch 2 times, most recently from cac1d81 to 32e46ef Compare July 2, 2024 10:00
@vladimir-paramuzov vladimir-paramuzov added this pull request to the merge queue Jul 2, 2024
Merged via the queue into openvinotoolkit:master with commit 626966b Jul 2, 2024
106 checks passed
@vladimir-paramuzov vladimir-paramuzov deleted the micro_sdpa_fixes branch July 2, 2024 16:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@yeonbok yeonbok yeonbok approved these changes

Assignees
No one assigned
Labels
category: GPU OpenVINO GPU plugin
Projects
None yet
Milestone
2024.3
Development

Successfully merging this pull request may close these issues.

None yet
2 participants
@vladimir-paramuzov @yeonbok