Skip to content

[GPU] Improve OOR exception #32649

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 5 commits into
base: master
Choose a base branch
from
+9 −3
Open

[GPU] Improve OOR exception #32649

Changes from all commits
Commits
Show all changes
5 commits
Select commit Hold shift + click to select a range
92f013a
improve oor exception
JohnLeFeng Nov 3, 2025
06964b0
fix typo
JohnLeFeng Nov 3, 2025
d5b79eb
update description
JohnLeFeng Nov 5, 2025
f3dcca0
add 10GB system memory limitation
JohnLeFeng Nov 5, 2025
e3dc040
update segment
JohnLeFeng Nov 5, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
12 changes: 9 additions & 3 deletions src/plugins/intel_gpu/src/runtime/ocl/ocl_common.hpp
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -48,10 +48,16 @@ inline void rethrow(std::string message, cl_int error, const device_info& info)
<< "\tDue to a driver bug, any subsequent OpenCL API call may cause the application to hang, "
<< "so the GPU plugin may be unable to finish correctly.\n"
<< "\tThe CL_OUT_OF_RESOURCES error typically occurs in two cases:\n"
<< "\t1. An actual lack of memory for the current inference.\n"
<< "\t1. Insufficient memory for the current inference.\n"
<< "\t2. An out-of-bounds access to GPU memory from a kernel.\n"
<< "\tFor case 1, you may try adjusting some model parameters (e.g., using a smaller batch size, lower inference precision, fewer streams, etc.)"
<< " to reduce the required memory size. For case 2, please submit a bug report to the OpenVINO team.\n"
<< "\tFor case 1 (Insufficient Memory)"
<< "\t - Try adjusting some model parameters (e.g., using a smaller batch size, lower inference precision, fewer streams, etc.) to \n"
<< "\t reduce the required memory size.\n"
<< "\t - Alternatively, for Intel integrated Arc GPUs on Microsoft Windows 10 or 11 host systems with more than 10 GB of system memory, the \n"
<< "\t shared memory allocation can be increased via the Intel Graphics Software tool: 'Graphics > General > Shared GPU Memory Override', \n"
<< "\t as long as it is not already at its software-defined upper limit.\n"
<< "\tFor case 2 (Out-of-Bounds Access):\n"
<< "\t - Please submit a bug report to the OpenVINO team.\n"
<< "\tAdditionally, please try updating the driver to the latest version.\n";
OPENVINO_THROW(ss.str());
} else {
Expand Down
Loading