Loading cache_mode from load_config json for GPU #773
Conversation
| LOGS_DEFAULT(INFO) << log_tag << "Enables Caching"; | ||
|
|
||
| OVCore::Get()->SetCache(session_context_.cache_dir.string()); | ||
| config_t& load_config = session_context_.load_config; |
There was a problem hiding this comment.
I see that you are setting the values explicitly, can we not directly pass below & let ov toolkit take care of it. In my opinion this change is not needed, as we are delegating all the heavy lifting & setting of ov::AnyMap device_config properties to OV toolkit internally going ahead
{
"GPU": {
"CACHE_MODE": "OPTIMIZE_SIZE"
// "CACHE_MODE": "OPTIMIZE_SPEED"
}
}
|
@ankitm3k, cache_mode is not handled anywhere today. Just adding it from json does not work without this change. Whereever we put, handling of cache_mode and cache_dir should be together. Pls suggest if you have any better place to put them. |
cache_mode can be set from load_config json. However, OV backend did not use it so far. Added the support but restricted to GPU for tiem being.
|
@susbhere can you please put cache mode and cache dir in the latest ovep-develop together through load json and verify , It should work, just like it works for OV |
|
This code change is not required. Cache mode can be set through load_config json. |
3 participants
cache_mode can be set from load_config json. However, OV backend did not
use it so far. Added the support but restricted to GPU for tiem being.
https://jira.devtools.intel.com/browse/CVS-171607