OnlyKey DUO freezing when connected to Thunderbolt port

[45freehold]

If connected to Thunderbolt 4 port on a PC, Onlykey Duo becomes unresponsive to touches after some time (10-30 minutes).
It does work at first, but then the green LED remains lit, but Onlykey doesn't respond. Reinserting it doesn't help as it remains "frozen" for quite some time, but may randomly unfreeze and start working again.
Tried updating and reinstalling Thunderbolt drivers, changing power management options to keep ports permanently powered but the issue seems to be somewhere else.
If anyone had similar issue please share as it isn't quite convenient to remove Onlykey from its type-c adaptor case every time.