[24.1] Put cached jobs back into queue on handler restart

[24.1] Put cached jobs back into queue on handler restart #6067