Github actions use cached images

[bn222]

While working on k8snetworkplumbingwg/sriov-network-device-plugin#414, we have noticed that a build error was hidden (locally and) in Github actions. We should ensure that Github actions don't rely on cached versions.