CI: Automate colima delete command with confirmation

[SmartManoj]

What is the problem that this fixes or functionality that this introduces? Does it fix any open issues?

Action link

---

Give a summary of what the PR does, explaining any non-trivial design decisions

Increased ATTEMPT_LIMIT to 4 to check the inference ( QEMU works in 3rd attempt) lima-vm/lima#2455 (comment)

---

Other references

[neubig]

Thanks for attempting to fix the Colima problems! But sorry, could you explain more?

Why do you think that 3 attempts may be insufficient but 4 would be better?

Also, why delete after 3 attempts when the maximum number of attempts is 4?

[SmartManoj]

Increased ATTEMPT_LIMIT to 4 to check the inference ( QEMU works in 3rd attempt) lima-vm/lima#2455 (comment)

first two attempts failed with msg="[hostagent] QEMU did not exit in 3m0s, forcibly killing QEMU"
third one with msg="error starting docker: cannot restart, VM not previously started" (inference => 1st essential requirement is satisfied in ~7mins (3+3+1))

Action link

---

Why do you think that 3 attempts may be insufficient but 4 would be better?

The timeout issue persists for 2 attempts. So, need to check colima stop or colima delete is efficient.

So on 3rd attempt, it will stop, and 4th attempt it will delete.

Also, why delete after 3 attempts when the maximum number of attempts is 4?

a fall back method

[SmartManoj]

Another failed action

[neubig]

Thanks! But do we know why colima is failing? Do we have any evidence that this actually fixes the problem? It seems like this is trying things out without any guarantee that this actually fixes the problem...

[SmartManoj]

do we know why colima is failing?

Due to Github actions resource contention? lima-vm/lima#2455 (comment)

[neubig]

I think this is probably fixed by #3097 , so let's close this for now. If we still end up getting flaky tests we could reconsider!

[SmartManoj]

I think this is probably fixed by #3097

It didn't. #3097 (comment)

[SmartManoj]

CC: @tobitege

[tobitege]

Shouldn't it delete after every failed attempt (except the last one), like this?

if [ $i -lt $ATTEMPT_LIMIT ]; then

[SmartManoj]

Yes but if [ $i -lt $ATTEMPT_LIMIT ]; then it will delete.

[tobitege]

Ok, I'll change that in my PR then

[SmartManoj]

, like this?

Did you mean unlike this?