raft/rafttest: TestBasicProgress failed

[cockroach-teamcity]

raft/rafttest.TestBasicProgress failed with artifacts on release-24.2 @ 35538e048969d6d7937d6128dfd20ecdb4eb79d3:

I240906 14:07:18.538678 294 (gostd) node.go:100  [-] 2  raft.2: stop
I240906 14:07:18.538695 296 (gostd) node.go:100  [-] 3  raft.3: stop
I240906 14:07:18.538708 298 (gostd) node.go:100  [-] 4  raft.4: stop
I240906 14:07:18.538722 300 (gostd) node.go:100  [-] 5  raft.5: stop
raft2024/09/06 14:07:18 INFO: 1 switched to configuration voters=()
raft2024/09/06 14:07:18 INFO: 1 became follower at term 0
raft2024/09/06 14:07:18 INFO: newRaft 1 [peers: [], term: 0, commit: 0, applied: 0, lastindex: 0, lastterm: 0]
raft2024/09/06 14:07:18 INFO: 1 became follower at term 1
raft2024/09/06 14:07:18 INFO: 1 switched to configuration voters=(1)
raft2024/09/06 14:07:18 INFO: 1 switched to configuration voters=(1 2)
raft2024/09/06 14:07:18 INFO: 1 switched to configuration voters=(1 2 3)
raft2024/09/06 14:07:18 INFO: 1 switched to configuration voters=(1 2 3 4)
raft2024/09/06 14:07:18 INFO: 1 switched to configuration voters=(1 2 3 4 5)
raft2024/09/06 14:07:18 INFO: 2 switched to configuration voters=()
raft2024/09/06 14:07:18 INFO: 2 became follower at term 0
raft2024/09/06 14:07:18 INFO: newRaft 2 [peers: [], term: 0, commit: 0, applied: 0, lastindex: 0, lastterm: 0]
raft2024/09/06 14:07:18 INFO: 2 became follower at term 1
raft2024/09/06 14:07:18 INFO: 2 switched to configuration voters=(1)
raft2024/09/06 14:07:18 INFO: 2 switched to configuration voters=(1 2)
raft2024/09/06 14:07:18 INFO: 2 switched to configuration voters=(1 2 3)
raft2024/09/06 14:07:18 INFO: 2 switched to configuration voters=(1 2 3 4)
raft2024/09/06 14:07:18 INFO: 2 switched to configuration voters=(1 2 3 4 5)
raft2024/09/06 14:07:18 INFO: 3 switched to configuration voters=()
raft2024/09/06 14:07:18 INFO: 3 became follower at term 0
raft2024/09/06 14:07:18 INFO: newRaft 3 [peers: [], term: 0, commit: 0, applied: 0, lastindex: 0, lastterm: 0]
raft2024/09/06 14:07:18 INFO: 3 became follower at term 1
raft2024/09/06 14:07:18 INFO: 3 switched to configuration voters=(1)
raft2024/09/06 14:07:18 INFO: 3 switched to configuration voters=(1 2)
raft2024/09/06 14:07:18 INFO: 3 switched to configuration voters=(1 2 3)
raft2024/09/06 14:07:18 INFO: 3 switched to configuration voters=(1 2 3 4)
raft2024/09/06 14:07:18 INFO: 3 switched to configuration voters=(1 2 3 4 5)
raft2024/09/06 14:07:18 INFO: 4 switched to configuration voters=()
raft2024/09/06 14:07:18 INFO: 4 became follower at term 0
raft2024/09/06 14:07:18 INFO: newRaft 4 [peers: [], term: 0, commit: 0, applied: 0, lastindex: 0, lastterm: 0]
raft2024/09/06 14:07:18 INFO: 4 became follower at term 1
raft2024/09/06 14:07:18 INFO: 4 switched to configuration voters=(1)
raft2024/09/06 14:07:18 INFO: 4 switched to configuration voters=(1 2)
raft2024/09/06 14:07:18 INFO: 4 switched to configuration voters=(1 2 3)
raft2024/09/06 14:07:18 INFO: 4 switched to configuration voters=(1 2 3 4)
raft2024/09/06 14:07:18 INFO: 4 switched to configuration voters=(1 2 3 4 5)
raft2024/09/06 14:07:18 INFO: 5 switched to configuration voters=()
raft2024/09/06 14:07:18 INFO: 5 became follower at term 0
raft2024/09/06 14:07:18 INFO: newRaft 5 [peers: [], term: 0, commit: 0, applied: 0, lastindex: 0, lastterm: 0]
raft2024/09/06 14:07:18 INFO: 5 became follower at term 1
raft2024/09/06 14:07:18 INFO: 5 switched to configuration voters=(1)
raft2024/09/06 14:07:18 INFO: 5 switched to configuration voters=(1 2)
raft2024/09/06 14:07:18 INFO: 5 switched to configuration voters=(1 2 3)
raft2024/09/06 14:07:18 INFO: 5 switched to configuration voters=(1 2 3 4)
raft2024/09/06 14:07:18 INFO: 5 switched to configuration voters=(1 2 3 4 5)
--- FAIL: TestBasicProgress (5.21s)

Help

See also: How To Investigate a Go Test Failure (internal)

/cc @cockroachdb/kv

This test on roachdash | Improve this report!

Jira issue: CRDB-41954

[miraradeva]

@pav-kv does this look the same as #121745?

I see a leader change in the test:

raft2024/09/06 14:07:13 INFO: 4 became leader at term 2
...
raft2024/09/06 14:07:13 INFO: 2 became leader at term 4
...
raft2024/09/06 14:07:13 INFO: found conflict at index 11 [existing term: 2, conflicting term: 4]
raft2024/09/06 14:07:13 INFO: replace the unstable entries from index 11

[pav-kv]

Looks like it. Fixed by #130084.

[nvanbenschoten]

Closed by #130259.