Hot fix: [server] Use thread safe map for versioned stats in SN read … #3837
6838 tests run, 6828 passed, 0 skipped, 10 failed.
Annotations
github-actions / JUnit Test Report
SITWithPWiseAndBufferAfterLeaderTest.testResubscribeAfterRoleChange
org.mockito.exceptions.verification.TooFewActualInvocations:
activeActiveStoreIngestionTask.resubscribeForAllPartitions();
Wanted 4 times:
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.resubscribeForAllPartitions(StoreIngestionTask.java:616)
But was 3 times:
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.updateIngestionRoleIfStoreChanged(StoreIngestionTask.java:1543)
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.updateIngestionRoleIfStoreChanged(StoreIngestionTask.java:1543)
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.updateIngestionRoleIfStoreChanged(StoreIngestionTask.java:1543)
Raw output
org.mockito.exceptions.verification.TooFewActualInvocations:
activeActiveStoreIngestionTask.resubscribeForAllPartitions();
Wanted 4 times:
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.resubscribeForAllPartitions(StoreIngestionTask.java:616)
But was 3 times:
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.updateIngestionRoleIfStoreChanged(StoreIngestionTask.java:1543)
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.updateIngestionRoleIfStoreChanged(StoreIngestionTask.java:1543)
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.updateIngestionRoleIfStoreChanged(StoreIngestionTask.java:1543)
at app//com.linkedin.davinci.kafka.consumer.StoreIngestionTask.resubscribeForAllPartitions(StoreIngestionTask.java:616)
at app//com.linkedin.davinci.kafka.consumer.StoreIngestionTaskTest.lambda$testResubscribeAfterRoleChange$107(StoreIngestionTaskTest.java:4092)
at app//com.linkedin.davinci.kafka.consumer.StoreIngestionTaskTest.runTest(StoreIngestionTaskTest.java:885)
at app//com.linkedin.davinci.kafka.consumer.StoreIngestionTaskTest.runTest(StoreIngestionTaskTest.java:778)
at app//com.linkedin.davinci.kafka.consumer.StoreIngestionTaskTest.testResubscribeAfterRoleChange(StoreIngestionTaskTest.java:4114)
github-actions / JUnit Test Report
SITWithPWiseWithoutBufferAfterLeaderTest.testProcessConsumerActionsError
Wanted but not invoked:
leaderFollowerStoreIngestionTask.reportError(
<any string>,
1,
<Capturing argument>
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.reportError(StoreIngestionTask.java:4221)
However, there were exactly 36 interactions with this mock:
leaderFollowerStoreIngestionTask.subscribePartition(
TestTopic_794c07675b_653cf70c_v1-1
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTaskTest.runTest(StoreIngestionTaskTest.java:878)
leaderFollowerStoreIngestionTask.subscribePartition(
TestTopic_794c07675b_653cf70c_v1-1,
true
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.subscribePartition(StoreIngestionTask.java:612)
leaderFollowerStoreIngestionTask.throwIfNotRunning();
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.subscribePartition(StoreIngestionTask.java:626)
leaderFollowerStoreIngestionTask.isRunning();
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.throwIfNotRunning(StoreIngestionTask.java:573)
leaderFollowerStoreIngestionTask.getIsRunning();
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.isRunning(StoreIngestionTask.java:4054)
leaderFollowerStoreIngestionTask.nextSeqNum();
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.subscribePartition(StoreIngestionTask.java:635)
leaderFollowerStoreIngestionTask.run();
-> at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
leaderFollowerStoreIngestionTask.isRunning();
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.run(StoreIngestionTask.java:1611)
leaderFollowerStoreIngestionTask.getIsRunning();
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.isRunning(StoreIngestionTask.java:4054)
leaderFollowerStoreIngestionTask.updateIngestionRoleIfStoreChanged(
Mock for Store, hashCode: 204751491
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.run(StoreIngestionTask.java:1613)
leaderFollowerStoreIngestionTask.isHybridMode();
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.updateIngestionRoleIfStoreChanged(StoreIngestionTask.java:1530)
leaderFollowerStoreIngestionTask.processConsumerActions(
Mock for Store, hashCode: 204751491
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.run(StoreIngestionTask.java:1614)
leaderFollowerStoreIngestionTask.processConsumerAction(
KafkaTaskMessage{type=SUBSCRIBE, topicPartition=TestTopic_794c07675b_653cf70c_v1-1, attempts=3, sequenceNumber=1, createdTimestampInMs=1735866819331},
Mock for Store, hashCode: 204751491
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.processConsumerActions(StoreIngestionTask.java:1893)
leaderFollowerStoreIngestionTask.processCommonConsumerAction(
KafkaTaskMessage{type=SUBSCRIBE, topicPartition=TestTopic_794c07675b_653cf70c_v1-1, attempts=3, sequenceNumber=1, createdTimestampInMs=1735866819331}
);
-> at com.linkedin.davinci.kafka.consumer.LeaderFollowerStoreIngestionTask.processConsumerAction(LeaderFollowerStoreIngestionTask.java:569)
leaderFollowerStoreIngestionTask.reportIfCatchUpVersionTopicOffset(
PCS{replicaId=TestTopic_794c07675b_653cf70c_v1-1, hybrid=false, latestProcessedLocalVersionTopicOffset=-1, latestProcessedUpstreamVersionTopicOffset=-1, latestProcessedUpstreamRTOffsetMap={}, latestIgnoredUpstreamRTOffsetMap={}, latestRTOffsetTriedToProduceToVTMap{}, offsetRecord=OffsetRecord{localVersionTopicOffset=-1, upstreamOffset=-1, leaderTopic=null, offsetLag=0, eventTimeEpochMs=-1, latestProducerProcessingTimeInMs=0, isEndOfPushReceived=false, databaseInfo={}, realTimeProducerState={}}, errorReported=false, started=false, lagCaughtUp=false, processedRecordSizeSinceLastSync=0, leaderFollowerState=STANDBY}
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.processCommonConsumerAction(StoreIngestionTask.java:2137)
leaderFollowerStoreIngestionTask.updateLeaderTopicOnFollower(
PCS{replicaId=TestTopic_794c07675b_653cf70c_v1-1, hybrid=false, latestProcessedLocalVersionTopicOffset=-1, latestProcessedUpstreamVersionTopicOffset=-1, latestProcessedUpstreamRTOffsetMap={}, latestIgnoredUpstreamRTOffsetMap={}, latestRTOffsetTriedToProduceToVTMap{}, offsetRecord=OffsetRecord{localVersionTopicOffset=-1, upstreamOffset=-1, leaderTopic=null, offsetLag=0, eventTimeEpochMs=-1, latestProducerProcessingTimeInMs=0, isEndOfPushReceived=false, databaseInfo={}, realTimeProducerState={}}, errorReported=false, started=false, lagCaughtUp=false, processedRecordSizeSinceLastSync=0, leaderFollowerState=STANDBY}
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.processCommonConsumerAction(StoreIngestionTask.java:2142)
leaderFollowerStoreIngestionTask.consumerSubscribe(
TestTopic_794c07675b_653cf70c_v1,
PCS{replicaId=TestTopic_794c07675b_653cf70c_v1-1, hybrid=false, latestProcessedLocalVersionTopicOffset=-1, latestProcessedUpstreamVersionTopicOffset=-1, latestProcessedUpstreamRTOffsetMap={}, latestIgnoredUpstreamRTOffsetMap={}, latestRTOffsetTriedToProduceToVTMap{}, offsetRecord=OffsetRecord{localVersionTopicOffset=-1, upstreamOffset=-1, leaderTopic=null, offsetLag=0, eventTimeEpochMs=-1, latestProducerProcessingTimeInMs=0, isEndOfPushReceived=false, databaseInfo={}, realTimeProducerState={}}, errorReported=false, started=false, lagCaughtUp=false, processedRecordSizeSinceLastSync=0, leaderFollowerState=STANDBY},
-1L,
"local_InMemoryKafkaBroker:33145"
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.processCommonConsumerAction(StoreIngestionTask.java:2146)
leaderFollowerStoreIngestionTask.resolveTopicPartitionWithKafkaURL(
TestTopic_794c07675b_653cf70c_v1,
PCS{replicaId=TestTopic_794c07675b_653cf70c_v1-1, hybrid=false, latestProcessedLocalVersionTopicOffset=-1, latestProcessedUpstreamVersionTopicOffset=-1, latestProcessedUpstreamRTOffsetMap={}, latestIgnoredUpstreamRTOffsetMap={}, latestRTOffsetTriedToProduceToVTMap{}, offsetRecord=OffsetRecord{localVersionTopicOffset=-1, upstreamOffset=-1, leaderTopic=null, offsetLag=0, eventTimeEpochMs=-1, latestProducerProcessingTimeInMs=0, isEndOfPushReceived=false, databaseInfo={}, realTimeProducerState={}}, errorReported=false, started=false, lagCaughtUp=false, processedRecordSizeSinceLastSync=0, leaderFollowerState=STANDBY},
"local_InMemoryKafkaBroker:33145"
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.consumerSubscribe(StoreIngestionTask.java:3544)
leaderFollowerStoreIngestionTask.resolveTopicWithKafkaURL(
TestTopic_794c07675b_653cf70c_v1,
"local_InMemoryKafkaBroker:33145"
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.resolveTopicPartitionWithKafkaURL(StoreIngestionTask.java:4534)
leaderFollowerStoreIngestionTask.consumerSubscribe(
TestTopic_794c07675b_653cf70c_v1-1,
-1L,
"local_InMemoryKafkaBroker:33145"
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.consumerSubscribe(StoreIngestionTask.java:3545)
leaderFollowerStoreIngestionTask.createKafkaConsumerProperties(
{"kafka.bootstrap.servers" = "local_InMemoryKafkaBroker:33145"},
"local_InMemoryKafkaBroker:33145",
false
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.consumerSubscribe(StoreIngestionTask.java:3557)
leaderFollowerStoreIngestionTask.getVersionTopic();
-> at com.linkedin.davinci.kafka.consumer.StorePartitionDataReceiver.destinationIdentifier(StorePartitionDataReceiver.java:86)
leaderFollowerStoreIngestionTask.getVersionTopic();
-> at com.linkedin.davinci.kafka.consumer.StorePartitionDataReceiver.destinationIdentifier(StorePartitionDataReceiver.java:86)
leaderFollowerStoreIngestionTask.processConsumerActions(
Mock for Store, hashCode: 204751491
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTaskTest.lambda$testProcessConsumerActionsError$153(StoreIngestionTaskTest.java:5158)
leaderFollowerStoreIngestionTask.processConsumerAction(
KafkaTaskMessage{type=SUBSCRIBE, topicPartition=TestTopic_794c07675b_653cf70c_v1-1, attempts=3, sequenceNumber=1, createdTimestampInMs=1735866819331},
Mock for Store, hashCode: 204751491
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.processConsumerActions(StoreIngestionTask.java:1893)
leaderFollowerStoreIngestionTask.processCommonConsumerAction(
KafkaTaskMessage{type=SUBSCRIBE, topicPartition=TestTopic_794c07675b_653cf70c_v1-1, attempts=3, sequenceNumber=1, createdTimestampInMs=1735866819331}
);
-> at com.linkedin.davinci.kafka.consumer.LeaderFollowerStoreIngestionTask.processConsumerAction(LeaderFollowerStoreIngestionTask.java:569)
leaderFollowerStoreIngestionTask.processConsumerActions(
Mock for Store, hashCode: 204751491
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTaskTest.lambda$testProcessConsumerActionsError$153(StoreIngestionTaskTest.java:5158)
leaderFollowerStoreIngestionTask.processConsumerAction(
KafkaTaskMessage{type=SUBSCRIBE, topicPartition=TestTopic_794c07675b_653cf70c_v1-1, attempts=3, sequenceNumber=1, createdTimestampInMs=1735866819331},
Mock for Store, hashCode: 204751491
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.processConsumerActions(StoreIngestionTask.java:1893)
leaderFollowerStoreIngestionTask.processCommonConsumerAction(
KafkaTaskMessage{type=SUBSCRIBE, topicPartition=TestTopic_794c07675b_653cf70c_v1-1, attempts=3, sequenceNumber=1, createdTimestampInMs=1735866819331}
);
-> at com.linkedin.davinci.kafka.consumer.LeaderFollowerStoreIngestionTask.processConsumerAction(LeaderFollowerStoreIngestionTask.java:569)
leaderFollowerStoreIngestionTask.checkLongRunningTaskState();
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.run(StoreIngestionTask.java:1615)
leaderFollowerStoreIngestionTask.getVersionTopic();
-> at com.linkedin.davinci.kafka.consumer.LeaderFollowerStoreIngestionTask.checkLongRunningTaskState(LeaderFollowerStoreIngestionTask.java:767)
leaderFollowerStoreIngestionTask.checkIngestionProgress(
Mock for Store, hashCode: 204751491
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.run(StoreIngestionTask.java:1616)
leaderFollowerStoreIngestionTask.consumerHasAnySubscription();
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.checkIngestionProgress(StoreIngestionTask.java:1483)
leaderFollowerStoreIngestionTask.processConsumerActions(
Mock for Store, hashCode: 204751491
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTaskTest.lambda$testProcessConsumerActionsError$153(StoreIngestionTaskTest.java:5158)
leaderFollowerStoreIngestionTask.processConsumerActions(
Mock for Store, hashCode: 204751491
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTaskTest.lambda$testProcessConsumerActionsError$153(StoreIngestionTaskTest.java:5158)
leaderFollowerStoreIngestionTask.processConsumerActions(
Mock for Store, hashCode: 204751491
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTaskTest.lambda$testProcessConsumerActionsError$153(StoreIngestionTaskTest.java:5158)
Raw output
Wanted but not invoked:
leaderFollowerStoreIngestionTask.reportError(
<any string>,
1,
<Capturing argument>
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.reportError(StoreIngestionTask.java:4221)
However, there were exactly 36 interactions with this mock:
leaderFollowerStoreIngestionTask.subscribePartition(
TestTopic_794c07675b_653cf70c_v1-1
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTaskTest.runTest(StoreIngestionTaskTest.java:878)
leaderFollowerStoreIngestionTask.subscribePartition(
TestTopic_794c07675b_653cf70c_v1-1,
true
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.subscribePartition(StoreIngestionTask.java:612)
leaderFollowerStoreIngestionTask.throwIfNotRunning();
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.subscribePartition(StoreIngestionTask.java:626)
leaderFollowerStoreIngestionTask.isRunning();
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.throwIfNotRunning(StoreIngestionTask.java:573)
leaderFollowerStoreIngestionTask.getIsRunning();
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.isRunning(StoreIngestionTask.java:4054)
leaderFollowerStoreIngestionTask.nextSeqNum();
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.subscribePartition(StoreIngestionTask.java:635)
leaderFollowerStoreIngestionTask.run();
-> at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
leaderFollowerStoreIngestionTask.isRunning();
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.run(StoreIngestionTask.java:1611)
leaderFollowerStoreIngestionTask.getIsRunning();
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.isRunning(StoreIngestionTask.java:4054)
leaderFollowerStoreIngestionTask.updateIngestionRoleIfStoreChanged(
Mock for Store, hashCode: 204751491
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.run(StoreIngestionTask.java:1613)
leaderFollowerStoreIngestionTask.isHybridMode();
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.updateIngestionRoleIfStoreChanged(StoreIngestionTask.java:1530)
leaderFollowerStoreIngestionTask.processConsumerActions(
Mock for Store, hashCode: 204751491
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.run(StoreIngestionTask.java:1614)
leaderFollowerStoreIngestionTask.processConsumerAction(
KafkaTaskMessage{type=SUBSCRIBE, topicPartition=TestTopic_794c07675b_653cf70c_v1-1, attempts=3, sequenceNumber=1, createdTimestampInMs=1735866819331},
Mock for Store, hashCode: 204751491
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.processConsumerActions(StoreIngestionTask.java:1893)
leaderFollowerStoreIngestionTask.processCommonConsumerAction(
KafkaTaskMessage{type=SUBSCRIBE, topicPartition=TestTopic_794c07675b_653cf70c_v1-1, attempts=3, sequenceNumber=1, createdTimestampInMs=1735866819331}
);
-> at com.linkedin.davinci.kafka.consumer.LeaderFollowerStoreIngestionTask.processConsumerAction(LeaderFollowerStoreIngestionTask.java:569)
leaderFollowerStoreIngestionTask.reportIfCatchUpVersionTopicOffset(
PCS{replicaId=TestTopic_794c07675b_653cf70c_v1-1, hybrid=false, latestProcessedLocalVersionTopicOffset=-1, latestProcessedUpstreamVersionTopicOffset=-1, latestProcessedUpstreamRTOffsetMap={}, latestIgnoredUpstreamRTOffsetMap={}, latestRTOffsetTriedToProduceToVTMap{}, offsetRecord=OffsetRecord{localVersionTopicOffset=-1, upstreamOffset=-1, leaderTopic=null, offsetLag=0, eventTimeEpochMs=-1, latestProducerProcessingTimeInMs=0, isEndOfPushReceived=false, databaseInfo={}, realTimeProducerState={}}, errorReported=false, started=false, lagCaughtUp=false, processedRecordSizeSinceLastSync=0, leaderFollowerState=STANDBY}
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.processCommonConsumerAction(StoreIngestionTask.java:2137)
leaderFollowerStoreIngestionTask.updateLeaderTopicOnFollower(
PCS{replicaId=TestTopic_794c07675b_653cf70c_v1-1, hybrid=false, latestProcessedLocalVersionTopicOffset=-1, latestProcessedUpstreamVersionTopicOffset=-1, latestProcessedUpstreamRTOffsetMap={}, latestIgnoredUpstreamRTOffsetMap={}, latestRTOffsetTriedToProduceToVTMap{}, offsetRecord=OffsetRecord{localVersionTopicOffset=-1, upstreamOffset=-1, leaderTopic=null, offsetLag=0, eventTimeEpochMs=-1, latestProducerProcessingTimeInMs=0, isEndOfPushReceived=false, databaseInfo={}, realTimeProducerState={}}, errorReported=false, started=false, lagCaughtUp=false, processedRecordSizeSinceLastSync=0, leaderFollowerState=STANDBY}
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.processCommonConsumerAction(StoreIngestionTask.java:2142)
leaderFollowerStoreIngestionTask.consumerSubscribe(
TestTopic_794c07675b_653cf70c_v1,
PCS{replicaId=TestTopic_794c07675b_653cf70c_v1-1, hybrid=false, latestProcessedLocalVersionTopicOffset=-1, latestProcessedUpstreamVersionTopicOffset=-1, latestProcessedUpstreamRTOffsetMap={}, latestIgnoredUpstreamRTOffsetMap={}, latestRTOffsetTriedToProduceToVTMap{}, offsetRecord=OffsetRecord{localVersionTopicOffset=-1, upstreamOffset=-1, leaderTopic=null, offsetLag=0, eventTimeEpochMs=-1, latestProducerProcessingTimeInMs=0, isEndOfPushReceived=false, databaseInfo={}, realTimeProducerState={}}, errorReported=false, started=false, lagCaughtUp=false, processedRecordSizeSinceLastSync=0, leaderFollowerState=STANDBY},
-1L,
"local_InMemoryKafkaBroker:33145"
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.processCommonConsumerAction(StoreIngestionTask.java:2146)
leaderFollowerStoreIngestionTask.resolveTopicPartitionWithKafkaURL(
TestTopic_794c07675b_653cf70c_v1,
PCS{replicaId=TestTopic_794c07675b_653cf70c_v1-1, hybrid=false, latestProcessedLocalVersionTopicOffset=-1, latestProcessedUpstreamVersionTopicOffset=-1, latestProcessedUpstreamRTOffsetMap={}, latestIgnoredUpstreamRTOffsetMap={}, latestRTOffsetTriedToProduceToVTMap{}, offsetRecord=OffsetRecord{localVersionTopicOffset=-1, upstreamOffset=-1, leaderTopic=null, offsetLag=0, eventTimeEpochMs=-1, latestProducerProcessingTimeInMs=0, isEndOfPushReceived=false, databaseInfo={}, realTimeProducerState={}}, errorReported=false, started=false, lagCaughtUp=false, processedRecordSizeSinceLastSync=0, leaderFollowerState=STANDBY},
"local_InMemoryKafkaBroker:33145"
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.consumerSubscribe(StoreIngestionTask.java:3544)
leaderFollowerStoreIngestionTask.resolveTopicWithKafkaURL(
TestTopic_794c07675b_653cf70c_v1,
"local_InMemoryKafkaBroker:33145"
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.resolveTopicPartitionWithKafkaURL(StoreIngestionTask.java:4534)
leaderFollowerStoreIngestionTask.consumerSubscribe(
TestTopic_794c07675b_653cf70c_v1-1,
-1L,
"local_InMemoryKafkaBroker:33145"
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.consumerSubscribe(StoreIngestionTask.java:3545)
leaderFollowerStoreIngestionTask.createKafkaConsumerProperties(
{"kafka.bootstrap.servers" = "local_InMemoryKafkaBroker:33145"},
"local_InMemoryKafkaBroker:33145",
false
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.consumerSubscribe(StoreIngestionTask.java:3557)
leaderFollowerStoreIngestionTask.getVersionTopic();
-> at com.linkedin.davinci.kafka.consumer.StorePartitionDataReceiver.destinationIdentifier(StorePartitionDataReceiver.java:86)
leaderFollowerStoreIngestionTask.getVersionTopic();
-> at com.linkedin.davinci.kafka.consumer.StorePartitionDataReceiver.destinationIdentifier(StorePartitionDataReceiver.java:86)
leaderFollowerStoreIngestionTask.processConsumerActions(
Mock for Store, hashCode: 204751491
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTaskTest.lambda$testProcessConsumerActionsError$153(StoreIngestionTaskTest.java:5158)
leaderFollowerStoreIngestionTask.processConsumerAction(
KafkaTaskMessage{type=SUBSCRIBE, topicPartition=TestTopic_794c07675b_653cf70c_v1-1, attempts=3, sequenceNumber=1, createdTimestampInMs=1735866819331},
Mock for Store, hashCode: 204751491
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.processConsumerActions(StoreIngestionTask.java:1893)
leaderFollowerStoreIngestionTask.processCommonConsumerAction(
KafkaTaskMessage{type=SUBSCRIBE, topicPartition=TestTopic_794c07675b_653cf70c_v1-1, attempts=3, sequenceNumber=1, createdTimestampInMs=1735866819331}
);
-> at com.linkedin.davinci.kafka.consumer.LeaderFollowerStoreIngestionTask.processConsumerAction(LeaderFollowerStoreIngestionTask.java:569)
leaderFollowerStoreIngestionTask.processConsumerActions(
Mock for Store, hashCode: 204751491
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTaskTest.lambda$testProcessConsumerActionsError$153(StoreIngestionTaskTest.java:5158)
leaderFollowerStoreIngestionTask.processConsumerAction(
KafkaTaskMessage{type=SUBSCRIBE, topicPartition=TestTopic_794c07675b_653cf70c_v1-1, attempts=3, sequenceNumber=1, createdTimestampInMs=1735866819331},
Mock for Store, hashCode: 204751491
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.processConsumerActions(StoreIngestionTask.java:1893)
leaderFollowerStoreIngestionTask.processCommonConsumerAction(
KafkaTaskMessage{type=SUBSCRIBE, topicPartition=TestTopic_794c07675b_653cf70c_v1-1, attempts=3, sequenceNumber=1, createdTimestampInMs=1735866819331}
);
-> at com.linkedin.davinci.kafka.consumer.LeaderFollowerStoreIngestionTask.processConsumerAction(LeaderFollowerStoreIngestionTask.java:569)
leaderFollowerStoreIngestionTask.checkLongRunningTaskState();
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.run(StoreIngestionTask.java:1615)
leaderFollowerStoreIngestionTask.getVersionTopic();
-> at com.linkedin.davinci.kafka.consumer.LeaderFollowerStoreIngestionTask.checkLongRunningTaskState(LeaderFollowerStoreIngestionTask.java:767)
leaderFollowerStoreIngestionTask.checkIngestionProgress(
Mock for Store, hashCode: 204751491
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.run(StoreIngestionTask.java:1616)
leaderFollowerStoreIngestionTask.consumerHasAnySubscription();
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.checkIngestionProgress(StoreIngestionTask.java:1483)
leaderFollowerStoreIngestionTask.processConsumerActions(
Mock for Store, hashCode: 204751491
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTaskTest.lambda$testProcessConsumerActionsError$153(StoreIngestionTaskTest.java:5158)
leaderFollowerStoreIngestionTask.processConsumerActions(
Mock for Store, hashCode: 204751491
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTaskTest.lambda$testProcessConsumerActionsError$153(StoreIngestionTaskTest.java:5158)
leaderFollowerStoreIngestionTask.processConsumerActions(
Mock for Store, hashCode: 204751491
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTaskTest.lambda$testProcessConsumerActionsError$153(StoreIngestionTaskTest.java:5158)
at app//com.linkedin.davinci.kafka.consumer.StoreIngestionTask.reportError(StoreIngestionTask.java:4221)
at app//com.linkedin.davinci.kafka.consumer.StoreIngestionTaskTest.lambda$testProcessConsumerActionsError$153(StoreIngestionTaskTest.java:5164)
at app//com.linkedin.davinci.kafka.consumer.StoreIngestionTaskTest.runTest(StoreIngestionTaskTest.java:885)
at app//com.linkedin.davinci.kafka.consumer.StoreIngestionTaskTest.runTest(StoreIngestionTaskTest.java:778)
at app//com.linkedin.davinci.kafka.consumer.StoreIngestionTaskTest.runTest(StoreIngestionTaskTest.java:638)
at app//com.linkedin.davinci.kafka.consumer.StoreIngestionTaskTest.testProcessConsumerActionsError(StoreIngestionTaskTest.java:5150)
github-actions / JUnit Test Report
TestRemoteIngestionRepairService.testIngestionRepairService
java.lang.AssertionError: expected [2] but found [1]
Raw output
java.lang.AssertionError: expected [2] but found [1]
at org.testng.Assert.fail(Assert.java:96)
at org.testng.Assert.failNotEquals(Assert.java:776)
at org.testng.Assert.assertEqualsImpl(Assert.java:137)
at org.testng.Assert.assertEquals(Assert.java:118)
at org.testng.Assert.assertEquals(Assert.java:652)
at org.testng.Assert.assertEquals(Assert.java:662)
at com.linkedin.davinci.kafka.consumer.TestRemoteIngestionRepairService.testIngestionRepairService(TestRemoteIngestionRepairService.java:25)
github-actions / JUnit Test Report
NativeMetadataRepositoryTest.testNativeMetadataRepositoryStats
java.lang.AssertionError: expected [2000.0] but found [1000.0]
Raw output
java.lang.AssertionError: expected [2000.0] but found [1000.0]
at org.testng.Assert.fail(Assert.java:96)
at org.testng.Assert.failNotEquals(Assert.java:776)
at org.testng.Assert.assertEqualsImpl(Assert.java:137)
at org.testng.Assert.assertEquals(Assert.java:118)
at org.testng.Assert.assertEquals(Assert.java:442)
at com.linkedin.davinci.repository.NativeMetadataRepositoryTest.lambda$testNativeMetadataRepositoryStats$5(NativeMetadataRepositoryTest.java:136)
at com.linkedin.venice.utils.TestUtils.waitForNonDeterministicAssertion(TestUtils.java:243)
at com.linkedin.venice.utils.TestUtils.waitForNonDeterministicAssertion(TestUtils.java:228)
at com.linkedin.venice.utils.TestUtils.waitForNonDeterministicAssertion(TestUtils.java:220)
at com.linkedin.davinci.repository.NativeMetadataRepositoryTest.testNativeMetadataRepositoryStats(NativeMetadataRepositoryTest.java:133)
github-actions / JUnit Test Report
BatchGetAvroStoreClientUnitTest.testSimpleStreamingBatchGet
org.testng.internal.thread.ThreadTimeoutException: Method com.linkedin.venice.fastclient.BatchGetAvroStoreClientUnitTest.testSimpleStreamingBatchGet() didn't finish within the time-out 5000
Raw output
org.testng.internal.thread.ThreadTimeoutException: Method com.linkedin.venice.fastclient.BatchGetAvroStoreClientUnitTest.testSimpleStreamingBatchGet() didn't finish within the time-out 5000
at app//org.apache.logging.log4j.core.Logger.$jacocoInit(Logger.java)
at app//org.apache.logging.log4j.core.Logger.requiresLocation(Logger.java)
at app//org.apache.logging.log4j.spi.AbstractLogger.getLocation(AbstractLogger.java:2216)
at app//org.apache.logging.log4j.spi.AbstractLogger.logMessageTrackRecursion(AbstractLogger.java:2159)
at app//org.apache.logging.log4j.spi.AbstractLogger.logMessageSafely(AbstractLogger.java:2142)
at app//org.apache.logging.log4j.spi.AbstractLogger.logMessage(AbstractLogger.java:2046)
at app//org.apache.logging.log4j.spi.AbstractLogger.logIfEnabled(AbstractLogger.java:1915)
at app//org.apache.logging.log4j.spi.AbstractLogger.info(AbstractLogger.java:1454)
at app//com.linkedin.venice.fastclient.utils.TestClientSimulator.restRequest(TestClientSimulator.java:266)
at app//com.linkedin.venice.fastclient.transport.R2TransportClient.post(R2TransportClient.java:51)
at app//com.linkedin.venice.fastclient.DispatchingAvroGenericStoreClient.multiKeyStreamingRequest(DispatchingAvroGenericStoreClient.java:479)
at app//com.linkedin.venice.fastclient.DispatchingAvroGenericStoreClient.streamingBatchGet(DispatchingAvroGenericStoreClient.java:365)
at app//com.linkedin.venice.fastclient.DelegatingAvroStoreClient.streamingBatchGet(DelegatingAvroStoreClient.java:99)
at app//com.linkedin.venice.fastclient.StatsAvroGenericStoreClient.streamingBatchGet(StatsAvroGenericStoreClient.java:70)
at app//com.linkedin.venice.fastclient.InternalAvroStoreClient.streamingBatchGet(InternalAvroStoreClient.java:65)
at app//com.linkedin.venice.fastclient.BatchGetAvroStoreClientUnitTest.callStreamingBatchGetAndVerifyResults(BatchGetAvroStoreClientUnitTest.java:770)
at app//com.linkedin.venice.fastclient.BatchGetAvroStoreClientUnitTest.callStreamingBatchGetAndVerifyResults(BatchGetAvroStoreClientUnitTest.java:759)
at app//com.linkedin.venice.fastclient.BatchGetAvroStoreClientUnitTest.testSimpleStreamingBatchGet(BatchGetAvroStoreClientUnitTest.java:65)
github-actions / JUnit Test Report
SITWithPWiseAndBufferAfterLeaderTest.testResubscribeAfterRoleChange
org.mockito.exceptions.verification.TooFewActualInvocations:
activeActiveStoreIngestionTask.resubscribeForAllPartitions();
Wanted 4 times:
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.resubscribeForAllPartitions(StoreIngestionTask.java:616)
But was 3 times:
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.updateIngestionRoleIfStoreChanged(StoreIngestionTask.java:1543)
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.updateIngestionRoleIfStoreChanged(StoreIngestionTask.java:1543)
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.updateIngestionRoleIfStoreChanged(StoreIngestionTask.java:1543)
Raw output
org.mockito.exceptions.verification.TooFewActualInvocations:
activeActiveStoreIngestionTask.resubscribeForAllPartitions();
Wanted 4 times:
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.resubscribeForAllPartitions(StoreIngestionTask.java:616)
But was 3 times:
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.updateIngestionRoleIfStoreChanged(StoreIngestionTask.java:1543)
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.updateIngestionRoleIfStoreChanged(StoreIngestionTask.java:1543)
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.updateIngestionRoleIfStoreChanged(StoreIngestionTask.java:1543)
at app//com.linkedin.davinci.kafka.consumer.StoreIngestionTask.resubscribeForAllPartitions(StoreIngestionTask.java:616)
at app//com.linkedin.davinci.kafka.consumer.StoreIngestionTaskTest.lambda$testResubscribeAfterRoleChange$107(StoreIngestionTaskTest.java:4092)
at app//com.linkedin.davinci.kafka.consumer.StoreIngestionTaskTest.runTest(StoreIngestionTaskTest.java:885)
at app//com.linkedin.davinci.kafka.consumer.StoreIngestionTaskTest.runTest(StoreIngestionTaskTest.java:778)
at app//com.linkedin.davinci.kafka.consumer.StoreIngestionTaskTest.testResubscribeAfterRoleChange(StoreIngestionTaskTest.java:4114)
github-actions / JUnit Test Report
SITWithPWiseWithoutBufferAfterLeaderTest.testProcessConsumerActionsError
Wanted but not invoked:
leaderFollowerStoreIngestionTask.reportError(
<any string>,
1,
<Capturing argument>
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.reportError(StoreIngestionTask.java:4221)
However, there were exactly 36 interactions with this mock:
leaderFollowerStoreIngestionTask.subscribePartition(
TestTopic_794c07675b_653cf70c_v1-1
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTaskTest.runTest(StoreIngestionTaskTest.java:878)
leaderFollowerStoreIngestionTask.subscribePartition(
TestTopic_794c07675b_653cf70c_v1-1,
true
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.subscribePartition(StoreIngestionTask.java:612)
leaderFollowerStoreIngestionTask.throwIfNotRunning();
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.subscribePartition(StoreIngestionTask.java:626)
leaderFollowerStoreIngestionTask.isRunning();
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.throwIfNotRunning(StoreIngestionTask.java:573)
leaderFollowerStoreIngestionTask.getIsRunning();
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.isRunning(StoreIngestionTask.java:4054)
leaderFollowerStoreIngestionTask.nextSeqNum();
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.subscribePartition(StoreIngestionTask.java:635)
leaderFollowerStoreIngestionTask.run();
-> at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
leaderFollowerStoreIngestionTask.isRunning();
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.run(StoreIngestionTask.java:1611)
leaderFollowerStoreIngestionTask.getIsRunning();
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.isRunning(StoreIngestionTask.java:4054)
leaderFollowerStoreIngestionTask.updateIngestionRoleIfStoreChanged(
Mock for Store, hashCode: 204751491
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.run(StoreIngestionTask.java:1613)
leaderFollowerStoreIngestionTask.isHybridMode();
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.updateIngestionRoleIfStoreChanged(StoreIngestionTask.java:1530)
leaderFollowerStoreIngestionTask.processConsumerActions(
Mock for Store, hashCode: 204751491
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.run(StoreIngestionTask.java:1614)
leaderFollowerStoreIngestionTask.processConsumerAction(
KafkaTaskMessage{type=SUBSCRIBE, topicPartition=TestTopic_794c07675b_653cf70c_v1-1, attempts=3, sequenceNumber=1, createdTimestampInMs=1735866819331},
Mock for Store, hashCode: 204751491
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.processConsumerActions(StoreIngestionTask.java:1893)
leaderFollowerStoreIngestionTask.processCommonConsumerAction(
KafkaTaskMessage{type=SUBSCRIBE, topicPartition=TestTopic_794c07675b_653cf70c_v1-1, attempts=3, sequenceNumber=1, createdTimestampInMs=1735866819331}
);
-> at com.linkedin.davinci.kafka.consumer.LeaderFollowerStoreIngestionTask.processConsumerAction(LeaderFollowerStoreIngestionTask.java:569)
leaderFollowerStoreIngestionTask.reportIfCatchUpVersionTopicOffset(
PCS{replicaId=TestTopic_794c07675b_653cf70c_v1-1, hybrid=false, latestProcessedLocalVersionTopicOffset=-1, latestProcessedUpstreamVersionTopicOffset=-1, latestProcessedUpstreamRTOffsetMap={}, latestIgnoredUpstreamRTOffsetMap={}, latestRTOffsetTriedToProduceToVTMap{}, offsetRecord=OffsetRecord{localVersionTopicOffset=-1, upstreamOffset=-1, leaderTopic=null, offsetLag=0, eventTimeEpochMs=-1, latestProducerProcessingTimeInMs=0, isEndOfPushReceived=false, databaseInfo={}, realTimeProducerState={}}, errorReported=false, started=false, lagCaughtUp=false, processedRecordSizeSinceLastSync=0, leaderFollowerState=STANDBY}
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.processCommonConsumerAction(StoreIngestionTask.java:2137)
leaderFollowerStoreIngestionTask.updateLeaderTopicOnFollower(
PCS{replicaId=TestTopic_794c07675b_653cf70c_v1-1, hybrid=false, latestProcessedLocalVersionTopicOffset=-1, latestProcessedUpstreamVersionTopicOffset=-1, latestProcessedUpstreamRTOffsetMap={}, latestIgnoredUpstreamRTOffsetMap={}, latestRTOffsetTriedToProduceToVTMap{}, offsetRecord=OffsetRecord{localVersionTopicOffset=-1, upstreamOffset=-1, leaderTopic=null, offsetLag=0, eventTimeEpochMs=-1, latestProducerProcessingTimeInMs=0, isEndOfPushReceived=false, databaseInfo={}, realTimeProducerState={}}, errorReported=false, started=false, lagCaughtUp=false, processedRecordSizeSinceLastSync=0, leaderFollowerState=STANDBY}
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.processCommonConsumerAction(StoreIngestionTask.java:2142)
leaderFollowerStoreIngestionTask.consumerSubscribe(
TestTopic_794c07675b_653cf70c_v1,
PCS{replicaId=TestTopic_794c07675b_653cf70c_v1-1, hybrid=false, latestProcessedLocalVersionTopicOffset=-1, latestProcessedUpstreamVersionTopicOffset=-1, latestProcessedUpstreamRTOffsetMap={}, latestIgnoredUpstreamRTOffsetMap={}, latestRTOffsetTriedToProduceToVTMap{}, offsetRecord=OffsetRecord{localVersionTopicOffset=-1, upstreamOffset=-1, leaderTopic=null, offsetLag=0, eventTimeEpochMs=-1, latestProducerProcessingTimeInMs=0, isEndOfPushReceived=false, databaseInfo={}, realTimeProducerState={}}, errorReported=false, started=false, lagCaughtUp=false, processedRecordSizeSinceLastSync=0, leaderFollowerState=STANDBY},
-1L,
"local_InMemoryKafkaBroker:33145"
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.processCommonConsumerAction(StoreIngestionTask.java:2146)
leaderFollowerStoreIngestionTask.resolveTopicPartitionWithKafkaURL(
TestTopic_794c07675b_653cf70c_v1,
PCS{replicaId=TestTopic_794c07675b_653cf70c_v1-1, hybrid=false, latestProcessedLocalVersionTopicOffset=-1, latestProcessedUpstreamVersionTopicOffset=-1, latestProcessedUpstreamRTOffsetMap={}, latestIgnoredUpstreamRTOffsetMap={}, latestRTOffsetTriedToProduceToVTMap{}, offsetRecord=OffsetRecord{localVersionTopicOffset=-1, upstreamOffset=-1, leaderTopic=null, offsetLag=0, eventTimeEpochMs=-1, latestProducerProcessingTimeInMs=0, isEndOfPushReceived=false, databaseInfo={}, realTimeProducerState={}}, errorReported=false, started=false, lagCaughtUp=false, processedRecordSizeSinceLastSync=0, leaderFollowerState=STANDBY},
"local_InMemoryKafkaBroker:33145"
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.consumerSubscribe(StoreIngestionTask.java:3544)
leaderFollowerStoreIngestionTask.resolveTopicWithKafkaURL(
TestTopic_794c07675b_653cf70c_v1,
"local_InMemoryKafkaBroker:33145"
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.resolveTopicPartitionWithKafkaURL(StoreIngestionTask.java:4534)
leaderFollowerStoreIngestionTask.consumerSubscribe(
TestTopic_794c07675b_653cf70c_v1-1,
-1L,
"local_InMemoryKafkaBroker:33145"
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.consumerSubscribe(StoreIngestionTask.java:3545)
leaderFollowerStoreIngestionTask.createKafkaConsumerProperties(
{"kafka.bootstrap.servers" = "local_InMemoryKafkaBroker:33145"},
"local_InMemoryKafkaBroker:33145",
false
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.consumerSubscribe(StoreIngestionTask.java:3557)
leaderFollowerStoreIngestionTask.getVersionTopic();
-> at com.linkedin.davinci.kafka.consumer.StorePartitionDataReceiver.destinationIdentifier(StorePartitionDataReceiver.java:86)
leaderFollowerStoreIngestionTask.getVersionTopic();
-> at com.linkedin.davinci.kafka.consumer.StorePartitionDataReceiver.destinationIdentifier(StorePartitionDataReceiver.java:86)
leaderFollowerStoreIngestionTask.processConsumerActions(
Mock for Store, hashCode: 204751491
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTaskTest.lambda$testProcessConsumerActionsError$153(StoreIngestionTaskTest.java:5158)
leaderFollowerStoreIngestionTask.processConsumerAction(
KafkaTaskMessage{type=SUBSCRIBE, topicPartition=TestTopic_794c07675b_653cf70c_v1-1, attempts=3, sequenceNumber=1, createdTimestampInMs=1735866819331},
Mock for Store, hashCode: 204751491
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.processConsumerActions(StoreIngestionTask.java:1893)
leaderFollowerStoreIngestionTask.processCommonConsumerAction(
KafkaTaskMessage{type=SUBSCRIBE, topicPartition=TestTopic_794c07675b_653cf70c_v1-1, attempts=3, sequenceNumber=1, createdTimestampInMs=1735866819331}
);
-> at com.linkedin.davinci.kafka.consumer.LeaderFollowerStoreIngestionTask.processConsumerAction(LeaderFollowerStoreIngestionTask.java:569)
leaderFollowerStoreIngestionTask.processConsumerActions(
Mock for Store, hashCode: 204751491
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTaskTest.lambda$testProcessConsumerActionsError$153(StoreIngestionTaskTest.java:5158)
leaderFollowerStoreIngestionTask.processConsumerAction(
KafkaTaskMessage{type=SUBSCRIBE, topicPartition=TestTopic_794c07675b_653cf70c_v1-1, attempts=3, sequenceNumber=1, createdTimestampInMs=1735866819331},
Mock for Store, hashCode: 204751491
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.processConsumerActions(StoreIngestionTask.java:1893)
leaderFollowerStoreIngestionTask.processCommonConsumerAction(
KafkaTaskMessage{type=SUBSCRIBE, topicPartition=TestTopic_794c07675b_653cf70c_v1-1, attempts=3, sequenceNumber=1, createdTimestampInMs=1735866819331}
);
-> at com.linkedin.davinci.kafka.consumer.LeaderFollowerStoreIngestionTask.processConsumerAction(LeaderFollowerStoreIngestionTask.java:569)
leaderFollowerStoreIngestionTask.checkLongRunningTaskState();
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.run(StoreIngestionTask.java:1615)
leaderFollowerStoreIngestionTask.getVersionTopic();
-> at com.linkedin.davinci.kafka.consumer.LeaderFollowerStoreIngestionTask.checkLongRunningTaskState(LeaderFollowerStoreIngestionTask.java:767)
leaderFollowerStoreIngestionTask.checkIngestionProgress(
Mock for Store, hashCode: 204751491
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.run(StoreIngestionTask.java:1616)
leaderFollowerStoreIngestionTask.consumerHasAnySubscription();
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.checkIngestionProgress(StoreIngestionTask.java:1483)
leaderFollowerStoreIngestionTask.processConsumerActions(
Mock for Store, hashCode: 204751491
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTaskTest.lambda$testProcessConsumerActionsError$153(StoreIngestionTaskTest.java:5158)
leaderFollowerStoreIngestionTask.processConsumerActions(
Mock for Store, hashCode: 204751491
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTaskTest.lambda$testProcessConsumerActionsError$153(StoreIngestionTaskTest.java:5158)
leaderFollowerStoreIngestionTask.processConsumerActions(
Mock for Store, hashCode: 204751491
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTaskTest.lambda$testProcessConsumerActionsError$153(StoreIngestionTaskTest.java:5158)
Raw output
Wanted but not invoked:
leaderFollowerStoreIngestionTask.reportError(
<any string>,
1,
<Capturing argument>
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.reportError(StoreIngestionTask.java:4221)
However, there were exactly 36 interactions with this mock:
leaderFollowerStoreIngestionTask.subscribePartition(
TestTopic_794c07675b_653cf70c_v1-1
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTaskTest.runTest(StoreIngestionTaskTest.java:878)
leaderFollowerStoreIngestionTask.subscribePartition(
TestTopic_794c07675b_653cf70c_v1-1,
true
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.subscribePartition(StoreIngestionTask.java:612)
leaderFollowerStoreIngestionTask.throwIfNotRunning();
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.subscribePartition(StoreIngestionTask.java:626)
leaderFollowerStoreIngestionTask.isRunning();
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.throwIfNotRunning(StoreIngestionTask.java:573)
leaderFollowerStoreIngestionTask.getIsRunning();
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.isRunning(StoreIngestionTask.java:4054)
leaderFollowerStoreIngestionTask.nextSeqNum();
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.subscribePartition(StoreIngestionTask.java:635)
leaderFollowerStoreIngestionTask.run();
-> at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
leaderFollowerStoreIngestionTask.isRunning();
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.run(StoreIngestionTask.java:1611)
leaderFollowerStoreIngestionTask.getIsRunning();
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.isRunning(StoreIngestionTask.java:4054)
leaderFollowerStoreIngestionTask.updateIngestionRoleIfStoreChanged(
Mock for Store, hashCode: 204751491
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.run(StoreIngestionTask.java:1613)
leaderFollowerStoreIngestionTask.isHybridMode();
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.updateIngestionRoleIfStoreChanged(StoreIngestionTask.java:1530)
leaderFollowerStoreIngestionTask.processConsumerActions(
Mock for Store, hashCode: 204751491
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.run(StoreIngestionTask.java:1614)
leaderFollowerStoreIngestionTask.processConsumerAction(
KafkaTaskMessage{type=SUBSCRIBE, topicPartition=TestTopic_794c07675b_653cf70c_v1-1, attempts=3, sequenceNumber=1, createdTimestampInMs=1735866819331},
Mock for Store, hashCode: 204751491
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.processConsumerActions(StoreIngestionTask.java:1893)
leaderFollowerStoreIngestionTask.processCommonConsumerAction(
KafkaTaskMessage{type=SUBSCRIBE, topicPartition=TestTopic_794c07675b_653cf70c_v1-1, attempts=3, sequenceNumber=1, createdTimestampInMs=1735866819331}
);
-> at com.linkedin.davinci.kafka.consumer.LeaderFollowerStoreIngestionTask.processConsumerAction(LeaderFollowerStoreIngestionTask.java:569)
leaderFollowerStoreIngestionTask.reportIfCatchUpVersionTopicOffset(
PCS{replicaId=TestTopic_794c07675b_653cf70c_v1-1, hybrid=false, latestProcessedLocalVersionTopicOffset=-1, latestProcessedUpstreamVersionTopicOffset=-1, latestProcessedUpstreamRTOffsetMap={}, latestIgnoredUpstreamRTOffsetMap={}, latestRTOffsetTriedToProduceToVTMap{}, offsetRecord=OffsetRecord{localVersionTopicOffset=-1, upstreamOffset=-1, leaderTopic=null, offsetLag=0, eventTimeEpochMs=-1, latestProducerProcessingTimeInMs=0, isEndOfPushReceived=false, databaseInfo={}, realTimeProducerState={}}, errorReported=false, started=false, lagCaughtUp=false, processedRecordSizeSinceLastSync=0, leaderFollowerState=STANDBY}
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.processCommonConsumerAction(StoreIngestionTask.java:2137)
leaderFollowerStoreIngestionTask.updateLeaderTopicOnFollower(
PCS{replicaId=TestTopic_794c07675b_653cf70c_v1-1, hybrid=false, latestProcessedLocalVersionTopicOffset=-1, latestProcessedUpstreamVersionTopicOffset=-1, latestProcessedUpstreamRTOffsetMap={}, latestIgnoredUpstreamRTOffsetMap={}, latestRTOffsetTriedToProduceToVTMap{}, offsetRecord=OffsetRecord{localVersionTopicOffset=-1, upstreamOffset=-1, leaderTopic=null, offsetLag=0, eventTimeEpochMs=-1, latestProducerProcessingTimeInMs=0, isEndOfPushReceived=false, databaseInfo={}, realTimeProducerState={}}, errorReported=false, started=false, lagCaughtUp=false, processedRecordSizeSinceLastSync=0, leaderFollowerState=STANDBY}
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.processCommonConsumerAction(StoreIngestionTask.java:2142)
leaderFollowerStoreIngestionTask.consumerSubscribe(
TestTopic_794c07675b_653cf70c_v1,
PCS{replicaId=TestTopic_794c07675b_653cf70c_v1-1, hybrid=false, latestProcessedLocalVersionTopicOffset=-1, latestProcessedUpstreamVersionTopicOffset=-1, latestProcessedUpstreamRTOffsetMap={}, latestIgnoredUpstreamRTOffsetMap={}, latestRTOffsetTriedToProduceToVTMap{}, offsetRecord=OffsetRecord{localVersionTopicOffset=-1, upstreamOffset=-1, leaderTopic=null, offsetLag=0, eventTimeEpochMs=-1, latestProducerProcessingTimeInMs=0, isEndOfPushReceived=false, databaseInfo={}, realTimeProducerState={}}, errorReported=false, started=false, lagCaughtUp=false, processedRecordSizeSinceLastSync=0, leaderFollowerState=STANDBY},
-1L,
"local_InMemoryKafkaBroker:33145"
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.processCommonConsumerAction(StoreIngestionTask.java:2146)
leaderFollowerStoreIngestionTask.resolveTopicPartitionWithKafkaURL(
TestTopic_794c07675b_653cf70c_v1,
PCS{replicaId=TestTopic_794c07675b_653cf70c_v1-1, hybrid=false, latestProcessedLocalVersionTopicOffset=-1, latestProcessedUpstreamVersionTopicOffset=-1, latestProcessedUpstreamRTOffsetMap={}, latestIgnoredUpstreamRTOffsetMap={}, latestRTOffsetTriedToProduceToVTMap{}, offsetRecord=OffsetRecord{localVersionTopicOffset=-1, upstreamOffset=-1, leaderTopic=null, offsetLag=0, eventTimeEpochMs=-1, latestProducerProcessingTimeInMs=0, isEndOfPushReceived=false, databaseInfo={}, realTimeProducerState={}}, errorReported=false, started=false, lagCaughtUp=false, processedRecordSizeSinceLastSync=0, leaderFollowerState=STANDBY},
"local_InMemoryKafkaBroker:33145"
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.consumerSubscribe(StoreIngestionTask.java:3544)
leaderFollowerStoreIngestionTask.resolveTopicWithKafkaURL(
TestTopic_794c07675b_653cf70c_v1,
"local_InMemoryKafkaBroker:33145"
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.resolveTopicPartitionWithKafkaURL(StoreIngestionTask.java:4534)
leaderFollowerStoreIngestionTask.consumerSubscribe(
TestTopic_794c07675b_653cf70c_v1-1,
-1L,
"local_InMemoryKafkaBroker:33145"
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.consumerSubscribe(StoreIngestionTask.java:3545)
leaderFollowerStoreIngestionTask.createKafkaConsumerProperties(
{"kafka.bootstrap.servers" = "local_InMemoryKafkaBroker:33145"},
"local_InMemoryKafkaBroker:33145",
false
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.consumerSubscribe(StoreIngestionTask.java:3557)
leaderFollowerStoreIngestionTask.getVersionTopic();
-> at com.linkedin.davinci.kafka.consumer.StorePartitionDataReceiver.destinationIdentifier(StorePartitionDataReceiver.java:86)
leaderFollowerStoreIngestionTask.getVersionTopic();
-> at com.linkedin.davinci.kafka.consumer.StorePartitionDataReceiver.destinationIdentifier(StorePartitionDataReceiver.java:86)
leaderFollowerStoreIngestionTask.processConsumerActions(
Mock for Store, hashCode: 204751491
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTaskTest.lambda$testProcessConsumerActionsError$153(StoreIngestionTaskTest.java:5158)
leaderFollowerStoreIngestionTask.processConsumerAction(
KafkaTaskMessage{type=SUBSCRIBE, topicPartition=TestTopic_794c07675b_653cf70c_v1-1, attempts=3, sequenceNumber=1, createdTimestampInMs=1735866819331},
Mock for Store, hashCode: 204751491
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.processConsumerActions(StoreIngestionTask.java:1893)
leaderFollowerStoreIngestionTask.processCommonConsumerAction(
KafkaTaskMessage{type=SUBSCRIBE, topicPartition=TestTopic_794c07675b_653cf70c_v1-1, attempts=3, sequenceNumber=1, createdTimestampInMs=1735866819331}
);
-> at com.linkedin.davinci.kafka.consumer.LeaderFollowerStoreIngestionTask.processConsumerAction(LeaderFollowerStoreIngestionTask.java:569)
leaderFollowerStoreIngestionTask.processConsumerActions(
Mock for Store, hashCode: 204751491
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTaskTest.lambda$testProcessConsumerActionsError$153(StoreIngestionTaskTest.java:5158)
leaderFollowerStoreIngestionTask.processConsumerAction(
KafkaTaskMessage{type=SUBSCRIBE, topicPartition=TestTopic_794c07675b_653cf70c_v1-1, attempts=3, sequenceNumber=1, createdTimestampInMs=1735866819331},
Mock for Store, hashCode: 204751491
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.processConsumerActions(StoreIngestionTask.java:1893)
leaderFollowerStoreIngestionTask.processCommonConsumerAction(
KafkaTaskMessage{type=SUBSCRIBE, topicPartition=TestTopic_794c07675b_653cf70c_v1-1, attempts=3, sequenceNumber=1, createdTimestampInMs=1735866819331}
);
-> at com.linkedin.davinci.kafka.consumer.LeaderFollowerStoreIngestionTask.processConsumerAction(LeaderFollowerStoreIngestionTask.java:569)
leaderFollowerStoreIngestionTask.checkLongRunningTaskState();
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.run(StoreIngestionTask.java:1615)
leaderFollowerStoreIngestionTask.getVersionTopic();
-> at com.linkedin.davinci.kafka.consumer.LeaderFollowerStoreIngestionTask.checkLongRunningTaskState(LeaderFollowerStoreIngestionTask.java:767)
leaderFollowerStoreIngestionTask.checkIngestionProgress(
Mock for Store, hashCode: 204751491
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.run(StoreIngestionTask.java:1616)
leaderFollowerStoreIngestionTask.consumerHasAnySubscription();
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.checkIngestionProgress(StoreIngestionTask.java:1483)
leaderFollowerStoreIngestionTask.processConsumerActions(
Mock for Store, hashCode: 204751491
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTaskTest.lambda$testProcessConsumerActionsError$153(StoreIngestionTaskTest.java:5158)
leaderFollowerStoreIngestionTask.processConsumerActions(
Mock for Store, hashCode: 204751491
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTaskTest.lambda$testProcessConsumerActionsError$153(StoreIngestionTaskTest.java:5158)
leaderFollowerStoreIngestionTask.processConsumerActions(
Mock for Store, hashCode: 204751491
);
-> at com.linkedin.davinci.kafka.consumer.StoreIngestionTaskTest.lambda$testProcessConsumerActionsError$153(StoreIngestionTaskTest.java:5158)
at app//com.linkedin.davinci.kafka.consumer.StoreIngestionTask.reportError(StoreIngestionTask.java:4221)
at app//com.linkedin.davinci.kafka.consumer.StoreIngestionTaskTest.lambda$testProcessConsumerActionsError$153(StoreIngestionTaskTest.java:5164)
at app//com.linkedin.davinci.kafka.consumer.StoreIngestionTaskTest.runTest(StoreIngestionTaskTest.java:885)
at app//com.linkedin.davinci.kafka.consumer.StoreIngestionTaskTest.runTest(StoreIngestionTaskTest.java:778)
at app//com.linkedin.davinci.kafka.consumer.StoreIngestionTaskTest.runTest(StoreIngestionTaskTest.java:638)
at app//com.linkedin.davinci.kafka.consumer.StoreIngestionTaskTest.testProcessConsumerActionsError(StoreIngestionTaskTest.java:5150)
github-actions / JUnit Test Report
TestRemoteIngestionRepairService.testIngestionRepairService
java.lang.AssertionError: expected [2] but found [1]
Raw output
java.lang.AssertionError: expected [2] but found [1]
at org.testng.Assert.fail(Assert.java:96)
at org.testng.Assert.failNotEquals(Assert.java:776)
at org.testng.Assert.assertEqualsImpl(Assert.java:137)
at org.testng.Assert.assertEquals(Assert.java:118)
at org.testng.Assert.assertEquals(Assert.java:652)
at org.testng.Assert.assertEquals(Assert.java:662)
at com.linkedin.davinci.kafka.consumer.TestRemoteIngestionRepairService.testIngestionRepairService(TestRemoteIngestionRepairService.java:25)
github-actions / JUnit Test Report
NativeMetadataRepositoryTest.testNativeMetadataRepositoryStats
java.lang.AssertionError: expected [2000.0] but found [1000.0]
Raw output
java.lang.AssertionError: expected [2000.0] but found [1000.0]
at org.testng.Assert.fail(Assert.java:96)
at org.testng.Assert.failNotEquals(Assert.java:776)
at org.testng.Assert.assertEqualsImpl(Assert.java:137)
at org.testng.Assert.assertEquals(Assert.java:118)
at org.testng.Assert.assertEquals(Assert.java:442)
at com.linkedin.davinci.repository.NativeMetadataRepositoryTest.lambda$testNativeMetadataRepositoryStats$5(NativeMetadataRepositoryTest.java:136)
at com.linkedin.venice.utils.TestUtils.waitForNonDeterministicAssertion(TestUtils.java:243)
at com.linkedin.venice.utils.TestUtils.waitForNonDeterministicAssertion(TestUtils.java:228)
at com.linkedin.venice.utils.TestUtils.waitForNonDeterministicAssertion(TestUtils.java:220)
at com.linkedin.davinci.repository.NativeMetadataRepositoryTest.testNativeMetadataRepositoryStats(NativeMetadataRepositoryTest.java:133)
github-actions / JUnit Test Report
BatchGetAvroStoreClientUnitTest.testSimpleStreamingBatchGet
org.testng.internal.thread.ThreadTimeoutException: Method com.linkedin.venice.fastclient.BatchGetAvroStoreClientUnitTest.testSimpleStreamingBatchGet() didn't finish within the time-out 5000
Raw output
org.testng.internal.thread.ThreadTimeoutException: Method com.linkedin.venice.fastclient.BatchGetAvroStoreClientUnitTest.testSimpleStreamingBatchGet() didn't finish within the time-out 5000
at app//org.apache.logging.log4j.core.Logger.$jacocoInit(Logger.java)
at app//org.apache.logging.log4j.core.Logger.requiresLocation(Logger.java)
at app//org.apache.logging.log4j.spi.AbstractLogger.getLocation(AbstractLogger.java:2216)
at app//org.apache.logging.log4j.spi.AbstractLogger.logMessageTrackRecursion(AbstractLogger.java:2159)
at app//org.apache.logging.log4j.spi.AbstractLogger.logMessageSafely(AbstractLogger.java:2142)
at app//org.apache.logging.log4j.spi.AbstractLogger.logMessage(AbstractLogger.java:2046)
at app//org.apache.logging.log4j.spi.AbstractLogger.logIfEnabled(AbstractLogger.java:1915)
at app//org.apache.logging.log4j.spi.AbstractLogger.info(AbstractLogger.java:1454)
at app//com.linkedin.venice.fastclient.utils.TestClientSimulator.restRequest(TestClientSimulator.java:266)
at app//com.linkedin.venice.fastclient.transport.R2TransportClient.post(R2TransportClient.java:51)
at app//com.linkedin.venice.fastclient.DispatchingAvroGenericStoreClient.multiKeyStreamingRequest(DispatchingAvroGenericStoreClient.java:479)
at app//com.linkedin.venice.fastclient.DispatchingAvroGenericStoreClient.streamingBatchGet(DispatchingAvroGenericStoreClient.java:365)
at app//com.linkedin.venice.fastclient.DelegatingAvroStoreClient.streamingBatchGet(DelegatingAvroStoreClient.java:99)
at app//com.linkedin.venice.fastclient.StatsAvroGenericStoreClient.streamingBatchGet(StatsAvroGenericStoreClient.java:70)
at app//com.linkedin.venice.fastclient.InternalAvroStoreClient.streamingBatchGet(InternalAvroStoreClient.java:65)
at app//com.linkedin.venice.fastclient.BatchGetAvroStoreClientUnitTest.callStreamingBatchGetAndVerifyResults(BatchGetAvroStoreClientUnitTest.java:770)
at app//com.linkedin.venice.fastclient.BatchGetAvroStoreClientUnitTest.callStreamingBatchGetAndVerifyResults(BatchGetAvroStoreClientUnitTest.java:759)
at app//com.linkedin.venice.fastclient.BatchGetAvroStoreClientUnitTest.testSimpleStreamingBatchGet(BatchGetAvroStoreClientUnitTest.java:65)