[Question]: who is the producer of topic(flink-task-app)?

[yuehan-mm]

What would you like to ask or discuss?

who is the producer of topic(flink-task-app)? i could't find the relevant code.
main branch : \task-flink\src\main\java\com\oppo\cloud\flink\consumer\ConsumerMessage.java line 68
thanks

[zebozhuang]

What would you like to ask or discuss?

who is the producer of topic(flink-task-app)? i could't find the relevant code. main branch : \task-flink\src\main\java\com\oppo\cloud\flink\consumer\ConsumerMessage.java line 68 thanks

The code is in the file https://github.com/cubefs/compass/blob/main/task-syncer/src/main/java/com/oppo/cloud/syncer/service/impl/TaskInstanceService.java#L109C39-L109C57.

[Yves-yuan]

What would you like to ask or discuss?

who is the producer of topic(flink-task-app)? i could't find the relevant code. main branch : \task-flink\src\main\java\com\oppo\cloud\flink\consumer\ConsumerMessage.java line 68 thanks

@yuehan-mm
receiveFlinkTaskApp method is no longer used,we should delete this method later.
receiveDsTaskApplication method is used to sync flink metadata,it consumes task-application topic data which is produced by LogParserServiceImpl.addTaskApplication method.

[yuehan-mm]

TaskInstanceService

@zebozhuang i konw this class. but it is writes to topic(task-instance), not flink-task-app

[yuehan-mm]

What would you like to ask or discuss?

who is the producer of topic(flink-task-app)? i could't find the relevant code. main branch : \task-flink\src\main\java\com\oppo\cloud\flink\consumer\ConsumerMessage.java line 68 thanks

@yuehan-mm receiveFlinkTaskApp method is no longer used,we should delete this method later. receiveDsTaskApplication method is used to sync flink metadata,it consumes task-application topic data which is produced by LogParserServiceImpl.addTaskApplication method.

thanks for replay @Yves-yuan

[tyoushinya]

What would you like to ask or discuss?

who is the producer of topic(flink-task-app)? i could't find the relevant code. main branch : \task-flink\src\main\java\com\oppo\cloud\flink\consumer\ConsumerMessage.java line 68 thanks

@yuehan-mm receiveFlinkTaskApp method is no longer used,we should delete this method later. receiveDsTaskApplication method is used to sync flink metadata,it consumes task-application topic data which is produced by LogParserServiceImpl.addTaskApplication method.

This means the Flink resource diagnostic module can only work with scheduler (Airflow,DolphinScheduler etc) , is it right?