Improve ReactiveEventPublisher throughtput #1457
Assignees
Comments
fjtirado
added a commit
to fjtirado/kogito-runtimes
that referenced
this issue
Aug 31, 2024
fjtirado
added a commit
to fjtirado/kogito-apps
that referenced
this issue
Aug 31, 2024
fjtirado
added a commit
to fjtirado/kogito-apps
that referenced
this issue
Aug 31, 2024
fjtirado
added a commit
to fjtirado/kogito-runtimes
that referenced
this issue
Aug 31, 2024
fjtirado
added a commit
to fjtirado/kogito-apps
that referenced
this issue
Aug 31, 2024
|
What is the root cause of the sending being too slow? I remember that the numbers of events in the stress tests were not big. |
gmunozfe
added a commit
to fjtirado/kogito-apps
that referenced
this issue
Sep 18, 2024
gmunozfe
added a commit
to fjtirado/kogito-apps
that referenced
this issue
Sep 18, 2024
@rgolangh The number of processes was not too big, but the number of events per process is. |
gmunozfe
added a commit
to fjtirado/kogito-apps
that referenced
this issue
Sep 20, 2024
|
This issue depends on this one quarkiverse/quarkus-reactive-messaging-http#281 |
fjtirado
added a commit
to fjtirado/kogito-runtimes
that referenced
this issue
Sep 26, 2024
fjtirado
added a commit
to fjtirado/kogito-runtimes
that referenced
this issue
Sep 26, 2024
fjtirado
added a commit
to fjtirado/kogito-runtimes
that referenced
this issue
Sep 26, 2024
fjtirado
added a commit
to fjtirado/kogito-runtimes
that referenced
this issue
Sep 26, 2024
fjtirado
added a commit
to fjtirado/kogito-apps
that referenced
this issue
Sep 26, 2024
fjtirado
added a commit
to fjtirado/kogito-runtimes
that referenced
this issue
Sep 26, 2024
fjtirado
added a commit
to fjtirado/kogito-runtimes
that referenced
this issue
Sep 26, 2024
fjtirado
added a commit
to fjtirado/kogito-runtimes
that referenced
this issue
Sep 26, 2024
fjtirado
added a commit
to fjtirado/kogito-apps
that referenced
this issue
Sep 26, 2024
fjtirado
added a commit
to fjtirado/kogito-apps
that referenced
this issue
Sep 27, 2024
fjtirado
added a commit
to fjtirado/kogito-examples
that referenced
this issue
Sep 27, 2024
Fixing outdated pom in dmn example
fjtirado
added a commit
to fjtirado/kogito-runtimes
that referenced
this issue
Sep 27, 2024
|
@tkobayas |
fjtirado
added a commit
to fjtirado/kogito-apps
that referenced
this issue
Oct 1, 2024
fjtirado
added a commit
to fjtirado/kogito-apps
that referenced
this issue
Oct 1, 2024
fjtirado
added a commit
to fjtirado/kogito-apps
that referenced
this issue
Oct 1, 2024
|
^ @fjtirado Probably because the commit message |
fjtirado
added a commit
to fjtirado/kogito-runtimes
that referenced
this issue
Oct 4, 2024
fjtirado
added a commit
to fjtirado/kogito-runtimes
that referenced
this issue
Oct 4, 2024
fjtirado
added a commit
to fjtirado/kogito-runtimes
that referenced
this issue
Oct 4, 2024
fjtirado
added a commit
to fjtirado/kogito-runtimes
that referenced
this issue
Oct 4, 2024
fjtirado
added a commit
to fjtirado/kogito-apps
that referenced
this issue
Oct 4, 2024
fjtirado
added a commit
to fjtirado/kogito-apps
that referenced
this issue
Oct 4, 2024
fjtirado
added a commit
to fjtirado/kogito-apps
that referenced
this issue
Oct 4, 2024
fjtirado
added a commit
to fjtirado/kogito-apps
that referenced
this issue
Oct 4, 2024
fjtirado
added a commit
to fjtirado/kogito-apps
that referenced
this issue
Oct 4, 2024
fjtirado
added a commit
to fjtirado/kogito-apps
that referenced
this issue
Oct 4, 2024
fjtirado
added a commit
to fjtirado/kogito-apps
that referenced
this issue
Oct 4, 2024
fjtirado
added a commit
to fjtirado/kogito-apps
that referenced
this issue
Oct 4, 2024
fjtirado
added a commit
to apache/incubator-kie-kogito-runtimes
that referenced
this issue
Oct 4, 2024
* [Fix apache/incubator-kie-issues#1457] Allow grouping of events * Add test for coverage * [Fix apache/incubator-kie-issues#1457] Grouping of event serialization * [Fix apache/incubator-kie-issues#1457] Adding default constructor * [Fix apache/incubator-kie-issues#1457] Adding TYPE constant --------- Co-authored-by: gmunozfe <[email protected]>
rgdoliveira
pushed a commit
to rgdoliveira/kogito-apps
that referenced
this issue
Oct 10, 2024
) * Add unit tests * [Fix apache/incubator-kie-issues#1457] Grouping of events 2nd approach * Add integration tests * [Fix apache/incubator-kie-issues#1457] Grouping of event serialization * [Fix apache/incubator-kie-issues#1457] DataAudit serialization * Update data-index/data-index-service/data-index-service-common/src/test/java/org/kie/kogito/index/service/messaging/AbstractMessagingConsumerIT.java Co-authored-by: Gonzalo Muñoz <[email protected]> Update data-index/data-index-service/data-index-service-postgresql/src/test/java/org/kie/kogito/index/service/messaging/PostgreSqlMessagingKafkaConsumerIT.java Co-authored-by: Gonzalo Muñoz <[email protected]> Update data-index/data-index-service/data-index-service-common/src/test/java/org/kie/kogito/index/service/messaging/AbstractMessagingConsumerIT.java Co-authored-by: Gonzalo Muñoz <[email protected]> Update data-index/data-index-service/data-index-service-postgresql/src/test/java/org/kie/kogito/index/service/messaging/PostgreSqlMessagingKafkaConsumerIT.java Co-authored-by: Gonzalo Muñoz <[email protected]> Fix to run collections tests for all * [Fix apache/incubator-kie-issues#1457] Converter deserialization * [Fix apache/incubator-kie-issues#1457] Converter deserialization right --------- Co-authored-by: gmunozfe <[email protected]>
rgdoliveira
pushed a commit
to rgdoliveira/kogito-runtimes
that referenced
this issue
Oct 10, 2024
* [Fix apache/incubator-kie-issues#1457] Allow grouping of events * Add test for coverage * [Fix apache/incubator-kie-issues#1457] Grouping of event serialization * [Fix apache/incubator-kie-issues#1457] Adding default constructor * [Fix apache/incubator-kie-issues#1457] Adding TYPE constant --------- Co-authored-by: gmunozfe <[email protected]>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
EventPublisher has the list of events generated at the end of a UnitOfWork
These events are currently sent one by one by ReactiveEventMessagePublisher, which is the case of Http Smallrye connector heavily affects system throughput, which in turn increase memory consumption because of event queuing.
One possible improvement is to set the message body to the entire collection, minimizing the number of external calls. However this will affect consumers. For example, in DataIndex, ReactiveMessageEventConsumer will have to be changed to check if the message body contains one event or a collection of them.
The text was updated successfully, but these errors were encountered: