Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
[CELEBORN-1760] OOM causes disk buffer unable to be released
### What changes were proposed in this pull request? When OOM occurs in flushBuffer.addComponent, there are two problems. 1. decrementPendingWrites is not called, causing close PartitionDataWriter to be stuck for a period of time during commit. 2. After OOM occurs, ByteBuf is not released, causing memory leaks. ### Why are the changes needed? Fix disk buffer unable to be released ### Does this PR introduce _any_ user-facing change? Yes, it fixes a memory leak issue in some corner cases. ### How was this patch tested? I did some tests. 2 of the nodes did not have this PR, and the memory of these two nodes could not be released. 1 node had this PR, and the memory could be released. It was obviously much lower than the previous 2 nodes. ![image](https://github.com/user-attachments/assets/3fe846ec-6ee8-432a-be7a-a7efb7c102d0) Closes #2975 from leixm/CELEBORN-1760. Authored-by: Xianming Lei <[email protected]> Signed-off-by: Shuang <[email protected]>
- Loading branch information