Attempting to upgrade from vector 0.27.0-distroless-libc to new versions

[mohdAkibUddin]

A note for the community

• Please vote on this issue by adding a 👍 reaction to the original issue to help the community and maintainers prioritize this request
• If you are interested in working on this issue or have submitted a pull request, please leave a comment

Problem

I am attempting to go from vector 0.27.0-distroless-libc to 0.42.0-distroless-libc.

Taking an incremental approach from 0.27.0-distroless-libc to 0.33.0-distroless-libc to 0.38.0-distroless-libc to 0.42.0-distroless-libc we notice memory increases along the way.

On version 0.27.0-distroless-libc we saw an average use of 60-80 MiB

On version 0.33.0-distroless-libc we saw an average use of 105 MiB

On both versions 0.38.0-distroless-libc and 0.42.0-distroless-libc we saw an average use of 115-125 MiB.

Is it expected for memory usage to increase in this manner? Are there any VRL changes that come to mind between these changes that you think I’d have to make?

Version

0.27.0-distroless-libc, 0.33.0-distroless-libc, 0.38.0-distroless-libc, 0.42.0-distroless-libc

Example Data

On version 0.27.0-distroless-libc we saw an average use of 60-80 MiB

On version 0.33.0-distroless-libc we saw an average use of 105 MiB

Additional Context

Vector is running on Kubernetes

Here's what vector top shows on 0.42.0-distroless-libc

[pront]

Are there any VRL changes that come to mind between these changes that you think I’d have to make?

I would recommend smaller incremental changes. You can follow the upgrade guides (here).