Bump Spring Boot to 3.4 #3941

adinauer · 2024-11-29T10:09:07Z

Description

Bump Spring Boot to 3.4

bjornharvold · 2024-12-01T09:14:28Z

Please see this issue as this might very well pertain to Sentry: spring-projects/spring-boot#43332

Using Sentry 7.18.1 and 8.0.0.rc1 produced different errors in our staging environment.

7.18.1 made the system unresponsive after authenticating
8.0.0.rc1 made it impossible to authenticate with Spring Authorization Server 1.4.0

Cannot confirm 💯 without disabling Sentry in our Spring Boot app completely but have a hunch.

Cheers,
Bjorn

adinauer · 2024-12-02T12:54:09Z

Thanks for reaching out @bjornharvold , what makes you think it's Sentry that's causing the issues? Just using different versions and having different outcomes?

Are you seeing any exceptions?

Do you have a repro we can use to look into this issue?

Can you please share more info on how you're using Sentry (which SDK, integrations, options, etc.).

bjornharvold · 2024-12-03T03:42:13Z

Hi @adinauer

What makes this look like an instrumentation issue, is that there is 0 errors. The apps just start hanging completely and being completely unresponsive even though we can see Spring Data MongoDb pinging MongoDB Atlas every few seconds.

Now it could be Spring Authorization Server but it wouldn't be giving us different errors based on the Sentry version we use.

Never seen anything quite like this actually.

Of course cannot be sure it's Sentry as we are unable to make a thread dump once the Cloud Run instance reaches this state.

Last indication that it is most likely Sentry is that our Spring Boot app (3.4.0) works locally and we have set sentry.logging.enabled=false in this environment. It's enabled in both staging and production.

Hope this helps,
Bjorn

adinauer · 2024-12-03T14:51:55Z

@bjornharvold did this start happening when you bumped Spring Boot to 3.4.0 and was fine before?

Can you please share more details on what Sentry integrations you're using and what config options you are setting?

How many servers are in play here and which one is causing troubles?

A reproducible sample would be the best way for us to help you.

bjornharvold · 2024-12-04T03:02:30Z

Hi @adinauer,

This started happening when upgrading Spring Boot to 3.4.0 and pushing to staging. Sentry was still on 7.18.0 at this point.

Here are the settings we use in staging and we haven't changed these settings for a long time (This is the configuration for a Spring Web MVC app FYI - maybe the reactive and backpressue properties are not valid here):
sentry.logging.enabled=true
sentry.environment=staging
sentry.dsn=HIDDEN
sentry.logging.minimum-event-level=error
sentry.logging.minimum-breadcrumb-level=debug
sentry.send-default-pii=true
sentry.max-request-body-size=ALWAYS
sentry.use-git-commit-id-as-release=false
[email protected]@
sentry.ignored-exceptions-for-type=
sentry.reactive.thread-local-accessor-enabled=true
sentry.enable-tracing=true
sentry.traces-sample-rate=0.2
sentry.enable-backpressure-handling=true

I am not asking for support on this ticket. I will create my own if I am certain that it's Sentry. Pointing out that this might be something to look at while testing support for Spring Boot 3.4.0. In your docs, there is no support for this version yet AFAIK.

adinauer · 2024-12-04T09:52:12Z

@bjornharvold can you please try with sentry.max-request-body-size=none and see if that changes anything?

adinauer · 2024-12-06T08:40:58Z

@bjornharvold have you had a chance to test the config change above? The problem might be related to us caching the request body. The suggested config disables attaching the request body to Sentry events as well as temporary caching of the request body.

bjornharvold · 2024-12-06T14:57:09Z

Hi @adinauer

Will try this next week when staging frees up.

Cheers

adinauer · 2024-12-23T05:49:04Z

@bjornharvold your initial properties of

sentry.send-default-pii=true
sentry.max-request-body-size=ALWAYS

should now work with rc.3.

8.0.0.rc1 made it impossible to authenticate with Spring Authorization Server 1.4.0

This issue should now be fixed.

bjornharvold · 2024-12-25T02:24:25Z

Hi @adinauer,

I can confirm that rc.3 does not freeze our server and authentication with SAS works fine.

👏🏻🦸‍♂️

bjornharvold · 2024-12-25T09:57:35Z

Hi Team,

There is still something going on with one of our apps that uses Apache CXF with Spring Web Services. Looking into it.

bjornharvold · 2024-12-26T02:47:10Z

Latest update, we released a build to our production servers with Spring Boot 3.4.1 and Sentry 8.0.0.rc-3.

Authentication works
It works initially - However, servers become unresponsive after continued usage.

Wondering if there is a memory leak or memory requirements changed with either Spring Boot or Sentry.

Thoughts on how to better verify this. Cannot test this in a production environment due to unhappy customers 😉

bjornharvold · 2024-12-26T04:56:16Z

Here's the only thing we have to go on at the present moment:

java.lang.OutOfMemoryError: Cannot reserve 16364 bytes of direct buffer memory (allocated: 10476880, limit: 10485760)
	at java.base/java.nio.Bits.reserveMemory(Unknown Source) ~[na:na]
	at java.base/java.nio.DirectByteBuffer.<init>(Unknown Source) ~[na:na]
	at java.base/java.nio.ByteBuffer.allocateDirect(Unknown Source) ~[na:na]
	at io.undertow.server.DefaultByteBufferPool.allocate(DefaultByteBufferPool.java:149) ~[undertow-core-2.3.18.Final.jar:2.3.18.Final]
	at io.undertow.servlet.spec.ServletInputStreamImpl.readIntoBuffer(ServletInputStreamImpl.java:199) ~[undertow-servlet-2.3.18.Final.jar:2.3.18.Final]
	at io.undertow.servlet.spec.ServletInputStreamImpl.read(ServletInputStreamImpl.java:176) ~[undertow-servlet-2.3.18.Final.jar:2.3.18.Final]
	at org.apache.cxf.helpers.IOUtils.copyAtLeast(IOUtils.java:250) ~[cxf-core-4.0.5.jar:4.0.5]
	at org.apache.cxf.ext.logging.WireTapIn.handleInputStream(WireTapIn.java:91) ~[cxf-rt-features-logging-4.0.5.jar:4.0.5]
	at org.apache.cxf.ext.logging.WireTapIn.handleMessage(WireTapIn.java:61) ~[cxf-rt-features-logging-4.0.5.jar:4.0.5]
	at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:307) ~[cxf-core-4.0.5.jar:4.0.5]
	at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) ~[cxf-core-4.0.5.jar:4.0.5]
	at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:265) ~[cxf-rt-transports-http-4.0.5.jar:4.0.5]
	at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:233) ~[cxf-rt-transports-http-4.0.5.jar:4.0.5]
	at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:207) ~[cxf-rt-transports-http-4.0.5.jar:4.0.5]
	at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:159) ~[cxf-rt-transports-http-4.0.5.jar:4.0.5]
	at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:224) ~[cxf-rt-transports-http-4.0.5.jar:4.0.5]
	at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:303) ~[cxf-rt-transports-http-4.0.5.jar:4.0.5]
	at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doPost(AbstractHTTPServlet.java:216) ~[cxf-rt-transports-http-4.0.5.jar:4.0.5]
	at jakarta.servlet.http.HttpServlet.service(HttpServlet.java:547) ~[jakarta.servlet-api-6.0.0.jar:6.0.0]
	at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:278) ~[cxf-rt-transports-http-4.0.5.jar:4.0.5]
	at io.undertow.servlet.handlers.ServletHandler.handleRequest(ServletHandler.java:74) ~[undertow-servlet-2.3.18.Final.jar:2.3.18.Final]
	at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:129) ~[undertow-servlet-2.3.18.Final.jar:2.3.18.Final]
	at org.springframework.web.servlet.resource.ResourceUrlEncodingFilter.doFilter(ResourceUrlEncodingFilter.java:66) ~[spring-webmvc-6.2.1.jar:6.2.1]
	at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:67) ~[undertow-servlet-2.3.18.Final.jar:2.3.18.Final]
	at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) ~[undertow-servlet-2.3.18.Final.jar:2.3.18.Final]
	at io.sentry.spring.jakarta.SentryUserFilter.doFilterInternal(SentryUserFilter.java:56) ~[sentry-spring-jakarta-8.0.0-rc.3.jar:na]
	at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:116) ~[spring-web-6.2.1.jar:6.2.1]
	at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:67) ~[undertow-servlet-2.3.18.Final.jar:2.3.18.Final]
	at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) ~[undertow-servlet-2.3.18.Final.jar:2.3.18.Final]
	at org.springframework.web.filter.CompositeFilter$VirtualFilterChain.doFilter(CompositeFilter.java:108) ~[spring-web-6.2.1.jar:6.2.1]
	at org.springframework.security.web.FilterChainProxy.lambda$doFilterInternal$3(FilterChainProxy.java:231) ~[spring-security-web-6.4.2.jar:6.4.2]
	at org.springframework.security.web.ObservationFilterChainDecorator$FilterObservation$SimpleFilterObservation.lambda$wrap$1(ObservationFilterChainDecorator.java:479) ~[spring-security-web-6.4.2.jar:6.4.2]
	at org.springframework.security.web.ObservationFilterChainDecorator$AroundFilterObservation$SimpleAroundFilterObservation.lambda$wrap$1(ObservationFilterChainDecorator.java:340) ~[spring-security-web-6.4.2.jar:6.4.2]
	at org.springframework.security.web.ObservationFilterChainDecorator.lambda$wrapSecured$0(ObservationFilterChainDecorator.java:82) ~[spring-security-web-6.4.2.jar:6.4.2]
	at org.springframework.security.web.ObservationFilterChainDecorator$VirtualFilterChain.doFilter(ObservationFilterChainDecorator.java:128) ~[spring-security-web-6.4.2.jar:6.4.2]
	at org.springframework.security.web.access.intercept.AuthorizationFilter.doFilter(AuthorizationFilter.java:101) ~[spring-security-web-6.4.2.jar:6.4.2]
	at org.springframework.security.web.ObservationFilterChainDecorator$ObservationFilter.wrapFilter(ObservationFilterChainDecorator.java:240) ~[spring-security-web-6.4.2.jar:6.4.2]
	at org.springframework.security.web.ObservationFilterChainDecorator$ObservationFilter.doFilter(ObservationFilterChainDecorator.java:227) ~[spring-security-web-6.4.2.jar:6.4.2]
	at org.springframework.security.web.ObservationFilterChainDecorator$VirtualFilterChain.doFilter(ObservationFilterChainDecorator.java:137) ~[spring-security-web-6.4.2.jar:6.4.2]
	at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:126) ~[spring-security-web-6.4.2.jar:6.4.2]
	at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:120) ~[spring-security-web-6.4.2.jar:6.4.2]
	at org.springframework.security.web.ObservationFilterChainDecorator$ObservationFilter.wrapFilter(ObservationFilterChainDecorator.java:240) ~[spring-security-web-6.4.2.jar:6.4.2]
	at org.springframework.security.web.ObservationFilterChainDecorator$ObservationFilter.doFilter(ObservationFilterChainDecorator.java:227) ~[spring-security-web-6.4.2.jar:6.4.2]
	at org.springframework.security.web.ObservationFilterChainDecorator$VirtualFilterChain.doFilter(ObservationFilterChainDecorator.java:137) ~[spring-security-web-6.4.2.jar:6.4.2]
	at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:131) ~[spring-security-web-6.4.2.jar:6.4.2]
	at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:85) ~[spring-security-web-6.4.2.jar:6.4.2]
	at org.springframework.security.web.ObservationFilterChainDecorator$ObservationFilter.wrapFilter(ObservationFilterChainDecorator.java:240) ~[spring-security-web-6.4.2.jar:6.4.2]
	at org.springframework.security.web.ObservationFilterChainDecorator$ObservationFilter.doFilter(ObservationFilterChainDecorator.java:227) ~[spring-security-web-6.4.2.jar:6.4.2]
	at org.springframework.security.web.ObservationFilterChainDecorator$VirtualFilterChain.doFilter(ObservationFilterChainDecorator.java:137) ~[spring-security-web-6.4.2.jar:6.4.2]
	at org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:100) ~[spring-security-web-6.4.2.jar:6.4.2]
	at org.springframework.security.web.ObservationFilterChainDecorator$ObservationFilter.wrapFilter(ObservationFilterChainDecorator.java:240) ~[spring-security-web-6.4.2.jar:6.4.2]
	at org.springframework.security.web.ObservationFilterChainDecorator$ObservationFilter.doFilter(ObservationFilterChainDecorator.java:227) ~[spring-security-web-6.4.2.jar:6.4.2]
	at org.springframework.security.web.ObservationFilterChainDecorator$VirtualFilterChain.doFilter(ObservationFilterChainDecorator.java:137) ~[spring-security-web-6.4.2.jar:6.4.2]
	at org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:179) ~[spring-security-web-6.4.2.jar:6.4.2]
	at org.springframework.security.web.ObservationFilterChainDecorator$ObservationFilter.wrapFilter(ObservationFilterChainDecorator.java:240) ~[spring-security-web-6.4.2.jar:6.4.2]
	at org.springframework.security.web.ObservationFilterChainDecorator$ObservationFilter.doFilter(ObservationFilterChainDecorator.java:227) ~[spring-security-web-6.4.2.jar:6.4.2]
	at org.springframework.security.web.ObservationFilterChainDecorator$VirtualFilterChain.doFilter(ObservationFilterChainDecorator.java:137) ~[spring-security-web-6.4.2.jar:6.4.2]
	at org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:63) ~[spring-security-web-6.4.2.jar:6.4.2]
	at org.springframework.security.web.ObservationFilterChainDecorator$ObservationFilter.wrapFilter(ObservationFilterChainDecorator.java:240) ~[spring-security-web-6.4.2.jar:6.4.2]
	at org.springframework.security.web.ObservationFilterChainDecorator$ObservationFilter.doFilter(ObservationFilterChainDecorator.java:227) ~[spring-security-web-6.4.2.jar:6.4.2]
	at org.springframework.security.web.ObservationFilterChainDecorator$VirtualFilterChain.doFilter(ObservationFilterChainDecorator.java:137) ~[spring-security-web-6.4.2.jar:6.4.2]
	at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:107) ~[spring-security-web-6.4.2.jar:6.4.2]
	at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:93) ~[spring-security-web-6.4.2.jar:6.4.2]
	at org.springframework.security.web.ObservationFilterChainDecorator$ObservationFilter.wrapFilter(ObservationFilterChainDecorator.java:240) ~[spring-security-web-6.4.2.jar:6.4.2]
	at org.springframework.security.web.ObservationFilterChainDecorator$ObservationFilter.doFilter(ObservationFilterChainDecorator.java:227) ~[spring-security-web-6.4.2.jar:6.4.2]
	at org.springframework.security.web.ObservationFilterChainDecorator$VirtualFilterChain.doFilter(ObservationFilterChainDecorator.java:137) ~[spring-security-web-6.4.2.jar:6.4.2]
	at org.springframework.web.filter.CorsFilter.doFilterInternal(CorsFilter.java:91) ~[spring-web-6.2.1.jar:6.2.1]
	at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:116) ~[spring-web-6.2.1.jar:6.2.1]
	at org.springframework.security.web.ObservationFilterChainDecorator$ObservationFilter.wrapFilter(ObservationFilterChainDecorator.java:240) ~[spring-security-web-6.4.2.jar:6.4.2]
	at org.springframework.security.web.ObservationFilterChainDecorator$ObservationFilter.doFilter(ObservationFilterChainDecorator.java:227) ~[spring-security-web-6.4.2.jar:6.4.2]
	at org.springframework.security.web.ObservationFilterChainDecorator$VirtualFilterChain.doFilter(ObservationFilterChainDecorator.java:137) ~[spring-security-web-6.4.2.jar:6.4.2]
	at org.springframework.security.web.header.HeaderWriterFilter.doHeadersAfter(HeaderWriterFilter.java:90) ~[spring-security-web-6.4.2.jar:6.4.2]
	at org.springframework.security.web.header.HeaderWriterFilter.doFilterInternal(HeaderWriterFilter.java:75) ~[spring-security-web-6.4.2.jar:6.4.2]
	at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:116) ~[spring-web-6.2.1.jar:6.2.1]
	at org.springframework.security.web.ObservationFilterChainDecorator$ObservationFilter.wrapFilter(ObservationFilterChainDecorator.java:240) ~[spring-security-web-6.4.2.jar:6.4.2]
	at org.springframework.security.web.ObservationFilterChainDecorator$ObservationFilter.doFilter(ObservationFilterChainDecorator.java:227) ~[spring-security-web-6.4.2.jar:6.4.2]
	at org.springframework.security.web.ObservationFilterChainDecorator$VirtualFilterChain.doFilter(ObservationFilterChainDecorator.java:137) ~[spring-security-web-6.4.2.jar:6.4.2]
	at org.springframework.security.web.context.SecurityContextHolderFilter.doFilter(SecurityContextHolderFilter.java:82) ~[spring-security-web-6.4.2.jar:6.4.2]
	at org.springframework.security.web.context.SecurityContextHolderFilter.doFilter(SecurityContextHolderFilter.java:69) ~[spring-security-web-6.4.2.jar:6.4.2]
	at org.springframework.security.web.ObservationFilterChainDecorator$ObservationFilter.wrapFilter(ObservationFilterChainDecorator.java:240) ~[spring-security-web-6.4.2.jar:6.4.2]
	at org.springframework.security.web.ObservationFilterChainDecorator$ObservationFilter.doFilter(ObservationFilterChainDecorator.java:227) ~[spring-security-web-6.4.2.jar:6.4.2]
	at org.springframework.security.web.ObservationFilterChainDecorator$VirtualFilterChain.doFilter(ObservationFilterChainDecorator.java:137) ~[spring-security-web-6.4.2.jar:6.4.2]
	at org.springframework.security.web.context.request.async.WebAsyncManagerIntegrationFilter.doFilterInternal(WebAsyncManagerIntegrationFilter.java:62) ~[spring-security-web-6.4.2.jar:6.4.2]
	at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:116) ~[spring-web-6.2.1.jar:6.2.1]
	at org.springframework.security.web.ObservationFilterChainDecorator$ObservationFilter.wrapFilter(ObservationFilterChainDecorator.java:240) ~[spring-security-web-6.4.2.jar:6.4.2]
	at org.springframework.security.web.ObservationFilterChainDecorator$ObservationFilter.doFilter(ObservationFilterChainDecorator.java:227) ~[spring-security-web-6.4.2.jar:6.4.2]
	at org.springframework.security.web.ObservationFilterChainDecorator$VirtualFilterChain.doFilter(ObservationFilterChainDecorator.java:137) ~[spring-security-web-6.4.2.jar:6.4.2]
	at org.springframework.security.web.session.DisableEncodeUrlFilter.doFilterInternal(DisableEncodeUrlFilter.java:42) ~[spring-security-web-6.4.2.jar:6.4.2]
	at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:116) ~[spring-web-6.2.1.jar:6.2.1]
	at org.springframework.security.web.ObservationFilterChainDecorator$ObservationFilter.wrapFilter(ObservationFilterChainDecorator.java:240) ~[spring-security-web-6.4.2.jar:6.4.2]
	at org.springframework.security.web.ObservationFilterChainDecorator$AroundFilterObservation$SimpleAroundFilterObservation.lambda$wrap$0(ObservationFilterChainDecorator.java:323) ~[spring-security-web-6.4.2.jar:6.4.2]
	at org.springframework.security.web.ObservationFilterChainDecorator$ObservationFilter.doFilter(ObservationFilterChainDecorator.java:224) ~[spring-security-web-6.4.2.jar:6.4.2]
	at org.springframework.security.web.ObservationFilterChainDecorator$VirtualFilterChain.doFilter(ObservationFilterChainDecorator.java:137) ~[spring-security-web-6.4.2.jar:6.4.2]
	at org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:233) ~[spring-security-web-6.4.2.jar:6.4.2]
	at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:191) ~[spring-security-web-6.4.2.jar:6.4.2]
	at org.springframework.web.filter.CompositeFilter$VirtualFilterChain.doFilter(CompositeFilter.java:113) ~[spring-web-6.2.1.jar:6.2.1]
	at org.springframework.web.servlet.handler.HandlerMappingIntrospector.lambda$createCacheFilter$3(HandlerMappingIntrospector.java:243) ~[spring-webmvc-6.2.1.jar:6.2.1]
	at org.springframework.web.filter.CompositeFilter$VirtualFilterChain.doFilter(CompositeFilter.java:113) ~[spring-web-6.2.1.jar:6.2.1]
	at org.springframework.web.filter.CompositeFilter.doFilter(CompositeFilter.java:74) ~[spring-web-6.2.1.jar:6.2.1]
	at org.springframework.security.config.annotation.web.configuration.WebMvcSecurityConfiguration$CompositeFilterChainProxy.doFilter(WebMvcSecurityConfiguration.java:238) ~[spring-security-config-6.4.2.jar:6.4.2]
	at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:362) ~[spring-web-6.2.1.jar:6.2.1]
	at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:278) ~[spring-web-6.2.1.jar:6.2.1]
	at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:67) ~[undertow-servlet-2.3.18.Final.jar:2.3.18.Final]
	at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) ~[undertow-servlet-2.3.18.Final.jar:2.3.18.Final]
	at org.springframework.web.filter.RequestContextFilter.doFilterInternal(RequestContextFilter.java:100) ~[spring-web-6.2.1.jar:6.2.1]
	at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:116) ~[spring-web-6.2.1.jar:6.2.1]
	at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:67) ~[undertow-servlet-2.3.18.Final.jar:2.3.18.Final]
	at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) ~[undertow-servlet-2.3.18.Final.jar:2.3.18.Final]
	at org.springframework.web.filter.FormContentFilter.doFilterInternal(FormContentFilter.java:93) ~[spring-web-6.2.1.jar:6.2.1]
	at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:116) ~[spring-web-6.2.1.jar:6.2.1]
	at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:67) ~[undertow-servlet-2.3.18.Final.jar:2.3.18.Final]
	at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) ~[undertow-servlet-2.3.18.Final.jar:2.3.18.Final]
	at org.springframework.session.web.http.SessionRepositoryFilter.doFilterInternal(SessionRepositoryFilter.java:142) ~[spring-session-core-3.4.1.jar:3.4.1]
	at org.springframework.session.web.http.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:82) ~[spring-session-core-3.4.1.jar:3.4.1]
	at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:362) ~[spring-web-6.2.1.jar:6.2.1]
	at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:278) ~[spring-web-6.2.1.jar:6.2.1]
	at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:67) ~[undertow-servlet-2.3.18.Final.jar:2.3.18.Final]
	at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) ~[undertow-servlet-2.3.18.Final.jar:2.3.18.Final]
	at org.springframework.web.filter.ServerHttpObservationFilter.doFilterInternal(ServerHttpObservationFilter.java:114) ~[spring-web-6.2.1.jar:6.2.1]
	at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:116) ~[spring-web-6.2.1.jar:6.2.1]
	at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:67) ~[undertow-servlet-2.3.18.Final.jar:2.3.18.Final]
	at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) ~[undertow-servlet-2.3.18.Final.jar:2.3.18.Final]
	at io.sentry.spring.jakarta.tracing.SentryTracingFilter.doFilterWithTransaction(SentryTracingFilter.java:112) ~[sentry-spring-jakarta-8.0.0-rc.3.jar:na]
	at io.sentry.spring.jakarta.tracing.SentryTracingFilter.doFilterInternal(SentryTracingFilter.java:89) ~[sentry-spring-jakarta-8.0.0-rc.3.jar:na]
	at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:116) ~[spring-web-6.2.1.jar:6.2.1]
	at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:67) ~[undertow-servlet-2.3.18.Final.jar:2.3.18.Final]
	at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) ~[undertow-servlet-2.3.18.Final.jar:2.3.18.Final]
	at org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:201) ~[spring-web-6.2.1.jar:6.2.1]
	at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:116) ~[spring-web-6.2.1.jar:6.2.1]
	at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:67) ~[undertow-servlet-2.3.18.Final.jar:2.3.18.Final]
	at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) ~[undertow-servlet-2.3.18.Final.jar:2.3.18.Final]
	at io.sentry.spring.jakarta.SentrySpringFilter.doFilterInternal(SentrySpringFilter.java:76) ~[sentry-spring-jakarta-8.0.0-rc.3.jar:na]
	at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:116) ~[spring-web-6.2.1.jar:6.2.1]
	at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:67) ~[undertow-servlet-2.3.18.Final.jar:2.3.18.Final]
	at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) ~[undertow-servlet-2.3.18.Final.jar:2.3.18.Final]
	at io.undertow.servlet.handlers.FilterHandler.handleRequest(FilterHandler.java:84) ~[undertow-servlet-2.3.18.Final.jar:2.3.18.Final]
	at io.undertow.servlet.handlers.security.ServletSecurityRoleHandler.handleRequest(ServletSecurityRoleHandler.java:62) ~[undertow-servlet-2.3.18.Final.jar:2.3.18.Final]
	at io.undertow.servlet.handlers.ServletChain$1.handleRequest(ServletChain.java:68) ~[undertow-servlet-2.3.18.Final.jar:2.3.18.Final]
	at io.undertow.servlet.handlers.ServletDispatchingHandler.handleRequest(ServletDispatchingHandler.java:36) ~[undertow-servlet-2.3.18.Final.jar:2.3.18.Final]
	at io.undertow.servlet.handlers.RedirectDirHandler.handleRequest(RedirectDirHandler.java:68) ~[undertow-servlet-2.3.18.Final.jar:2.3.18.Final]
	at io.undertow.servlet.handlers.security.SSLInformationAssociationHandler.handleRequest(SSLInformationAssociationHandler.java:117) ~[undertow-servlet-2.3.18.Final.jar:2.3.18.Final]
	at io.undertow.servlet.handlers.security.ServletAuthenticationCallHandler.handleRequest(ServletAuthenticationCallHandler.java:57) ~[undertow-servlet-2.3.18.Final.jar:2.3.18.Final]
	at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) ~[undertow-core-2.3.18.Final.jar:2.3.18.Final]
	at io.undertow.security.handlers.AbstractConfidentialityHandler.handleRequest(AbstractConfidentialityHandler.java:46) ~[undertow-core-2.3.18.Final.jar:2.3.18.Final]
	at io.undertow.servlet.handlers.security.ServletConfidentialityConstraintHandler.handleRequest(ServletConfidentialityConstraintHandler.java:64) ~[undertow-servlet-2.3.18.Final.jar:2.3.18.Final]
	at io.undertow.security.handlers.AuthenticationMechanismsHandler.handleRequest(AuthenticationMechanismsHandler.java:60) ~[undertow-core-2.3.18.Final.jar:2.3.18.Final]
	at io.undertow.servlet.handlers.security.CachedAuthenticatedSessionHandler.handleRequest(CachedAuthenticatedSessionHandler.java:77) ~[undertow-servlet-2.3.18.Final.jar:2.3.18.Final]
	at io.undertow.security.handlers.AbstractSecurityContextAssociationHandler.handleRequest(AbstractSecurityContextAssociationHandler.java:43) ~[undertow-core-2.3.18.Final.jar:2.3.18.Final]
	at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) ~[undertow-core-2.3.18.Final.jar:2.3.18.Final]
	at io.undertow.servlet.handlers.SendErrorPageHandler.handleRequest(SendErrorPageHandler.java:52) ~[undertow-servlet-2.3.18.Final.jar:2.3.18.Final]
	at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) ~[undertow-core-2.3.18.Final.jar:2.3.18.Final]
	at io.undertow.servlet.handlers.ServletInitialHandler.handleFirstRequest(ServletInitialHandler.java:276) ~[undertow-servlet-2.3.18.Final.jar:2.3.18.Final]
	at io.undertow.servlet.handlers.ServletInitialHandler$2.call(ServletInitialHandler.java:135) ~[undertow-servlet-2.3.18.Final.jar:2.3.18.Final]
	at io.undertow.servlet.handlers.ServletInitialHandler$2.call(ServletInitialHandler.java:132) ~[undertow-servlet-2.3.18.Final.jar:2.3.18.Final]
	at io.undertow.servlet.core.ServletRequestContextThreadSetupAction$1.call(ServletRequestContextThreadSetupAction.java:48) ~[undertow-servlet-2.3.18.Final.jar:2.3.18.Final]
	at io.undertow.servlet.core.ContextClassLoaderSetupAction$1.call(ContextClassLoaderSetupAction.java:43) ~[undertow-servlet-2.3.18.Final.jar:2.3.18.Final]
	at io.undertow.servlet.handlers.ServletInitialHandler.dispatchRequest(ServletInitialHandler.java:256) ~[undertow-servlet-2.3.18.Final.jar:2.3.18.Final]
	at io.undertow.servlet.handlers.ServletInitialHandler$1.handleRequest(ServletInitialHandler.java:101) ~[undertow-servlet-2.3.18.Final.jar:2.3.18.Final]
	at io.undertow.server.Connectors.executeRootHandler(Connectors.java:395) ~[undertow-core-2.3.18.Final.jar:2.3.18.Final]
	at io.undertow.server.HttpServerExchange$1.run(HttpServerExchange.java:861) ~[undertow-core-2.3.18.Final.jar:2.3.18.Final]
	at java.base/java.lang.VirtualThread.run(Unknown Source) ~[na:na]

adinauer · 2024-12-27T06:47:52Z

Hey, in Sentry v8 a lot has changed, but so far there's no other reports of memory leaks.

Do you happen to have a heap dump that you can analyze?
Or if you're able to reproduce this behaviour on another system, you could capture a heap dump there.

How much memory do you have available?

Do you have some memory stats from before and after upgrading?
Was the system already close to MAX before the upgrade?
Does memory usage just creep up over time?
Does GC have any effect on memory?

I'll do some more testing and report back here.

bjornharvold · 2024-12-29T03:45:56Z

Hi @adinauer

Memory varies from server to server. Anywhere from 1Gb to 4Gb.
Cannot see an increase in memory usage with v8 so doesn't look like a memory leak.
Memory utilization is consistently at 60% before and after upgrade.
Cloud Run cannot give us heap / thread dumps

Next we will disable Sentry completely to make 100% sure that this is a Sentry issue and not something else.

bjornharvold · 2025-01-01T08:56:36Z

We just made a release with setting sentry.enabled=false in our production environment. We did not remove the Sentry Spring Boot starter dependency FYI. The apps still freeze. So this is possibly not a Sentry issue after all.

Happy New Year 🎆

adinauer · 2025-01-02T06:56:43Z

Thanks for the update. Please let us know if you need more help from us.
Happy New Year

adinauer · 2025-01-13T13:19:25Z

@bjornharvold any news regarding whether the issue goes away when removing Sentry completely from your application?

bjornharvold · 2025-01-14T08:41:34Z

Hi @adinauer

We only disabled Sentry and upgraded to Spring Boot 3.4.0. The apps hung [in production / not staging]. Assuming Sentry is not involved at this point but some other memory related issue.

Holding off with 3.4.0 upgrade until we have more cycles to test. Busy ATM with new features and we cannot have the production servers go down every time we test. Really sucks that we can't get thread / heap dump from GCP Cloud Run.

🫤

adinauer · 2025-01-14T09:25:16Z

Thanks for the update. Very understandable. No rush from our side here.

We'll consider things stable for now then.
We'll communicate that v8 of the Sentry Java SDK supports Spring Boot 3.4.

Please let us know if you have any further updates.

adinauer added the Platform: Java label Nov 29, 2024

github-project-automation bot added this to Mobile & Cross Platform SDK Nov 29, 2024

github-project-automation bot moved this to Needs Discussion in Mobile & Cross Platform SDK Nov 29, 2024

bjornharvold mentioned this issue Dec 1, 2024

Spring Boot v3.4.0 causes our staging & production environment to hang and time out spring-projects/spring-boot#43332

Closed

getsantry bot added the Waiting for: Product Owner label Dec 1, 2024

getsantry bot moved this to Waiting for: Product Owner in GitHub Issues with 👀 3 Dec 1, 2024

getsantry bot added this to GitHub Issues with 👀 3 Dec 1, 2024

adinauer self-assigned this Dec 2, 2024

adinauer mentioned this issue Dec 2, 2024

[Java] Performance powered by OpenTelemetry #3752

Open

getsantry bot removed the Waiting for: Product Owner label Dec 2, 2024

getsantry bot removed the status in GitHub Issues with 👀 3 Dec 2, 2024

adinauer mentioned this issue Dec 2, 2024

Bump Spring Boot to 3.4.0 #3939

Merged

7 tasks

getsantry bot added the Waiting for: Product Owner label Dec 3, 2024

getsantry bot moved this to Waiting for: Product Owner in GitHub Issues with 👀 3 Dec 3, 2024

getsantry bot removed the Waiting for: Product Owner label Dec 3, 2024

getsantry bot removed the status in GitHub Issues with 👀 3 Dec 3, 2024

getsantry bot added the Waiting for: Product Owner label Dec 4, 2024

getsantry bot moved this to Waiting for: Product Owner in GitHub Issues with 👀 3 Dec 4, 2024

getsantry bot removed the Waiting for: Product Owner label Dec 4, 2024

getsantry bot removed the status in GitHub Issues with 👀 3 Dec 4, 2024

adinauer mentioned this issue Dec 5, 2024

Bump start.spring.io version and Spring Boot compat versions #3931

Open

getsantry bot added the Waiting for: Product Owner label Dec 6, 2024

getsantry bot added the Waiting for: Product Owner label Dec 21, 2024

getsantry bot moved this to Waiting for: Product Owner in GitHub Issues with 👀 3 Dec 21, 2024

getsantry bot removed the Waiting for: Product Owner label Dec 23, 2024

getsantry bot removed the status in GitHub Issues with 👀 3 Dec 23, 2024

getsantry bot added the Waiting for: Product Owner label Dec 25, 2024

getsantry bot moved this to Waiting for: Product Owner in GitHub Issues with 👀 3 Dec 25, 2024

getsantry bot removed the Waiting for: Product Owner label Dec 27, 2024

getsantry bot removed the status in GitHub Issues with 👀 3 Dec 27, 2024

getsantry bot added the Waiting for: Product Owner label Dec 29, 2024

getsantry bot moved this to Waiting for: Product Owner in GitHub Issues with 👀 3 Dec 29, 2024

getsantry bot removed the Waiting for: Product Owner label Jan 2, 2025

getsantry bot removed the status in GitHub Issues with 👀 3 Jan 2, 2025

getsantry bot added the Waiting for: Product Owner label Jan 14, 2025

getsantry bot moved this to Waiting for: Product Owner in GitHub Issues with 👀 3 Jan 14, 2025

getsantry bot removed the Waiting for: Product Owner label Jan 14, 2025

getsantry bot removed the status in GitHub Issues with 👀 3 Jan 14, 2025

adinauer mentioned this issue Jan 14, 2025

Mention Spring Boot 3.4 compatibility in Changelog #4049

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Bump Spring Boot to 3.4 #3941

Bump Spring Boot to 3.4 #3941

adinauer commented Nov 29, 2024

bjornharvold commented Dec 1, 2024

adinauer commented Dec 2, 2024

bjornharvold commented Dec 3, 2024

adinauer commented Dec 3, 2024

bjornharvold commented Dec 4, 2024 •

edited

Loading

adinauer commented Dec 4, 2024

adinauer commented Dec 6, 2024 •

edited

Loading

bjornharvold commented Dec 6, 2024

adinauer commented Dec 23, 2024

bjornharvold commented Dec 25, 2024

bjornharvold commented Dec 25, 2024

bjornharvold commented Dec 26, 2024

bjornharvold commented Dec 26, 2024

adinauer commented Dec 27, 2024

bjornharvold commented Dec 29, 2024

bjornharvold commented Jan 1, 2025

adinauer commented Jan 2, 2025

adinauer commented Jan 13, 2025

bjornharvold commented Jan 14, 2025

adinauer commented Jan 14, 2025

Bump Spring Boot to 3.4 #3941

Bump Spring Boot to 3.4 #3941

Comments

adinauer commented Nov 29, 2024

Description

bjornharvold commented Dec 1, 2024

adinauer commented Dec 2, 2024

bjornharvold commented Dec 3, 2024

adinauer commented Dec 3, 2024

bjornharvold commented Dec 4, 2024 • edited Loading

adinauer commented Dec 4, 2024

adinauer commented Dec 6, 2024 • edited Loading

bjornharvold commented Dec 6, 2024

adinauer commented Dec 23, 2024

bjornharvold commented Dec 25, 2024

bjornharvold commented Dec 25, 2024

bjornharvold commented Dec 26, 2024

bjornharvold commented Dec 26, 2024

adinauer commented Dec 27, 2024

bjornharvold commented Dec 29, 2024

bjornharvold commented Jan 1, 2025

adinauer commented Jan 2, 2025

adinauer commented Jan 13, 2025

bjornharvold commented Jan 14, 2025

adinauer commented Jan 14, 2025

bjornharvold commented Dec 4, 2024 •

edited

Loading

adinauer commented Dec 6, 2024 •

edited

Loading