hello @sleepytanya! I think the bug is that the simulation is expected to work in the redesign as it is shown in the old confirmation pages using the same flow.

we can observe no "Estimated Changes" section in the redesign here:

For now, I will unassign myself and put this back into refine status to re-refine next week

& updated the title from:
[Bug]: Simulation metrics become visible exclusively when both the Experimental and Developer redesign toggles are turned off
→ [Bug]: Simulation metrics not captured in the wallet initiated Redesigned Confirmation Send Flow

@digiwand could we still capture the simulation data even if we don't display it to the user? Alternatively, we can display it under advanced view only, but capture the simulation data for both users with advanced view on and users that have it off.

Asking as the send flow is also important for the same leadership ask around metrics.

hello @bschorchit 👋🏼 we could. What I would suggest or question is how we'd distinguish between no results returned vs. not showing the simulation. (I'm not exactly sure of the UI/UX behavior here as I'm writing this.)

Updating metrics to indicate whether the user has seen or has not seen the simulation rendered in the advanced view could be a different feature request

That's a good point.

I think we could infer if the user has seen simulations or not from other properties like:
(1) the transaction type and referrer (these will tell us it's a send started within MM) and
(2)the advanced_view property (this will tell whether the user was seeing advanced view or not - this is not working on prod yet, but I believe it's on develop).

With that we can build a dashboard or even custom property directly on Mixpanel to indicate to us whether the simulations UI was visible to users at transaction time.

Hi team,

I believe I have good news. I tested on 12.7.0 using ETH mainnet, with both toggles on, and through a dapp-initiated send to confirm that the simulation metrics work as expected

note:

• testing on the Sepholia chain did not add the simulation metrics. This may be expected for other chains
• (example flow in the description) wallet-initiated send transactions do not display simulations on the redesign version. Since simulations are not shown on this flow, it is expected not to see simulation metrics

cc: @bschorchit @pedronfigueiredo @sleepytanya

As discussed in an internal slack thread, we will capture simulation metrics even when no estimated changes are shown e.g. when we initiate send through the wallet. We will mirror the same metrics that we use when we display "Estimated Changes" "No changes..."

I've updated the issue post discussion on slack. This continues to be a release blocker for the reasons mentioned earlier above.

For a given transaction, we should see the same simulations metrics when doing it with the improved transactions toggle on and when doing it with the improved transactions toggle off.
Simulations metrics should be capture even when the simulation UI is not visible (only exception is if the user had disabled it themselves).