Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[v1.33.1] assertVisible is producing false positives in Maestro Studio #1532

Open
clmoore28 opened this issue Oct 17, 2023 · 5 comments
Open
Labels
bug Something isn't working

Comments

@clmoore28
Copy link

Describe the bug
Maestro Studio is not failing the assertVisible assertions when the elements do not exist.

To Reproduce

  1. Start the simulator for a React Native project on iOS or Android
  2. Run Maestro Studio
  3. Manually run an assertVisible assertion in the commands box for any ID that does not exist

Expected behavior
The command fails.

Screenshots
image

Environment information (please complete the following information):

  • Maestro version v1.33.1
  • Platform: iOS v17.0 & Android v13, but possibly across others.
  • Framework: React Native
  • Device model and OS version: All iPhone emulators and Android devices.
  • Simulator, emulator or physical device: Simulators/emulators and physical devices.
  • Host [e.g. Mac M1, Windows, Linux, etc]: Mac M1
@clmoore28 clmoore28 added the bug Something isn't working label Oct 17, 2023
@hackgoofer
Copy link

It is affecting me too

@rikur
Copy link

rikur commented Dec 28, 2023

Any assertVisible or assertNotVisible seems to "pass" in Studio

@rob4226
Copy link

rob4226 commented Mar 16, 2024

Still happening in v1.36.0, it seems every command succeeds in studio when it should really fail.

Related issue #1617.

@NorseGaud
Copy link

NorseGaud commented Oct 19, 2024

Same here. Super odd... I do something like

- assertVisible:
    id: "save-mem"
    enabled: true

And it's green even though the button is disabled.

On 1.39.0

@mwmcode
Copy link

mwmcode commented Feb 14, 2025

Still happening in 1.39.13

- assertVisible:
    text: "My Button"
    enabled: true

Would pass ✅ even though there is no such button on the screen (or in the whole app for that matter).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

6 participants