TestExecute fails every region checkpoint on VM
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
TestExecute fails every region checkpoint on VM
Hi,
I am running tests on a VM using TestExecute. I am running it at the same resolution as the main test machine I use to create them. And all browser settings are the same. The comparisons also look the same.
I am not sure what else to check.
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Different OS? Different color settings?
Image comparison checkpoints are NOTORIOUS for being imprecise. When doing the checkpoint, the log should show a "mask" showing, in red, the different pixels. Anything stand out? Is there a "date" or "time" on screen that is different each time? Lots of things could cause a difference... even if everything is exact, there's always a little bit that's off...
Robert Martin
[Hall of Fame]
Please consider giving a Kudo if I write good stuff
----
Why automate? I do automated testing because there's only so much a human being can do and remain healthy. Sleep is a requirement. So, while people sleep, automation that I create does what I've described above in order to make sure that nothing gets past the final defense of the testing group.
I love good food, good books, good friends, and good fun.
Mysterious Gremlin Master
Vegas Thrill Rider
Extensions available
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Yes, its hard to make image comparison robust and reliable. But still achievable.
Some hints:
- create region reference image on the same computer the test run
- use mask
- use pixel and color tolerance
Un sourire et ça repart
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I guess you have a different color depth or windows themes.
So, the region checkpoint doesn't lie. Pictures are really different.
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Thank you Community for great suggestions here.
@kylegogtp were you able to solve this using the suggestions? Please share.
Sonya Mihaljova
Community and Education Specialist
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I haven't been able to try yet. I started moving tests to TestExecute because of my other issue I posted about chromium edge. The VM still had the "legacy" edge. I reinstalled windows on my test machine and have been getting the tests to work on the original machine again.
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Thank you for the update @kylegogtp , keep us posted and the Community will see how esle we can help.
Sonya Mihaljova
Community and Education Specialist
