TestExecute fails every region checkpoint on VM

[kylegogtp]

Hi,

I am running tests on a VM using TestExecute. I am running it at the same resolution as the main test machine I use to create them. And all browser settings are the same. The comparisons also look the same.

I am not sure what else to check.

[tristaanogre]

Different OS?  Different color settings?

Image comparison checkpoints are NOTORIOUS for being imprecise.  When doing the checkpoint, the log should show a "mask" showing, in red, the different pixels.  Anything stand out?  Is there a "date" or "time" on screen that is different each time?  Lots of things could cause a difference... even if everything is exact, there's always a little bit that's off...

[BenoitB]

Yes, its hard to make image comparison robust and reliable. But still achievable.

Some hints:

- create region reference image on the same computer the test run

- use mask

- use pixel and color tolerance

[Bobik]

I guess you have a different color depth or windows themes.

So, the region checkpoint doesn't lie. Pictures are really different.

[sonya_m]

Thank you Community for great suggestions here.

@kylegogtp were you able to solve this using the suggestions? Please share.

[kylegogtp]

I haven't been able to try yet. I started moving tests to TestExecute because of my other issue I posted about chromium edge. The VM still had the "legacy" edge. I reinstalled windows on my test machine and have been getting the tests to work on the original machine again.

[sonya_m]

Thank you for the update @kylegogtp , keep us posted and the Community will see how esle we can help.