Showing ideas with label Test Results.
Show all ideas
When we have a project that integrates to Cucumber, we have the option to have TestComplete push results to Cucumber during a test run. The process of pushing results seems to be somewhat fragile (as any REST API interaction is), with timeout errors etc every once in a while. Any kind of error whilst pushing to Cucumber is logged as a RED ERROR that cannot be intercepted (even if intercepted, TestComplete logs the error anyway). If we use CI/CD to run our tests, pushing to Cucumber errors will halt the CI/CD process (since there is an error in the logs). However, just because pushing the results to Cucumber has failed, doesn't mean that the test run itself was a fail. Our CI/CD process should be able to continue (depending on project configuration). I am suggesting an option somewhere in the project to set whether any Cucumber pushing error should be displayed as an ERROR or a WARNING. This way we could set the project to throw a WARNING, if the pushing to cucumber fails, instead of an error. Then, if that was the only thing that went wrong, the CI/CD process could continue.
... View more
See more ideas labeled with:
-
Test Results
Currently there it is just logged with what exe & version & parameters passed. From past experience it would be good to have following details logged too: Configured session details - Run interactive user session flag - Use active session flag - Session screen resolution (sample 2560x1440) The real facts from the Session Desktop during test execution - Is it an interactive user session? - Is an already active session used or did the test runner created a new one? - Session screen resolution (sample 1679x551 which does not match the requested one see above)
... View more
See more ideas labeled with:
-
Command Line
-
Distributed Testing
-
Test Results
-
Web Testing
Instead of limiting the number of logs kept by Test Complete by a count, it would be nice if it they could be limited by a time period. For example, keep the last Month of test logs. This would be useful for users who run a high volume of tests in a short amount of time, but would still like to keep their output logs under control and accessible.
... View more
See more ideas labeled with:
-
Desktop Testing
-
Keyword Tests
-
Test Results
-
Visualizer
A good to have feature would be if the Log report summary can include a logo of your respective company. Branding is important to many organizations and we see this as an advantage when the PDF can be shared with a specific logo.
... View more
See more ideas labeled with:
-
Test Results
While the new sharing results options are quite handy, for an enterprise scenario the 2-week window is too less. An option for unlimited time would be needed. Please consider increasing the time limit duration. Also, the share option saves company information in the Smartbear server. We need an option that will save the log locally without the smartbear URL.
... View more
See more ideas labeled with:
-
Test Results
When I check logs, I always have to: enlarge the block with the screenshot to immediately see which elements are in action expand the test case tree on the left to see which test case we are checking at the moment. I suppose that other users also suffer from such inconveniences, and maybe they have other wishes to view the logs. That's why I think it should be possible to adjust the display once and keep it. So that you don't have to change the display of the log window every time you run test cases.
... View more
See more ideas labeled with:
-
Test Results
-
Web Testing
Azure DevOps seems to be a popular option these days. Please consider adding the following as a feature in the near future. 1. Post Bugs from Test complete to Azure DevOps 2. Post Work Item from TestComplete to Azure DevOps 3. Upload Test Plan from TestComplete to ADO.
... View more
See more ideas labeled with:
-
Keyword Tests
-
Script Extensions
-
Test Results
Log files can take up lots of space on a HDD
You have the option to limit the number of log files kept, but this is not always the answer you are looking for
The logs could be stored in another location possibly a network location which will save resources on the local computer
(would store locally if location not available - drive offline)
... View more
See more ideas labeled with:
-
Test Results
Status:
New Idea
Submitted on
11-09-2022
01:23 AM
Submitted by
tomasmica2412
on
11-09-2022
01:23 AM
Hi, It would be very useful to get instant test logs during test execution. Currently TestComplete does not provide a scripting interface to the test log of the current run. it is very limiting for us. We have desktop UI tests with several hours execution and waiting for the log result is very impractical. I think it would be nice to support for example Elasticsearch live logging like many other modern test frameworks, not only HTML reporting that is very outdated today.
... View more
See more ideas labeled with:
-
Data-Driven Testing
-
Desktop Testing
-
Keyword Tests
-
Test Results
Status:
New Idea
Submitted on
06-04-2021
07:21 AM
Submitted by
nandinipalani
on
06-04-2021
07:21 AM
Good to Include Screenshot in the summary log report as an evidence report This helps the readability of the execution It can be extracted and share the results to the manual team It acts a TC document which can be used an KT document for the new joiners It acts as a proof for raising a bug incase of failure
... View more
See more ideas labeled with:
-
Test Results
Hey, it would be great if the log would not display the whole screen from 3 monitors which are in use. Better would be that TestComplete checks where the tested application runs and just make screenshots for the log from this monitor - or implement an option to choose which monitor should be logged. Attached is a screenshot from a log with 3 monitors.
... View more
See more ideas labeled with:
-
Desktop Testing
-
Keyword Tests
-
Test Results
-
Visualizer
Please provide ability to develop Testcomplete tests using VS Code (dll). No need to include namemapping or object spy feature. Just create an extension for quick test script development and execution using TestExecute.
... View more
See more ideas labeled with:
-
Desktop Testing
-
Mobile Testing
-
Test Results
-
Web Testing
Please have an alternative to read mht file, because of the end of life of Internet Explorer. Also change the default report type from Azure DevOps. The default report type is now mht which it cannot be used from June 15 2022.
... View more
See more ideas labeled with:
-
Test Results
The screenshots in the Log files on the file directory would be much more useful outside of Test Complete if you could specify the filename when the screenshot is taken. Ideally, you would be able to specify the filenames always, but at least it should be an option to specify the filename of a screenshot when one uses the Post Screenshot Operation.
... View more
See more ideas labeled with:
-
Keyword Tests
-
Test Results
-
Visualizer
When executing test cases in Test Complete or Test Execute via the command line, you can specify which folder to write the test results to but CAN NOT specificy Zephyr Folder. Please add support for Test Complete/Test Execute to write results to Zephyr Folders via command line (or other executions)
... View more
See more ideas labeled with:
-
Command Line
-
Test Results
Hi there, we have a scenario where a single script decides which tests run and then runs the tests. This causes all logs to have the same name: Script Test Log [ScriptUnit\scriptName] It would be great if this script could rename the log items. More information: http://community.smartbear.com/t5/Getting-Started-with/Rename-test-logs/m-p/116832 Greetings, vat
... View more
See more ideas labeled with:
-
Test Results
It would be very useful to have a feature where the test logs can be automatically generated to PDF files. Essentially, rather than manually generate a PDF report as an export as instructed in Test Complete documentation: https://support.smartbear.com/testcomplete/docs/testing-with/log/working-with/exporting/index.html#pdf have the PDF report generate with a simple "writeLogToPDF" command. Thanks for your consideration!
... View more
See more ideas labeled with:
-
Checkpoints
-
Desktop Testing
-
Keyword Tests
-
Test Results
Status:
New Idea
Submitted on
05-01-2020
02:23 PM
Submitted by
garyschechter
on
05-01-2020
02:23 PM
I thought this should just be a feature already and I posted asking for help to get it to work. https://community.smartbear.com/t5/TestComplete-General-Discussions/Log-Folder-Icon-Checkpoint-Over-Message-Javascript/m-p/200736#M37434 The log folders are real nice for cleaning up the logs but they only change Icon's if the Folder contains an Error or a Warning. I want LogFolders to show a green if it contains a checkpoint. A common sense order of importance Error > Warning > Checkpoint > Message. Instead it's showing Error > Warning > Message. I think it should even auto detect based on the Log item's priority that has been set. Or just a method to hit ie, Log.CurrentStack(iconWarning, priorityHigh); function TestScriptLog()
{
Log.AppendFolder("This folder Icon should be an Error");
Log.Message("Informational in Folder","",pmNormal);
Log.Checkpoint("Checkpoint in Folder","",pmNormal);
Log.Warning("Warning in Folder","",pmNormal);
Log.Error("Error in Folder","",pmHighest);
Log.PopLogFolder();
Log.AppendFolder("This folder Icon should be an Error");
Log.Message("Informational in Folder");
Log.Checkpoint("Checkpoint in Folder");
Log.Warning("Warning in Folder");
Log.Error("Error in Folder");
Log.PopLogFolder();
Log.AppendFolder("This folder Icon should be a Warning");
Log.Message("Informational in Folder","",pmNormal);
Log.Checkpoint("Checkpoint in Folder","",pmNormal);
Log.Warning("Warning in Folder","",pmHighest);
Log.PopLogFolder();
Log.AppendFolder("This folder Icon should be a Warning");
Log.Message("Informational in Folder");
Log.Checkpoint("Checkpoint in Folder");
Log.Warning("Warning in Folder");
Log.PopLogFolder();
Log.AppendFolder("This folder Icon should be a Checkpoint");
Log.Message("Informational in Folder","",pmNormal);
Log.Checkpoint("Checkpoint in Folder","",pmHighest);
Log.PopLogFolder();
Log.AppendFolder("This folder Icon should be a Checkpoint");
Log.Message("Informational in Folder");
Log.Checkpoint("Checkpoint in Folder");
Log.PopLogFolder();
Log.AppendFolder("This folder Icon should be an Informational");
Log.Message("Informational in Folder","",pmHighest);
Log.PopLogFolder();
Log.AppendFolder("This folder Icon should be an Informational");
Log.Message("Informational in Folder");
Log.PopLogFolder();
}
... View more
See more ideas labeled with:
Hello, I work with two monitors and after running Keywordtests the pictures in the log are showing the secound (for testing unused) monitor. It´s not necessary to make a picture of both screens and I think nobody uses two screens for testing. So please change the process of screenshot making limited to one screen only or make it chooseable from which screen pictures are been taken. Attached Screenshot is showing my secound (blank) screen on the left side.
... View more
See more ideas labeled with:
-
Desktop Testing
-
Test Results
-
Visualizer
It would be nice to have an option for the networksuite and the distributed-testing to (automatically) delete the logs on the remote machine (TestExecute) through the normal TestComplete interface.
... View more
See more ideas labeled with:
-
Distributed Testing
-
Test Results
-
Visualizer