Forum Discussion

shankar_r's avatar
shankar_r
Community Hero
8 years ago

Automation Execution Report

Apart from Test Complete logs, Does anybody have worked different kind of reports that can be generated for each test case. Something like HTML or Excel or some other which we will have Expected results Actual results for a step and etc.

 

  • sanjay0288's avatar
    sanjay0288
    Frequent Contributor

    Hi,

      Yes have worked on Excel as well as HTML reporting formats. Can you please let me know what exactly are  you looking for and which scripting language are you using; which you don't say specifically in your post. As a heads up  I am attaching screenshot of a  sample excel result file which might be of some help to you in designing a reporting structure depending your project needs.

     

    Regards,

    Sanjay

    • Colin_McCrae's avatar
      Colin_McCrae
      Community Hero

      Yep.

       

      I seldom use the built in reporting. I wrote all my own custom stuff which is now embedded into my framework. Built-in stuff is only really used by me during building and debugging of test fixtures. Live stuff almost exclusively uses my results and logs.

       

      Input data is all provided on Excel sheets (and small text, SQL, whatever else is required - files. These are referenced from the main input sheet). These Excel sheets then become results files. It writes a result sheet per test pack. And then compiles a summary sheet, with headline numbers for all packs in the run, and overall totals & percentages, at the end. The summary sheet contains clickable links to the results sheets for each pack, and the log file for each as well. (I write my own log files too) Input data and expected results are all present as it's the input sheet used for results as well.

       

      It takes counts on total test steps. Passes, fails, errors, warnings etc. Everything is timestamped and colour coded. Counts are both at test step and test case (as per TFS - which I link into and write to during runs) level. One test "pack" contains many TFS tests "cases", each of which is made up of multiple TestComplete test "steps".

       

      All this is stored locally or networked. (Which is a setting I can adjust)

       

      And the summary is mailed to set of people specified at the end of the teardown pack at the end. (If required - it's configurable again)

       

      I also write out a small HTML file with basic headline numbers and file links. If the run is done as part of the build process (some are, some aren't), the build process picks up this HTML file and presents it as tab on the web page with the build results.

       

      That's how it all works. I can't really post any code examples for this as it's an entire framework so it's a fairly large and complex thing.

      • shankar_r's avatar
        shankar_r
        Community Hero

        Colin_McCrae  Thanks for sharing your experience with Reporting. got some ideas how to make it.

         

        sanjay0288I'm looking for HTML and Excel reports. And currently using JavaScript.

         

        I will give a try with your words in script. :)