How to get the total number of errors at the end of a sequence of tests

Question

Hi,I run a number of tests (organized via "organize tests") and want to report the total sum of errors and warnings (five tests are run automatically one after another).However, in my script Log.ErrCount reports the number of errors in the last test only.I found "Log.FolderErrCount(FolderID)" which might do it - but I don't know where to get the current FolderID.Is there a property avaliable?Regards,- Carsten

dmitry_nikolaev · Answer

Hi Carsten,I am sending you the code which you can use to count errors and warnings:function GetSum(sType);var tempFolder, xDoc, wrnC, errC;begin&nbsp;&nbsp; &nbsp;tempFolder := aqEnvironment.GetEnvironmentVariable('temp')+'\'+IntToStr(Random(10000))+'\';&nbsp;&nbsp; &nbsp;aqFileSystem.CreateFolder(tempFolder);&nbsp;&nbsp; &nbsp;Log.SaveResultsAs(tempFolder, lsXML);&nbsp;&nbsp;&nbsp;&nbsp; &nbsp;xDoc := Sys.OleObject('MSXML2.DOMDocument.4.0');&nbsp;&nbsp; &nbsp;xDoc.load(tempFolder + 'Description.tcLog');&nbsp;&nbsp; &nbsp;//Warning count&nbsp;&nbsp; &nbsp;wrnC := VarToInteger(xDoc.selectSingleNode('Nodes/Node[@name="root"]/Prp[@name="warning count"]/@value').text);&nbsp;&nbsp; &nbsp;//Error count&nbsp;&nbsp; &nbsp;errC := VarToInteger(xDoc.selectSingleNode('Nodes/Node[@name="root"]/Prp[@name="error count"]/@value').text);&nbsp;&nbsp; &nbsp;aqFileSystem.DeleteFolder(tempFolder, True);&nbsp;&nbsp; &nbsp;&nbsp;&nbsp; &nbsp;case sType of&nbsp;&nbsp; &nbsp; &nbsp; &nbsp;'w': result := IntToStr(wrnC);&nbsp;&nbsp; &nbsp; &nbsp; &nbsp;'e': result := IntToStr(errC);&nbsp;&nbsp; &nbsp;else&nbsp;&nbsp; &nbsp; &nbsp; &nbsp;result := 'Wrong parameter'; &nbsp;&nbsp;&nbsp; &nbsp;end;&nbsp;&nbsp;end;procedure PostSum;begin&nbsp;&nbsp;Log.Message('Warning count: ' + GetSum('w'));end;Note that if you run a project, you need to get the summary of errors and warnings using the GetSum function in a routine (in this case, it is PostSum) set as the last test item of the project. If you run a project suite, you need to add a project to the end of the test item list of the project suite. This project should contain the only test item calling the routine that uses the GetSum function.

tlalok · Answer

Hello David,thanks a lot for the code, it works nicely and I just ran the whole test suite and got the result I expected. Now I can inform the team automatically by e-mail about the result of the tests. I included file version in the mail header so everyone knows what version the testlog is about.I don't think I would have figured that one out myself ;-).Best regards,- Carsten

rrubio · Answer

Hi all,I have tried to migrate this code to VisualBasic.However, I do have an error when opening the file (error -1072896636).Does anybody know which the cause could be? I attach the code I have done:Function GetSum(sType)Dim&nbsp; tempFolder, xDoc, wrnC, errC&nbsp;&nbsp;&nbsp; tempFolder = aqEnvironment.GetEnvironmentVariable("temp") &amp; "\" &amp; IntToStr(10000) &amp; "\"&nbsp;&nbsp;&nbsp; aqFileSystem.CreateFolder(tempFolder)&nbsp;&nbsp;&nbsp; Call Log.SaveResultsAs(tempFolder, lsXML, True)&nbsp;&nbsp; &nbsp;&nbsp;&nbsp;&nbsp; Set xDoc = Sys.OleObject("MSXML2.DOMDocument.6.0")&nbsp;&nbsp;&nbsp; Call xDoc.load(tempFolder &amp; "Description.tcLog")&nbsp;&nbsp; &nbsp;&nbsp; ' tested with '&nbsp;&nbsp;&nbsp; Call xDoc.loadXML(tempFolder &amp; "Description.tcLog")&nbsp; ' and result id the same &nbsp;&nbsp;&nbsp; Log.Message ("File load result: " &amp; xDoc.parseError.errorCode)&nbsp;&nbsp;&nbsp; ' Warning count&nbsp;&nbsp;&nbsp; Set wrnC = VarToInteger(xDoc.selectSingleNode("Nodes/Node[@name='root']/Prp[@name='warning count']/@value").text)&nbsp;&nbsp;&nbsp; ' Error count&nbsp;&nbsp;&nbsp; Set errC = VarToInteger(xDoc.selectSingleNode("Nodes/Node[@name='root']/Prp[@name='error count']/@value").text)&nbsp;&nbsp; &nbsp;&nbsp;&nbsp;&nbsp; Call aqFileSystem.DeleteFolder(tempFolder, True)&nbsp;&nbsp; &nbsp;&nbsp;&nbsp;&nbsp; Select Case sType&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Case w: result = IntToStr(wrnC)&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Case e: result = IntToStr(errC)&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Case Else result = "Wrong parameter" &nbsp;&nbsp;&nbsp;&nbsp; End Select&nbsp;&nbsp;&nbsp;&nbsp; &nbsp;End FunctionI have tested in using .load .loadXML methods.I have tested again with a static file to be loaded in another path in Windows Explorer.In all the cases, I get the same error.Thank you very much,Raul

alexeyk · Answer

Raul, This error occurs because the XML parser was unable to process the DOCTYPE instruction in the xml file storing results.Try using this code:Function GetSum(sType)&nbsp;&nbsp;&nbsp; Dim&nbsp; tempFolder, xDoc, wrnC, errC&nbsp;&nbsp;&nbsp; ' Prepare a temporary folder&nbsp;&nbsp;&nbsp; tempFolder = aqEnvironment.GetEnvironmentVariable("temp") &amp; "\" &amp; IntToStr(10000) &amp; "\"&nbsp;&nbsp;&nbsp; aqFileSystem.CreateFolder(tempFolder)&nbsp;&nbsp;&nbsp; &nbsp;&nbsp;&nbsp; ' Save results to an .xml file&nbsp;&nbsp;&nbsp; Call Log.SaveResultsAs(tempFolder, lsXML, True)&nbsp;&nbsp;&nbsp; &nbsp;&nbsp;&nbsp; ' Create an XMLDocument&nbsp;&nbsp;&nbsp; Set xDoc = Sys.OleObject("MSXML2.DOMDocument.4.0")&nbsp;&nbsp;&nbsp; ' Set xDoc = Sys.OleObject("MSXML2.DOMDocument.6.0")&nbsp;&nbsp;&nbsp; ' xDoc.validateOnParse = false&nbsp;&nbsp;&nbsp; ' Load the file&nbsp;&nbsp;&nbsp; Call xDoc.load(tempFolder &amp; "Description.tcLog")&nbsp;&nbsp;&nbsp; &nbsp;&nbsp;&nbsp; ' Check the load result&nbsp;&nbsp;&nbsp; If xDoc.parseError.errorCode &lt;&gt; 0 Then&nbsp; &nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Log.Message "File load result: "&amp; xDoc.parseError.errorCode, _&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; "Error code: "&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; &amp; xDoc.parseError.errorCode &amp; Chr(13) &amp; Chr(10) &amp; _&nbsp; &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; "Description: "&nbsp;&nbsp;&nbsp;&nbsp; &amp; xDoc.parseError.reason &amp; Chr(13) &amp; Chr(10) &amp; _ &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; "Line No: "&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; &amp; xDoc.parseError.line &amp; Chr(13) &amp; Chr(10) &amp; _&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; "Column: "&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; &amp; xDoc.parseError.linepos &amp; Chr(13) &amp; Chr(10) &amp; _&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; "Source text: "&nbsp;&nbsp;&nbsp;&nbsp; &amp; xDoc.parseError.srcText&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Exit Function&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; &nbsp;&nbsp;&nbsp; End If&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; &nbsp;&nbsp;&nbsp; ' Count warnings&nbsp;&nbsp;&nbsp; wrnC = xDoc.selectSingleNode("Nodes/Node[@name='root']/Prp[@name='warning count']/@value").text&nbsp;&nbsp;&nbsp; ' Count errors&nbsp;&nbsp;&nbsp; errC = xDoc.selectSingleNode("Nodes/Node[@name='root']/Prp[@name='error count']/@value").text&nbsp;&nbsp;&nbsp; &nbsp;&nbsp;&nbsp; ' Remove the temporary folder&nbsp;&nbsp;&nbsp; &nbsp;&nbsp;&nbsp; Call aqFileSystem.DeleteFolder(tempFolder, True)&nbsp;&nbsp;&nbsp; &nbsp;&nbsp;&nbsp; ' Return the result&nbsp;&nbsp;&nbsp; Select Case sType&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Case "w" : GetSum = CStr(wrnC)&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Case "e" : GetSum = CStr(errC)&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Case Else&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; GetSum = "Wrong parameter"&nbsp;&nbsp;&nbsp; End Select&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; End Function

rrubio · Answer

Thank you very much.It is working now.Regards,Raul

Forum Discussion

How to get the total number of errors at the end of a sequence of tests

8 Replies

Recent Discussions

ADO Pipeline Execution Fail issue after TC\TE upgrade

RuntimeError: The object does not exist

Fields data to compare?

Related Content

readyapi 3.0 testrunner.sh: Startup sequence

An error occurred [Maximum number of Redirects reached [10]

Locate error line in keyword test by line number