Forum Discussion

Florian_Hofmann's avatar
Florian_Hofmann
Contributor
10 years ago

Log analysis by groups rather than items

Hi everybody, maybe I'm lacking some imagination and just don't find the right words that might provide me with an answer from existing sources (or make for a more descriptive subject), sorry if ye...
  • Marsha_R's avatar
    Marsha_R
    10 years ago
    Hi Florian -



    We also have some tests that are repeated many times with different data, but we don't exclude them from the log because sometimes the data itself is a clue to finding the root cause of a test failure.  



    What we did do in our logs is start using the Group feature and the Append Log and Pop Log features inside all of our tests.  We use an Append/Pop for the beginning and end of each test, at the beginning and end of each Group, and at the beginning and end of any loops.  



    Take a look at my screenshot.  It looks like a lot of extra work in the code but each of those indents in the log is an Append and that really helps the readability when a test step fails.
Florian_Hofmann's avatar
Florian_Hofmann
Contributor
10 years ago
Since I can't seem to find the "edit" button, I write here what I tried so far:



For all items associated with testcases, I added a Description starting with "Testcase" followed by the JIRA key. 



In a "Parameter" item, I introduced a variable, by dim folder_main



At the very beginning of the project, there is some item that uses 'USEUNIT Parameter to refer to that variable:

folder_main=log.CreateFolder("main")

log.PushLogFolder(folder_main) 





Then I use a OnStartTestEvent Handler(including 'USEUNIT Parameter) that by regular expressions checks if Project.TestItems.Current.Description matches "Testcase.*"

If yes, I use 

dim Folder


Folder=Log.CreateFolder(itemDescription, , , ,folder_main)


Log.PushLogFolder(Folder)  







I also have an OnStartTestEvent Handler, quite similar except that on stopping items with descriptions starting with "Testcase", it invokes

Log.PopLogFolder(itemDescription)





In between, there's an OnStartErrorEvent Handler that also checks for a description starting with "testcase" and invoking

Log.Message("Error")





Now after a run, I would expect my log to contain some folder "folder_main" with subfolders named according to the description of the relevant items.

This does not seem to be the case. Where did I go wrong?