Integration TestRail and TestComplete

Hi, Is there anyone who has succesfully integrated the TestRail API into TestComplete? I'm working with the VBScripts in TestComplete, but was not yet able to report my results back to TestRail u...

HKosova

9 years ago

I'm not a TestRails expert, but try passing the login/password in the Authorization header:

Dim o, user, password

user = "user"
password = "password"

Set o = Sys.OleObject("MSXML2.XMLHTTP")
o.open "GET","https://site.testrail.net/index.php?/api/v2/get_case/1", False
o.setRequestHeader "Content-Type", "application/json" 
o.setRequestHeader "Authorization", "Basic " & Base64Encode(user & ":" & password)
o.send
Log.Message(o.status)

The code of the Base64Encode function is in this post on Stack Overflow.

UPD: fixed typos in the example

Sundaytwins

Occasional Contributor

7 years ago

Hi,

I created a framework in Testcomplete that will read the tests inside a test run with a given test run-id.

Then, it would execute the corresponding test cases as read from the test run.

At the end of each test case execution, the result of the test was returned via the API into TestRail.

As far as i know, there is no possibility to 'start' a test run or test case execution from within TestRail towards a (connected) Testtool.

Hope this helps.

I'm gladly willing to share the framework as it is built in Testcomplete. (12 i believe, it has been a while... )

Good luck!

AlexKaras
Champion Level 3
7 years ago
Sundaytwins:

Hi,

> I'm gladly willing to share the framework as it is built in Testcomplete.

While SmartBear has not provided yet an area for solutions sharing (though they are considering this), you may contact tristaanogre and talk to Robert to include your solution into the set of TestComplete-related goodies (https://bitbucket.org/account/user/privateteamogre/projects/CSE).
ArtyrMartyr
New Contributor
7 years ago
Sundaytwins, Thank you.
I will try to configure the launch of tests from TestRail. If I can write here :)
aaron1
New Contributor
7 years ago
Dear SundayTwins,

Just wondering if you have published your framework anywhere yet ?
If your framework based on TestComplete's script extension ?

Thanks
aaron
aaron1
New Contributor
7 years ago
"At the end of each test case execution, the result of the test was returned via the API into TestRail."

I would be interested to know how you can determine the pass/fail status of a test at the end of its execution.
Because the test log is not generated(e.g., RootLogData.dat) until after all test items have been executed.

Someone suggested ErrCount object but unfortunately this property is not tied to a specific test items but it's accumulative.
- Eduardo
  New Contributor
  6 years ago
  I know it is tooo late for answering but I hope someone will find this information useful.
  
  I was setting the integration between TC and TestRail and solved problem of saving results of each test this way:
  
  I added 2 global variables to project:
  
  Project.Variables.currentTestName = {testName}; // for example 1788
  Project.Variables.currentTestStatus = 0;
  
  And include them into each test. Each test has at the start
  
  Project.Variables.currentTestName = {testName}; // for example 1788
  Project.Variables.currentTestStatus = 0
  
  and at the end
  
  Project.Variables.currentTestStatus = 1
  
  If test failes, status remaines 0.
  
  To use these variables I created OnStopTest event - it works either test passes or failes.
  
  Code in the event looks like this:
  
  let caseId = Project.Variables.currentTestName;
  let caseStatus = Project.Variables.currentTestStatus;
  let testRailClient = new TestRailClient.TestRailClientClass();
  testRailClient.sendResult(caseId, caseStatus);
  
  Hope someone will find this useful.
  - PBylenga
    Regular Visitor
    6 years ago
    Thank you Eduardo !
    
    Is there any way you can also share the class you are using here:
    let testRailClient = new TestRailClient.TestRailClientClass();