Forum Discussion

lrjanzen's avatar
13 years ago

TestRunner Issue

I am having trouble getting test runner to not fail all the tests. Here is the situation. I hae a project that has several test suites in it. THis is a general smoke test for a group of web services. Each test is very basic. Just a not soap failure and an xpath check of a single value. Since this smoke test needs to be able to point to differant environments I added a project level custom property to set the environment (example qa or dev or production). I then set each suite to have the vlaue get added to the endpoint vlaue for each test (http://${#Project#EndPointEnvironment}/BusinessWS_1_0/Office.svc.) . here is where the problem comes in. if I run the test suites individually through the test suite UI, the token resolves fine and the test run without issue. If I run all the suites from the project level (right click Load TestRunner). I get errors. See below. Ami missing some setting on the launch page?

Thanks Lonnie

Running soapUI TestRunner for [CDS Smoke Tests-BE]
directory: C:\Program Files\eviware\soapUI-3.6.1\bin\.
command: cmd.exe /C testrunner.bat -s"Copy of HostOfficeService TestSuite" -I "C:\JOHNTFSP01\CSS.BusinessInterests\Utils\BIM Web Service Smoke Tests\CDS-Smoke-Tests-BE-soapui-project.xml"
soapUI 3.6.1 TestCase Runner
Configuring log4j from [C:\Program Files\eviware\soapUI-3.6.1\bin\soapui-log4j.xml]
13:49:12,226 INFO [DefaultSoapUICore] initialized soapui-settings from [C:\Users\janzenl.CORP\soapui-settings.xml]
13:49:13,030 INFO [WsdlProject] Loaded project from [file:C:/JOHNTFSP01/CSS.BusinessInterests/Utils/BIM Web Service Smoke Tests/CDS-Smoke-Tests-BE-soapui-project.xml]
Configuring log4j from [C:\Program Files\eviware\soapUI-3.6.1\bin\soapui-log4j.xml]
13:49:13,333 INFO [DefaultSoapUICore] initialized soapui-settings from [C:\Users\janzenl.CORP\soapui-settings.xml]
13:49:13,339 INFO [WsdlProject] Loaded project from [file:C:/JOHNTFSP01/CSS.BusinessInterests/Utils/BIM Web Service Smoke Tests/CDS-Smoke-Tests-BE-soapui-project.xml]
13:49:13,345 INFO [SoapUITestCaseRunner] Running soapUI tests in project [CDS Smoke Tests-BE]
13:49:13,355 INFO [SoapUITestCaseRunner] Running TestSuite [Copy of HostOfficeService TestSuite], runType = SEQUENTIAL
13:49:13,410 INFO [SoapUITestCaseRunner] Running soapUI testcase [RetrieveAllHostOffices TestCase]
13:49:13,417 INFO [SoapUITestCaseRunner] running step [RetrieveAllHostOffices]
13:49:13,659 INFO [SoapUITestCaseRunner] Assertion [Not SOAP Fault] has status VALID
13:49:13,659 INFO [SoapUITestCaseRunner] Assertion [XPath Match] has status FAILED
13:49:13,659 ERROR [SoapUITestCaseRunner] ASSERTION FAILED -> XPathContains assertion failed for path [declare namespace b='http://schemas.fmglobal.com/BusinessEntities/2009/01/26/OrganizationAddressDataContract';
declare namespace a='http://schemas.fmglobal.com/BusinessEntities/2009/01/26/HostOfficeDataContract';
declare namespace c='http://schemas.fmglobal.com/BusinessEntities/2009/02/23/ValidPlaceResultDataContract';
declare namespace b1='http://schemas.fmglobal.com/BusinessEntities/2009/01/23/OrganizationNameDataContract';
declare namespace i='http://www.w3.org/2001/XMLSchema-instance';
declare namespace ns1='http://schemas.fmglobal.com/BusinessEntities/2009/01/26/IHostOfficeServiceContract';
declare namespace s='http://schemas.xmlsoap.org/soap/envelope/';
//ns1:RetrieveAllHostOfficesResult[1]/a:HostOfficeDataContract[1]/a:OrgId[1]>1] : NullPointerException:null
13:49:13,677 ERROR [SoapUITestCaseRunner] RetrieveAllHostOffices failed, exporting to [C:\Program Files\eviware\soapUI-3.6.1\bin\Copy_of_HostOfficeService_TestSuite-RetrieveAllHostOffices_TestCase-RetrieveAllHostOffices-0-FAILED.txt]
13:49:13,706 INFO [SoapUITestCaseRunner] Finished running soapUI testcase [RetrieveAllHostOffices TestCase], time taken: 231ms, status: FAILED
13:49:13,706 INFO [SoapUITestCaseRunner] Running soapUI testcase [RetrieveAllHostOfficesForProspectClientId TestCase]
13:49:13,706 INFO [SoapUITestCaseRunner] running step [RetrieveAllHostOfficesForProspectClientId]
13:49:13,710 INFO [SoapUITestCaseRunner] Assertion [Not SOAP Fault] has status VALID
13:49:13,710 INFO [SoapUITestCaseRunner] Assertion [XPath Match] has status FAILED
13:49:13,727 ERROR [SoapUITestCaseRunner] ASSERTION FAILED -> XPathContains assertion failed for path [declare namespace b='http://schemas.fmglobal.com/BusinessEntities/2009/01/26/OrganizationAddressDataContract';
declare namespace a='http://schemas.fmglobal.com/BusinessEntities/2009/01/26/HostOfficeDataContract';
declare namespace c='http://schemas.fmglobal.com/BusinessEntities/2009/02/23/ValidPlaceResultDataContract';
declare namespace b1='http://schemas.fmglobal.com/BusinessEntities/2009/01/23/OrganizationNameDataContract';
declare namespace i='http://www.w3.org/2001/XMLSchema-instance';
declare namespace ns1='http://schemas.fmglobal.com/BusinessEntities/2009/01/26/IHostOfficeServiceContract';
declare namespace s='http://schemas.xmlsoap.org/soap/envelope/';
//ns1:RetrieveAllHostOfficesForProspectClientIdResult[1]/a:HostOfficeDataContract[1]/a:OrgId[1]>1] : NullPointerException:null
13:49:13,727 ERROR [SoapUITestCaseRunner] RetrieveAllHostOfficesForProspectClientId failed, exporting to [C:\Program Files\eviware\soapUI-3.6.1\bin\Copy_of_HostOfficeService_TestSuite-RetrieveAllHostOfficesForProspectClientId_TestCase-RetrieveAllHostOfficesForProspectClientId-0-FAILED.txt]
13:49:13,730 INFO [SoapUITestCaseRunner] Finished running soapUI testcase [RetrieveAllHostOfficesForProspectClientId TestCase], time taken: 3ms, status: FAILED
13:49:13,730 INFO [SoapUITestCaseRunner] TestSuite [Copy of HostOfficeService TestSuite] finished with status [FAILED] in 335ms

1 Reply

  • EdwardP3's avatar
    EdwardP3
    New Contributor

    I am having the same issue.  I'm evaluating SoapUI 5.2.0 (open source). TestRunner works fine when launched from within SoapUI, but fails every test when run from a JUnit test using SoapUITestCaseRunner.  Below are 2 types of errors that I'm seeing over and over (XML elements have been changed to protect the innocent): 

     

    XPathContains assertion:

    [VerifyStatusCode] XPathContains assertion failed for path [//getThisInfo/statusCode] : RuntimeException: Trying XBeans path engine... Trying XQRL... Trying delegated path engine... FAILED on //getThisInfo/statusCode

     

    Script Assertion:

    [AssertThisInRequest]  Trying XBeans path engine... Trying XQRL... Trying delegated path engine... FAILED on //thisData/thisDto/thatId

     

    The code I'm using is identical to that found on SoapUI Test Automation. Any help is appreciated. I wouldn't be opposed to asking my company to purchase a Pro license if it would fix TestRunner issues in JUnit and/or Maven tests. By the way, I can run TestRunner in a bat file and it works as it would if launched within SoapUI. Hope this helps.  

     

    Thanks.