>>(so you want to know how to define the criteria in the tests and how to tell soapui to use these criteria)
To define the criteria, I was relying on tagging(groups) concept in testng.
I should be able to clarify each testcase in all the testsuites and in all the projects with some standard notation. For example, let's say we have two projects ProjectA, ProjectB.
ProjectA has Testsuites TS1 and TS2 and testcases in TS1 are TC1, TC11 and testcases in TS2 are TC2, TC21.
ProjectB has Testsuites TS3 and TS4 and testcases in TS3 are TC3, TC31 and testcases in TS4 are TC4, TC41.
Now I will define a criteria or groups
DOMAIN={SELLING,BUYING}, PRIORITY={P1,P2}, SERVICE={BUYINGSERVICE,TRADINGSERVICE}
I should can tag each test case with one or more of these groups.
Let's say,
TC1 is tagged as DOMAIN={BUYING}, PRIORITY={P1}
TC11 is tagged as DOMAIN={SELLING}, PRIORITY={P1}, SERVICE={BUYINGSERVICE}
TC2 is tagged as DOMAIN={SELLING}, PRIORITY={P1},SERVICE={BUYINGSERVICE}
TC21 is tagged as DOMAIN={BUYING}, PRIORITY={P2}
TC3 is tagged as DOMAIN={SELLING}, PRIORITY={P1}, SERVICE={BUYINGSERVICE}
TC31 is tagged as SERVICE= {TRADINGSERVICE}
TC4 is tagged as DOMAIN={BUYING}, PRIORITY={P2}
TC41 is tagged as DOMAIN = {SELLING}, PRIORITY={P2}, SERVICE={TRADINGSERVICE}
Now when I want to execute tests via maven plugin or TestNg route, I should be able to say
Run all the tests in PROJECTA, PROJECTB that are tagged as DOMAIN={SELLING} and SERVICE={BUYINGSERVICE} - This should run TC11, TC2, TC3
Run all the tests in PROJECTA, PROJECTB that are tagged as SERVICE={TRADINGSERVICE} - This should run TC31 and TC41
Run all the tests in PROJECTA, PROJECTB that are tagged as PRIORITY={P2} - This should run TC4, TC41, TC21
We are not confined to one Project, we should be able to run tests that are in different projects. The test cases in those projects are picked based on the tags we opted.
We can have this as plugin extension or want to see if we can achieve this via testng.
This is very important for us. Please let me know if we can achieve this..