cancel
Showing results for 
Search instead for 
Did you mean: 

Can soap ui or ready api test persistance layer what are the options available ?

SOLVED
Highlighted
Contributor

Can soap ui or ready api test persistance layer what are the options available ?

We have a requirement to test persistence layer, can soap ui or ready api test it ?

1 ACCEPTED SOLUTION

Accepted Solutions
Highlighted
Community Hero

Re: Can soap ui or ready api test persistance layer what are the options available ?

Hey @ameesh1984,

Ok so you have what you term green screen back end (what is that...some sort of mainframe/mini computer?), some asynchronous messaging in which messages are published to a Kafka topic (the messages are transformed via an adaptor component in your Kafka I.S.) and these transformed messages are then posted to cosmosDB's listening REST API to persist the message in the DB.

Is that right....do i understand correctly?

That sounds analagous to a number of the projects ive worked on in the past (albeit different technologies, so ive never used Kafka before but ive used TIBCO, Weblogic, WSO2, Mulesoft).

If i understand correctly then id say its perfectly possible (it sounds like a lot of my previous projects)

So what have you gotta verify...the whole thing? So in this instance, the 4 points for possible consideration are:

1=ETL process to generate message from greenscreen mainframe
2= transformation,
3=schema valid messages consumption by rest api,
4=db write of schema valid messages.

1. ETL process (daily batch job?) executes extracting data from its on premise database into some sort of flat file (.csv? .xml? Tab separated? Fixed width?) and

2. Flat file messages published to the topic are transformed correctly (due to defined transformation rules which youd verify) and

3. the transformed messages are then posted via the cosmos db .wsdl/.wadl (.xsd/.json schemas so messages need to be schema valid) endpoint, which youd verify and

4. Webservice consumed messages written to the db correctly (transaction type works correctly, so create/update/delete of data records work correctly) and message content needs to be written to db table(s) correctly, so message attributes' values are written to correct table attribute, no invalid data is attempted to be written (no text attempting to write to numeric fields, any blank attributes in message correspond to null allowed table attributes, field atteibutes are correct length so no values are truncated).

Sorry. I know i go on a bit. Im just a bit too literal sometimes so i have to explain my understanding to ensure i understand what youre talking about before i can try and help.

I know @nmrao has more experience of using the JMS components of soapui than me (i'm thinking about the Kafka topics at this point. Does Kafka use JMS?). Ive always avoided using the JMS/Hermes functionality in soapui in my projects that use asynch queues/topics cos theres no response to assert against so the way ive always done it is for dev to code a stub that hooks into the api on the queue/topic (to enable me to verify the adaptor transforms the messages correctly), so you dont have to use the JMS functionality....the additional stub approach is more work for dev however, but less work for me.

Anyway. Thats all i got for now. I hope some of that essay helps!

Rich
if this helped answer the post, could you please mark it as 'solved'? Also if you consider whether the title of your post is relevant? Perhaps if the post is solved, it might make sense to update the Subject header field of the post to something more descriptive? This will help people when searching for problems. Ta

View solution in original post

4 REPLIES 4
Highlighted
Community Hero

Re: Can soap ui or ready api test persistance layer what are the options available ?

Would you add specific details on what you need to test, such as database etc?


Regards,
Rao.
Highlighted
Community Hero

Re: Can soap ui or ready api test persistance layer what are the options available ?

Hey @ameesh1984,

Is this related to your previous post for cosmosDB?

When you ask can soapui/readyapi! test the db layer, can you clarify what are the requirements for the testing....what would you be trying to verify?
Last year i had to verify a new Reference Data System (via an API gateway) which would be used for multiple different systems. The requirements included data quality and certain data attributes which required a little more planning and forethought (and a lot of groovy - all courtesy of Rao by the way.....i never could of done it without Rao's help in fact), but it was achievable.

So to summarise. Can you clarify what you actually want to verify via your DB testing and then people will be able to provide more concise answers.

Ta

Rich
if this helped answer the post, could you please mark it as 'solved'? Also if you consider whether the title of your post is relevant? Perhaps if the post is solved, it might make sense to update the Subject header field of the post to something more descriptive? This will help people when searching for problems. Ta
Highlighted
Contributor

Re: Can soap ui or ready api test persistance layer what are the options available ?

The persistent layer for us is a data transformation layer converting data from a green screen backend via Kafka topics into azure cosmos DB
Highlighted
Community Hero

Re: Can soap ui or ready api test persistance layer what are the options available ?

Hey @ameesh1984,

Ok so you have what you term green screen back end (what is that...some sort of mainframe/mini computer?), some asynchronous messaging in which messages are published to a Kafka topic (the messages are transformed via an adaptor component in your Kafka I.S.) and these transformed messages are then posted to cosmosDB's listening REST API to persist the message in the DB.

Is that right....do i understand correctly?

That sounds analagous to a number of the projects ive worked on in the past (albeit different technologies, so ive never used Kafka before but ive used TIBCO, Weblogic, WSO2, Mulesoft).

If i understand correctly then id say its perfectly possible (it sounds like a lot of my previous projects)

So what have you gotta verify...the whole thing? So in this instance, the 4 points for possible consideration are:

1=ETL process to generate message from greenscreen mainframe
2= transformation,
3=schema valid messages consumption by rest api,
4=db write of schema valid messages.

1. ETL process (daily batch job?) executes extracting data from its on premise database into some sort of flat file (.csv? .xml? Tab separated? Fixed width?) and

2. Flat file messages published to the topic are transformed correctly (due to defined transformation rules which youd verify) and

3. the transformed messages are then posted via the cosmos db .wsdl/.wadl (.xsd/.json schemas so messages need to be schema valid) endpoint, which youd verify and

4. Webservice consumed messages written to the db correctly (transaction type works correctly, so create/update/delete of data records work correctly) and message content needs to be written to db table(s) correctly, so message attributes' values are written to correct table attribute, no invalid data is attempted to be written (no text attempting to write to numeric fields, any blank attributes in message correspond to null allowed table attributes, field atteibutes are correct length so no values are truncated).

Sorry. I know i go on a bit. Im just a bit too literal sometimes so i have to explain my understanding to ensure i understand what youre talking about before i can try and help.

I know @nmrao has more experience of using the JMS components of soapui than me (i'm thinking about the Kafka topics at this point. Does Kafka use JMS?). Ive always avoided using the JMS/Hermes functionality in soapui in my projects that use asynch queues/topics cos theres no response to assert against so the way ive always done it is for dev to code a stub that hooks into the api on the queue/topic (to enable me to verify the adaptor transforms the messages correctly), so you dont have to use the JMS functionality....the additional stub approach is more work for dev however, but less work for me.

Anyway. Thats all i got for now. I hope some of that essay helps!

Rich
if this helped answer the post, could you please mark it as 'solved'? Also if you consider whether the title of your post is relevant? Perhaps if the post is solved, it might make sense to update the Subject header field of the post to something more descriptive? This will help people when searching for problems. Ta

View solution in original post

New Here?
Join us and watch the welcome video:
Announcements
Top Kudoed Authors