Ask a Question

Assert incoming csv file against outcoming multiple jsons

agroenen
Occasional Contributor

Assert incoming csv file against outcoming multiple jsons

Situation:

Customer uploads a csv file with multiple rows (REST API).

Rows are imported into a database, and converted to multiple json messages, which are send to an event grid (that has to be a mock service for now).

I can't think of a way how to create tests for this. How to check f.e. that there are as many json messages arrived in the message broker as there were rows in the csv-file/database? And how to check if the content of the json messages matches with content of the ccs file/database?

Any help appreciated, I'm not an experienced user.

2 REPLIES 2
richie
Community Hero

Re: Assert incoming csv file against outcoming multiple jsons

Hey @agroenen,

People can probably make suggestions bit youre gonna need to provide a lot more concise detail thatll need clarifying. We'd need to understand the overall solution basics and the basic requirements of your system under test before anyone would be able to give you an approach for your testing, and even then the forum members wont be privy to some of the info that would steer an approach, but based on the detail you provide theres some questions below that anyone would need to answer.

Q1. Is the whole end to end solution you describe new or existing?
Q2. Customer uploads csv....does this mean you have no control over the format of the csv?
Q3. The csv records are loaded into a db and converted to json....can you confirm? It would be less efficient to persist the records as json rather than referential records in the db....i wouldnt expect you to store as json. Or do you mean that once they are extracted from the database, the db records are extracted into .json format which undergo some subsequent processing?
Q4. When you say the json messages are sent to an "event grid (that has to be a mock service for now)". Can you please expand what you mean by this please? What do you mean by even grid...are you talking about a data grid (datasource test step)? Or something else
Q5. What do you mean by 'f.e.' where you state ". How to check f.e."??
Q6. You mention message broker. Are you publishing to Message Queues/Topics?
Q7. If youre publishing to Message Queues/Topics, depending on the solution MQs have an associated table to support transactionality/idempotence. Are you able to query this via SQL?
Q8. Is this asynchronous or synchronous message exchange?

Once youve clarified the above, id start thinking about splitting the end to end messaging into testable pieces. I tend to test each point in a message journey where a message is either created, validated or transformed/translated as these points in the journey have verifiable output (to assert against).

Cheers

Rich
if this helped answer the post, could you please mark it as 'solved'? Also if you consider whether the title of your post is relevant? Perhaps if the post is solved, it might make sense to update the Subject header field of the post to something more descriptive? This will help people when searching for problems. Ta
sonya_m
Community Manager

Re: Assert incoming csv file against outcoming multiple jsons

richie, thank you for your willingness to help, as alwaysSmiley Happy

 

Hi @agroenen, have you come up with an approach? Please share. If you haven't, try making your desription more detailed as richie mentions and the Community might suggest ways to proceed.


Sonya Mihaljova
Community and Education Specialist

Did my reply answer your question? Give Kudos or Accept it as a Solution to help others. ⬇️⬇️⬇️
cancel
Showing results for 
Search instead for 
Did you mean: