Forum Discussion

Liberty_Informa's avatar
Liberty_Informa
Regular Contributor
12 years ago

Nightly Tests failing

Hi

Many times we find we see our nightly tests do not complete successfully. There are around 1000 of tests. They fail abruptly due to many reasons sometimes due to socket time-out, sometimes due to locked soapUI-settings file however we are removing dependency on settings file as suggested by you by keeping minimal global properties and using external xml files instead to read large data.

My question is is there any recommendations regarding preparatory activities in terms of memory management that we should carry out before we start nightly tests? Is there anything specific in soapUI that I can carry out as a prerequisite step?

Thanks.

5 Replies

  • SmartBear_Suppo's avatar
    SmartBear_Suppo
    Icon for Alumni rankAlumni
    12 years ago
    Hi,

    What to do in preparation depends on what kind of failures you're experiencing. Removing shared dependencies and working with temporary files instead is a good step forward. If you're ever experiencing hangings or other potentially memory-related issues, check out http://www.soapui.org/Working-with-soap ... usage.html . It contains some useful tips on how to improve memory usage in SoapUI.

    Regards,
    Arian
    SmartBear Sweden
  • Liberty_Informa's avatar
    Liberty_Informa
    Regular Contributor
    12 years ago
    Removing shared dependencies and working with temporary files instead is a good step forward.

    Can you explain it more?
  • SmartBear_Suppo's avatar
    SmartBear_Suppo
    Icon for Alumni rankAlumni
    12 years ago
    I was referring to what you said about moving away from using the settings file Sorry for the confusion.

    Regards,
    Arian
  • Liberty_Informa's avatar
    Liberty_Informa
    Regular Contributor
    12 years ago
    Even though many recommendations are in place we still getting socket timeout - garbage collected type error responses

    The recommendation that are in place:

    1. Discard OK results
    2. socket time-out set to 90000
    3. close HTTP connection after each request
    4. Not to use global properties to store heavy objects and I/O type operations in soapui-settings file
    5. Adjusted java memory size.

    What I am thinking Invocation style of testsuits and testcases is parallel. Should we convert them to sequential? Will that improve anything? Time is not a constraint for us.

    RAM is also not an issue on the slice where we run tests. They run at midnight so no other use is executing them at that time.

    Thanks.
  • SmartBear_Suppo's avatar
    SmartBear_Suppo
    Icon for Alumni rankAlumni
    12 years ago
    How are you invoking these nightly tests; through testrunner or SoapUI Pro GUI?

    I would recommend the sequential run of the functional tests as that would require less memory on SoapUI Pro side and will not stress your API as much resolving in quicker response times on application API side.

    Michael Giller
    SmartBear Software