Parasoft SOAtest Review

Offers the possibility for continuous testing using the server-side (nightly) batch runs.


What is our primary use case?

Repeatable automated regression tests in a SOA architecture IT landscape, for several SOAP/REST webservices including Web Gui end-to-end testing, all scenario-based for 10+ applications. Also, scheduled for test runs at night, using Jenkins.

How has it helped my organization?

It provides us with fast(er) test results, more predictable results and automatic (regression) test runs outside the employee workstations. This tooling made us more agile and more ready for continuous integration. We use the night hours to run different regression tests over systems, for which we only need to check the results in the morning.

What is most valuable?

  • Fast and easy automated tests for UI
  • Interfaces (SOAP, REST)
  • Additional database queries
  • Easy validations on responses (soap, rest, json, sql, Gui)

Most valuable for us is the combination of all these items in one solution for us. Broad user story scenario's from A to Z, though a chain of systems, including test data prerequisites.
The next most valuable benefit over the past year is the possibility to use the tooling for continuous testing purposes, using the server-side run option 'as a web service' for (nightly) batch runs.

What needs improvement?

In general, its user-friendliness needs a little improvement since there are a few bugs that still remain. It needs to be (possibly) more lightweight and have more validation options. The bulk changes in the test cases are not always easy. But all in all, these are minor details compared to the benefits that we have.

For how long have I used the solution?

More than five years.

What do I think about the stability of the solution?

Very seldom, there were some stability issues but they do appear only from time to time. Since the 9.10 release we haven't seen this any more. Stable!

What do I think about the scalability of the solution?

We only encountered scalability issues with large test scenarios, combining interfaces with a lot of browser GUI tests. Work-around is cutting up the test cases into smaller scenarios.

How is customer service and technical support?

The technical support is fairly okay. Technical tool-wise they help a lot if needed, but when it comes to complex test scenarios or weird issues, they do not always have a solution.

An exchange of examples is difficult, since we use tooling for internal applications. So, it is not accessible from the outside world, which makes combined debugging impossible.

Which solutions did we use previously?

Initially, we were using some lightweight open-source (free) tools, but none met with our requirements fully; so we switched solutions.

How was the initial setup?

The setup was fairly easy. They provide good instructions. The workstation install is a piece of cake and some additional (simple) config is needed, for Git/SVN etc. The license server install can be tricky, but it turned out to be fairly easy compared to the earlier versions.

What about the implementation team?

We did it our self, with a little help from the seller.

What's my experience with pricing, setup cost, and licensing?

Use floating licenses, so it’s not attached to one workstation. Furthermore, the pricing is something for the staff to handle, not for us. ;)

Which other solutions did I evaluate?

We mainly looked into the SoapUI solution, along with some Selenium software and besides that, other stand-alone database tooling options. We also evaluated manual testing.

What other advice do I have?

Start off simple. Build your test setup from there. Do think about setting up some specific test cases as building blocks (reference material) for other test scenarios to use, so that the maintenance in the future is more easily done.

Also be sure to read the Help function, might help you on your way when you're facing some difficulties.

Disclosure: IT Central Station contacted the reviewer to collect the review and to validate authenticity. The reviewer was referred by the vendor, but the review is not subject to editing or approval by the vendor.
1 visitor found this review helpful
Read White Paper

Download The White Paper to Learn More

Add a Comment
Guest
Sign Up with Email