What is our primary use case?
We have an insurance application where the tests need to be executed in both a testing and production environment (the difference between the two is the database).
Each of the tests should be developed to address different sets of data (Data Driven Testing). A large volume of data is analyzed by comparing multiple Excel worksheets.
How has it helped my organization?
Zeenyx AscentialTest is well known for data-driven testing with its inbuilt data tables, which help in having a single test run across multiple sets of data. The drag and drop feature to develop tests/plans has helped in executing the test much easier and faster.
The regression suite was built much faster and helped in realizing our ROI within six months.
What is most valuable?
The feature that we find most valuable is the 'Restricted String', used for objects which have a variable number of items. This helps in selecting the input into the data table because it appears as a dropdown box. Another feature is the Plan creation; it is very easy to create and execute an arbitrary number of similar tests that differ only in the data.
What needs improvement?
I would like to see an improvement in the user interface. UI looks to be more trendy and attractive .
I am looking forward to API testing and mobile testing with Snapshot technology allowing drag and drop capabilities that are similar to Windows and the web.
For how long have I used the solution?
What do I think about the stability of the solution?
It is a very stable solution. The test maintenance is low, where one change in objects/steps will cause the change to be made in the entire project automatically.
Tests are solid when working in two different environments, as every step is reusable.
What do I think about the scalability of the solution?
In terms of the scalability, there is a change in the requirements every three months, but the performance is still the same and it works absolutely fine.
How are customer service and technical support?
Excellent always reachable and solutions are immediate almost all time.
Which solution did I use previously and why did I switch?
We have worked with other solutions. We were not satisfied with the data-driven testing support in the PowerBuilder app, which led us to try a POC with AscentialTest. We were really happy with the capability to identify custom objects, as well as support for the huge number of items in the list views.
How was the initial setup?
It was straight forward like any other normal installer
What about the implementation team?
Implemented through an in house team and level of expertise is good in test automationa nd AscentialTest
What was our ROI?
The ROI was quick, and is based on the following:
- Developed fifteen regression tests in less than four months, executing the same tests twice per week.
- Manual testers took three days of effort to perform testing on a huge volume of data in Excel, whereas with automation was achieved in an hour.
- ROI was realized from the sixth month, onwards.
What's my experience with pricing, setup cost, and licensing?
Setup is very easy. It's just like any normal installer.
The pricing is reasonable at first. Once it starts generating ROI, which for us took between three and six months, one will not even think about the investment.
Which other solutions did I evaluate?
We evaluated a few tools but there was a lot of coding required. Since it was an application with limited requirements and budget, our customer preferred AscentialTest. Using it requires minimal coding knowledge, and it is easy to develop tests with very good support for custom and dynamic data from the PowerBuilder app.
What other advice do I have?
If you use the PowerBuilder application, do choose AscentialTest without thinking twice.
It is the best choice, with capabilities to identify custom classes.
Disclosure: My company has a business relationship with this vendor other than being a customer: Matryxsoft is a Zeenyx partner and has been working for 3 years with a number of their clients.