What is most valuable?
How has it helped my organization?
First and foremost, it took out the painful resource hours out that went in to manually correlate each and every action of the script while using LoadRunner. NeoLoad does not require much of scripting efforts, and correlation and parameterization are fairly easy.
What needs improvement?
We would like the product to be able to handle large project suits with large number of test scripts. Currently, we are not able to upload/publish huge projects back and forth from the team server to the NeoLoad controller. There is no support for VT3270 terminal emulation to support mainframe-hosted applications. There is no summary graph that shows the distribution of all of the response times on a single graph. We currently export the data as a coma separated variable (CSV) file and import into Excel to generate this summary graph.
For how long have I used the solution?
What do I think about the stability of the solution?
A small number of times, when load testing huge projects with huge number (~10,000) of vUsers, we have seen that it completely froze. We had to recover from the previously saved version of the project.
How are customer service and technical support?
Very good, the vendor has been very accommodating with the ebb and flow of our business needs. Neotys is a partner. Technical Support
Good. (They decommissioned the support for 4.2 though)
Which solution did I use previously and why did I switch?
LoadRunner. Cost effective and with almost same features that are required for our project.
How was the initial setup?
Straightforward and the technical support folks will be available to help.
What about the implementation team?
We utilized a vendor team. They were fairly knowledgeable and knew how to quickly troubleshoot the issues or contact Neotys.
What was our ROI?
A great deal of improvement in application performance happened because we could pin point the bottlenecks. The real time performance monitoring allowed to find out the troublesome queries and tune them. Increased resource efficiency.
What's my experience with pricing, setup cost, and licensing?
Low in cost when compared to tools like HP LoadRunner. Talking about licensing, they offer a cool feature that enables us to split the Vuser bundle across multiple machines. In other words, we can have multiple controllers running multiple load tests at the same time.
Which other solutions did I evaluate?
JMeter. Figured that it would not be suitable tool for our project and requirements.
What other advice do I have?
NeoLoad is the performance testing solution for Web and Mobile applications that can also be used to run the tests from cloud by having load generator’s from various locations. If there is a strong performance team that can analyze and correlate the test results with the raw data, then NeoLoad would be the right solution.