- Load generator setup is not required so we can be running high concurrency tests in few minutes.
- Scenario setup for running tests was very easy.
- Distribution of the load from different locations was very easy.
- SiteScope and New Relic monitoring tools can be easily integrated with StormRunner Load.
- SLA configuration was available to monitor response times.
- Navigation breakdown report - to create a client navigation breakdown report.
- Real time graphs for monitoring results.
- Email reports.
- Benchmark- comparing previous test results with current tests.
- Anomalies detection.
Improvements to My Organization
Being able to setup and run 300,000 load tests using LoadRunner Performance Center takes around 1 to 2 hours when creating four scenarios of 75,000 each, including allocating/blocking load generators required for testing, initializing the fusers and running the test.
Running a 300,000 test was very easy using StormRunner. We just had to upload the script and create scenarios for 300,000 and run the test in 20 minutes.
Running back to back high concurrency test was very easy using StormRunner.
Room for Improvement
- Improved PDF reports and creating custom reports
- Real world- custom scenario setup
- Update existing scripts online without uploading them again
- Run time settings update in scenario
Use of Solution
I've used it for five months.
None - there's no deployment required for running a load test.
During the initial days of high concurrency testing (300,000 and 600,000) we had issues with the StormRunner infrastructure e.g. graphs “disappeared” in the middle of a test, and HP had to give an online fix. Also, there were cases where tests appeared as “initializing” even though it actually started and HP again had to give an online fix. The StormRunner R&D team was very proactive in fixing the issues in very small turnaround time and supporting us running the high concurrency tests.
Scalability issues were seen during initial days of testing but it was resolved by StormRunner R&D team.
Customer Service and Technical Support
8/10. Technical Support
8/10 - their team was very proactive in resolving the issues and provided hotfixes to support us running performance tests whenever required.
We were using Performance Center to run performance tests, so we had to switch to StormRunner to run high concurrency tests.
As StormRunner Load is a web-based application, it's simple setup, just registering users through an HP site.
In-house implementation and evaluation.
Other Solutions Considered
There were no other solutions evaluated.
StormRunner is one of the fastest-growing cloud based performance testing tools for running high concurrency tests very quickly.
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Jun 10 2015