Apache JMeter Review

Reporting feature can be improved but allows us to simulate a load of concurrent users on our application


What is most valuable?

Almost all features provided by JMeter are helpful.

How has it helped my organization?

We have a solution called Service Quality Manager portal and is a web based solution to do service management. We do performance testing of this solution using JMeter. It allows us to simulate a load of concurrent users on our application and find out performance bottlenecks in the application.

What needs improvement?

Reporting feature can be improved to provide better test results.

For how long have I used the solution?

We have been using JMeter for 5 years.

What was my experience with deployment of the solution?

I did not encounter any issue while deploying JMeter.

What do I think about the stability of the solution?

I did not encounter any issue with stability.

What do I think about the scalability of the solution?

Yes, While running with a large number of simulated users, sometimes we got thread exceptions and we restarted our testing simulation.

How are customer service and technical support?

As such there is no customer service provided by Apache for JMeter. This software is free to use under Apache licensing system.

Which solution did I use previously and why did I switch?

We tried BadBoy but it lacked features.

How was the initial setup?

Initial setup of JMeter is simple. A user can go ahead and start using it just by following it's documentation.

What about the implementation team?

We implemented JMeter using our own in-house team.

What was our ROI?

I am not sure yet.

What's my experience with pricing, setup cost, and licensing?

As it is java based software an can run on any platform supporting JVM.

What other advice do I have?

I would suggest to verify one's own business need and evaluate certain parameters first like Feasibility and Reliability of Automation, Ease in maintenance of automated test cases, Time saving in Manual or Automated Testing.


Disclosure: I am a real user, and this review is based on my own experience and opinions.

Add a Comment
Guest
2 Comments

author avatar
Real User

Thanks for sharing your experience. I agree that vanilla JMeter reports are hard to read/understand but JMeter is module architecture and any test element is basically a plugin. For the moment there is a number of http://jmeter-plugins.org/">JMeter Plugins which provide extended results analysis functionality.

A couple of JMeter Plugins can upload results to Cloud services providing powerful analysis and metrics, to wit:

http://jmeter-plugins.org/wiki/LoadosophiaUploader/">Loadosophia.org Uploader

http://community.blazemeter.com/knowledgebase/articles/83191-blazemeter-plugin-to-jmeter">BlazeMeter Plugin to JMeter

The last one provides useful bi-dimensional graphs and has unique feature of different test run results comparison.

author avatar
Consultant

How would you suggest improving the reporting features?