Apache JMeter Review

JMeter supports HTTP/HTTPS, DBs, FTP, and other system protocols and easy to crate basic scripts but has limitations on the reports


What is most valuable?

  • Recording/Playback
  • Templates for test plans (NEW)
  • Integrate with Java and many other scripting languages
  • Integrating with external plug-ins

How has it helped my organization?

  • The recording feature makes it easy to create test plans
  • They have templates that make starting very easy (this feature is added recently)
  • Supports a lot of protocols (HTTP, HTTPS, FTP , SMTP etc)
  • Simplicity of use
  • As compared to commercial tools, it provides better reporting features through third-party plug-ins
  • There's also a huge community around tool, and because of that when there's an issue, you can get solutions easily, and without cost For example, we dis a very complex testing of HL7 protocols, which JMeter doesn't support directly, but it's extendable to support the protocols
  • Supports Java and other scripting languages and can extend capabilities.

What needs improvement?

Reporting could be better if it could be like commercial tools. For example, a nice chart and visualizations. You can’t rely on the first 100 test results because the ramp-up and ramp-down time gives false results with outliers. It would be great if an option to ignore first 100 and last 100 records from results and then generate reports, should be great. Needs to support more concurrent users by single JMeter instance (agent/slave)

For how long have I used the solution?

I've been using it for over last five years, and it is a major, active open source tool.

What was my experience with deployment of the solution?

No issues with recent releases

What do I think about the stability of the solution?

There are issues when tests are stopped with large number of concurrent users. Test is not stopped as expected.

How are customer service and technical support?

Customer Service:

There is a huge community around JMeter. Hence free support is available to the users.

Technical Support:

Excellent (from the community)

Which solution did I use previously and why did I switch?

Grinder. Grinder was not user friendly and had to do lot of coding and low level configurations. It was lighter than JMeter.

How was the initial setup?

Initial setup is straight forward. You need to have have JDK or JRE for running JMeter.

What about the implementation team?

We have a team of testers capable of managing the JMeter perfromance testing project effectively.

What other advice do I have?

It's easy to use and free, a huge community, and it offers a risk free to start, so use it for application performance testing. It supports connectivies with databases, FTP, and other system protocols.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
4 visitors found this review helpful
1 Comment
author avatarpmouawad
Vendor

Hello Janesh,
Thanks for this nice review.
Just one note, since JMeter 3.0 and even more in 3.1, JMeter has now :

- a new Web Reporting feature, see http://jmeter.apache.org/usermanual/generating-dashboard.html

- Scalable Real-time Graphs in NON GUI mode thanks to 3rd party open sources like Graphite or InfluxDB, see http://jmeter.apache.org/usermanual/realtime-results.html

Regards
Philippe M. from Apache JMeter Team

Guest