SrinivasPakala - PeerSpot reviewer
Director Consulting Expert at a computer software company with 10,001+ employees
Real User
Top 5
Great features, reliable over the years, with accuracy in overall performance
Pros and Cons
  • "The distributed load testing is very good with Apache JMeter."
  • "The initial setup is complex and needs to be upgraded."

What is most valuable?

The distributed load testing is very good and the ramp-up. When we come out with the right ramp-up plan, it can be converted into Apache JMeter script very well. This accurately simulates how many of our transactions need to be triggered.

What needs improvement?

I would like to see exceptions improved. The initial setup is complex and needs to be upgraded. It would be great to have additional protocols other than HTTP, HTTPS, and APIs.

For how long have I used the solution?

I have been working with Apache JMeter for the past seven years.

What do I think about the stability of the solution?

The stability is good and I am not finding any issues.

Buyer's Guide
Apache JMeter
May 2024
Learn what your peers think about Apache JMeter. Get advice and tips from experienced pros sharing their opinions. Updated: May 2024.
770,924 professionals have used our research since 2012.

What do I think about the scalability of the solution?

We are not having any problems with the scalability of Apache JMeter

How are customer service and support?

Technical support is very good.

How would you rate customer service and support?

Positive

How was the initial setup?

The initial setup is complex.

What's my experience with pricing, setup cost, and licensing?

Apache JMeter is a free tool.

What other advice do I have?

I would rate Apache JMeter a nine out of ten.

Which deployment model are you using for this solution?

Hybrid Cloud

If public cloud, private cloud, or hybrid cloud, which cloud provider do you use?

Other
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Shubhashish Agarwal - PeerSpot reviewer
Systems Engineer at a tech services company with 5,001-10,000 employees
Real User
Top 20
Open-source with easy scripting and a modular design
Pros and Cons
  • "It is easy to set up."
  • "If JMeter could provide a web version of editing, that would be good."

What is our primary use case?

The use cases are mainly for performance testing and for test case management of the different APIs.

How has it helped my organization?

Initially, we didn't have any tool for performance testing, particularly open source. JMeter, since it is open source, we can test our APIs pretty quickly and we can work with different teams to provide performance testing very quickly. It doesn't take up much of our time.

What is most valuable?

The ease of scripting is great. 

The modular design is very useful.

It is easy to set up.

The solution is stable.

It can scale well. 

What needs improvement?

If JMeter could provide a web version of editing, that would be good. 

If JMeter can provide its own cloud version rather than depending on BlazeMeter, the commercial version of JMeter, that would be ideal. If we could have somebody right on the front end of JMeter, using it on any of the clouds, including AWS, GCP, or Azure, that would be very helpful. it would be better than me going for using commercial services.

I would like to have some kind of cloud version that can be implemented. Or we would like a Docker version. A Docker version is something that I would look for.

For how long have I used the solution?

I've been using the solution for four or more years. 

What do I think about the stability of the solution?

It is a stable, reliable product. There are no bugs or glitched. It doesn't crash or freeze.

What do I think about the scalability of the solution?

The solution has been scalable. 

We have almost 100 users on the solution. 

We likely won't increase usage in the future.

How are customer service and support?

I do have some knowledge of technical support. 

This is an open-source tool. If I write any issue in the forums, somebody will answer it pretty quickly. The open source technical support they have on offer is good.

Which solution did I use previously and why did I switch?

We did use a different solution previously. 

Most people know JMeter more than the other tools. It's easy to learn and quick to execute. It's also open source. You can get a lot of solutions across the internet. If you are having some issue or error, somebody or the other may have faced that same issue, and he may have found out the solution. It makes troubleshooting easy, having crowdsourced troubleshooting. That was a factor in our decision-making. 

How was the initial setup?

The initial setup is not straightforward. It's simple and not complex at all. 

We only need two people to maintain the product. It doesn't take a lot of staff. 

What about the implementation team?

We have our own in-house team that can handle the setup. 

What was our ROI?

We've definitely seen an ROI. 

What's my experience with pricing, setup cost, and licensing?

We use an open-source version of the product. However, there are cloud services that we use. I'm not sure of the cost of the cloud services.

Which other solutions did I evaluate?

We looked into Micro Focus and Cavisson NetStorm. However, they were licensed tools, and we decided against them. 

What other advice do I have?

We are using the latest version of the solution. 

We are using a cloud version of JMeter that is called BlazeMeter.

If you are a company that is evaluating other licensed tools, just go for JMeter. It's open source, easy to use, and the most widely used across platforms. It would be much simpler than using the other licensed tools. Other licensed tools may have pretty good technical support. However, most problems with JMeter can be solved using the solutions that are available on the internet.

I'd rate the solution eight out of ten.

Which deployment model are you using for this solution?

Public Cloud
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Buyer's Guide
Apache JMeter
May 2024
Learn what your peers think about Apache JMeter. Get advice and tips from experienced pros sharing their opinions. Updated: May 2024.
770,924 professionals have used our research since 2012.
I.T. Architect, Analyst, Developer at a educational organization with 51-200 employees
Real User
Scalable and stable, easy to use, can be automated, and has good community support
Pros and Cons
  • "The scripting ability is most valuable. It is easy to use. There is a UI, and you can go in there and figure those things out. After you've got a good set of tests, you basically have a scripted document that you can grab and execute in a pipeline. It is pretty quick to set up, and you can scale it and version control it."
  • "Because so much is being done these days with authentication processes, a better system for either getting bearer tokens or some kind of token-based authentication prior to executing APIs would benefit the product. It is there, and you can do things. It is just not real clean at this point. There should be a better authentication process for JMeter or some automation or better guidelines for gaining and utilizing tokens on the fly."

What is our primary use case?

We use Apache  JMeter for API testing. Our latest task combines test cases with our CI/CD pipeline for deployment to Kubernetes. Tests are developed locally and automated for the build using standard Unit and Integration testing techniques. Once deployment is successful to Kubernetes, we develop the JMeter tests for automation in promotion scenarios. Thereafter, once a deployment is successful, we can automate promotion to the next level based on test success.

How has it helped my organization?

Test automation moves our organization close to rapidly deploying products. Unit and Integration testing is easy to automate, and most organizations perform these as part of their day-to-day operations. However, end-to-end testing, smoke testing, load testing, and performance testing are much harder to automate. Apache JMeter has aided in that challenge.

What is most valuable?

While there is a User Interface, the scripting ability is highly beneficial and is easy to use. Tests can be added to a CI/CD Pipeline for integration with testing and deployment scenarios once finalized and operational.

What needs improvement?

This is a difficult question to answer. On one side, JMeter is very flexible and allows for a high amount of customization. On the other, some tasks are common enough that it merits simplifying the process.

Authentication for API testing could use improvement. Currently, it is a multi-step process to call, extract, and utilize a bearer token securely for API calls. This process is becoming a common enough task that a "wizard" for creating and consuming popular authentication models is merited.

For how long have I used the solution?

I have been using this solution for about six years.

What do I think about the stability of the solution?

Apache JMeter is stable, and I personally have not encountered any issues. Depending on the size of test runs, one might need to adjust their JAVA settings to align with the test requirements.

What do I think about the scalability of the solution?

Its scalability works. It is a typically Java run. Therefore, it is limited only by what you can do in Java in terms of scalability.

Developers write tests, verify tests, and maintain tests using version control. They identify and tag each to ensure they are appropriately labeled for test purposes (E.g., unit testing, integration testing, performance testing, and the like). Unit and Integration test coverage is normally high. However, we require testing from outside of the system, and JMeter allows us to create tests automating this process.

How are customer service and technical support?

Apache JMeter utilizes community support. It is well-documented and has an active community. As far as I know, there is not a "pay-for-support" option.

Which solution did I use previously and why did I switch?

I have used Postman in collaboration with other developers. However, I prefer Jmeter only out of personal familiarity and not for any technical deficiencies of Postman.

How was the initial setup?

Apache JMeter setup is easy. However, there is a medium-to-heavy learning curve for developing tests and getting started using it for practical uses. Depending on its intended uses, there could be a significant configuration task for a given set of tests.

What's my experience with pricing, setup cost, and licensing?

Apache JMeter is under Apache License, Version 2.0 licensing. Understanding licensing requirements is important for the implementation of any tool.

What other advice do I have?

Understand the use case. Choosing the correct tool for any task is always a challenge. Jmeter offers a significant amount of flexibility and will work for a lot of solutions. Jmeter requires a commitment to learning for optimal operation; without that investment, tests may not yield the appropriate outcomes.

Which deployment model are you using for this solution?

Public Cloud

If public cloud, private cloud, or hybrid cloud, which cloud provider do you use?

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Abin K Raj - PeerSpot reviewer
Test Architect Applications and Performance at Max Stack Labs
Real User
Top 5Leaderboard
Open-source with good community support and is very customizable
Pros and Cons
  • "It's a powerful tool that is open source."
  • "The only thing is the learning curve. It's high."

What is our primary use case?

I've been using JMeter mainly for performance testing and some repair testing as well.

How has it helped my organization?

The solution is open source, so we don't have to pay for anything. That is a good thing since we can save the licensing costs, et cetera, as an organization. If you go for an expensive tool like LoadRunner or even Loyalty or Locust, you'll have to spend from your budget. JMeter has everything we need without the cost.

What is most valuable?

It's a powerful tool that is open source. There are various functionalities that can be used in various combinations. You can use Jmeter for automation, like getting some APIs. You can use JMeter for the performance testing. You can add listeners. You can look at the results and can generate a load with JMeter. The beauty of JMeter is there is a lot of support from the communities online who have worked on JMeter and can give first-hand advice. Most of our queries are already answered by someone, so we get the benefit of learning from them. 

It's a good tool for automated performance testing and some behavioral things.

It has a lot of customizable features. There are a lot of open libraries that you can download, and each time when you go for a new requirement, you will get new libraries. 

The setup is pretty easy.

What needs improvement?

The only thing is the learning curve. It's high.

We'd like to see more third-party integrations that can be handled quickly.

Support-wise, while the community is strong, it would be nice to have the option to reach out directly to JMeter. 

For performance testing, you need to correlate, et cetera, so we have to do it manually in order to get the right to regular expressions.

For how long have I used the solution?

I've been using the solution for five years. 

What do I think about the stability of the solution?

As an open-source tool, when changes happen, it may be a bit unstable. This is occasional, and for the most part, it is fine. I'd rate it seven out of ten in terms of stability. 

What do I think about the scalability of the solution?

The solution is scalable. I'd rate it ten out of ten.

How are customer service and support?

While there isn't any traditional support, there is a very strong community around the solution. There are so many people using it and contributing to solving problems, you can easily find answers to your queries online.

How was the initial setup?

The solution is straightforward to set up. I'd rate it five out of ten. There is a bit of a learning curve at first, however, once you start using it and taking advantage of its capabilities, I'd rate it nine out of ten. 

What was our ROI?

In the areas where we do some prototyping and also some areas where we want to save money and not focus on the revenue, we use JMeter. It's a very powerful tool. 

What's my experience with pricing, setup cost, and licensing?

This is an open-source solution and is, therefore, free to use. 

What other advice do I have?

I'm a customer and end-user.

I'm not sure which version of the solution I'm using. It's not the latest, however. It may be about one year old. 

You can deploy both on-premises and on the cloud. 

Once you go ahead and implement JMeter and you learn the process, it's a great tool. It could be a great asset for any organization as it is a highly customizable tool. If you can handle the learning curve, it will be worth it. Plus, as an open-source tool, you can save a lot of money on licensing. 

I'd rate the solution eight out of ten. 

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
RodrigoRozas Moser - PeerSpot reviewer
Jefe de QA & Arquitectura at Azurian
Real User
Easy to set up, offers a free trial, and is reliable
Pros and Cons
  • "It's easy to set up."
  • "Apache should have a graphic interface."

What is our primary use case?

I am using JMeter only to test some web services.

How has it helped my organization?

You can moderate some transactions which aren't available to too many users. You can use JMeter and compress as needed or to support as many users as possible. 

What is most valuable?

I am a basic user. I couldn't explain the different features deeply. I use, for example, the web services. I like the features where you are programming at an increased rate in web services. I use those features. For example, as part of using our web services, if there are 100 transactions with three threads, and I want to finish with 5,000 transactions with 20 threads on different pages, I can find the rate which my server used on each page. I like this feature in JMeter.

It's easy to set up.

What needs improvement?

Apache should have a graphic interface. That would help beginner users a lot. Sometimes it's hard to do what you need to do via the command line. 

For how long have I used the solution?

I've been using the solution for around two or three years. 

What do I think about the stability of the solution?

The solution is stable. There are no bugs or glitches, and it doesn't crash or freeze.

What do I think about the scalability of the solution?

The solution can scale. However, it requires configuration to do so. I don't have much knowledge in regards to how to scale exactly.

On the other hand, if you have a cloud server with 10 servers and you are using the same DNS for all servers, as all servers are working with the same application, and you have for example a load balancer that provides balancing to each one of these ten servers, I am not sure if Apache JMeter will report the different servers separately. I imagine not.

Different implementations of JMeter Runtime could be used to point to each one of these 10 servers. You can use JMeter in different OS, for example, Windows, Linux, or Unix. You have a lot of features to use different instances with JMeter. However, this load balancer concept would be harder to explain.

Right now, we have around two or three guys working directly with the product.

We are evaluating automatization apps currently. We are using Jenkins, and I am sure we will start with JMeter later. However, I have not defined a roadmap to expanding usage of this product just yet.

How are customer service and support?

I have not used technical support.

Which solution did I use previously and why did I switch?

I have used some other solution previously. However, I cannot recall the name. It was likely SoapUI. We picked up JMeter as it is free to start with and easy to pick up.

How was the initial setup?

The product is simple to set up. 

For example, you can just support Apache JMeter with the Java installer feature, which downloads the JDK or Java Runtime from the Oracle pages, for example. Or you can add the Runtime as a part of your installer, and after the installation, have a common user in Windows, for example, as an option. There is some knowledge of Java needed, and you do need to use the command line. Some may feel a bit lost when they start. However, there are different ways to do it according to your comfort level. 

It should have something for the front-end user to help them prepare the environment correctly, however.

We have two to three people handling the maintenance of the product at this time. 

What was our ROI?

I have not really noticed a return on investment. 

What other advice do I have?

I cannot recall the exact version number we are using. I always download the latest. 

We are currently using our own servers to provide the network.

I recommend JMeter if your goal is to design some stress tests. JMeter has some features. For example, you can start with tests on the command line. You can join instantly on our current deployment batches. Jenkins has some support for JMeter as well. On another hand, you can make a simple bridge to start the JMeter process with the command line in the same Jenkins deployment. You have a lot of features on hand.

I'd rate the solution eight out of ten.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Technical Specialist at a financial services firm with 10,001+ employees
Real User
Reasonably priced, performs well, and has responsive technical support
Pros and Cons
  • "It is cost-effective and simple to use."
  • "It will be much easier, and beneficial for the individual to run it on their own machines rather than having a high-end infrastructure, more CPUs, or more memory that has been consumed by Apache JMeter."

What is our primary use case?

Regardless of, whether it is used for personal performance, load, volume, UI test, or functional test Apache JMeter is the best tool on the market.

What is most valuable?

It is cost-effective and simple to use.

Take, for example, a performance test with, the Micro Focus performance test tool, and compare it to Apache JMeter. Apache JMeter is far less expensive than HP Performance Center.

What needs improvement?

When you run tests with JMeter, it generates test version five, which is extremely large. Also, when you have a large number of tests to run, it requires a large size or memory size, which basically means it consumes a lot of memory. It would be helpful to come up with a way to be able to use Apache JMeter in a way where it did not use as much memory. It will be much easier, and beneficial for the individual to run it on their own machines rather than having a high-end infrastructure, more CPUs, or more memory that has been consumed by Apache JMeter.

For how long have I used the solution?

I have been working with Apache JMeter for two years now.

I am working with the latest version.

It's on digital platforms rather than the cloud.

What do I think about the stability of the solution?

I am absolutely satisfied with the stability of Apache JMeter.

What do I think about the scalability of the solution?

Apache JMeter is a scalable product. We are pleased with the scalability of this solution.

How are customer service and support?

When we have encountered difficulties and reached out to technical support, they respond very quickly and most of the things are readily available with them, for all of the challenges or support that are required. If I had to rate them from one to ten, I would rate the technical support an eight out of ten.

How would you rate customer service and support?

Positive

How was the initial setup?

It is very easy to set up. There have been no issues, it's hassle-free, and it doesn't require a lot of expertise or specialization to configure and set up JMeter. 

It is very straightforward and very easy. That is something that anyone can do.

What about the implementation team?

Our team completed the deployment. It only requires one person and takes no more than two to four hours.

In terms of maintenance, we only require one person.

What was our ROI?

When you compare it to HP because prior to using this Apache JMeter, we used this HP Performance Center, and in terms of ROI, while I don't have exact figures, when it comes to HP Performance Center, we have nearly five times more. You can say that it's five times less of an investment and five times written on the investment by using Apache JMeter. With Apache JMeter, you receive five times more. It's higher.

What's my experience with pricing, setup cost, and licensing?

It's a yearly license.

What other advice do I have?

I would rate Apache JMeter an eight out of ten.

Which deployment model are you using for this solution?

On-premises
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Rajesh Chouhan - PeerSpot reviewer
Principal Engineer at Marsh McLennan
Real User
Top 5
A highly stable, open-source solution that can be used for load testing
Pros and Cons
  • "We use Apache JMeter for load testing, where we provide the throughput time."
  • "Apache JMeter's UI can be made more colorful."

What is most valuable?

We use Apache JMeter for load testing, where we provide the throughput time. Apache JMeter allows me to give any number of users to put the load in a particular time frame. With Apache JMeter, we won't need multiple tools with the application or to give a load for the application.

What needs improvement?

Apache JMeter's UI can be made more colorful.

For how long have I used the solution?

I have been using Apache JMeter for two years.

What do I think about the stability of the solution?

I rate Apache JMeter ten out of ten for stability.

What do I think about the scalability of the solution?

Around 10 people are using the solution in my team.

I rate Apache JMeter a nine out of ten for scalability.

How was the initial setup?

Apache JMeter's initial setup is easy.

What about the implementation team?

Apache JMeter's deployment takes half an hour to one hour.

What's my experience with pricing, setup cost, and licensing?

Apache JMeter is a free, open-source solution.

What other advice do I have?

I recommend users explore each and every functionality of Apache JMeter.

Overall, I rate Apache JMeter a nine out of ten.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
Flag as inappropriate
PeerSpot user
Alona Tupchei - PeerSpot reviewer
Engineering manager I - Quality at a financial services firm with 1,001-5,000 employees
Real User
Top 5
Great for comprehensive performance testing and helps measure how our applications are working
Pros and Cons
  • "We find the ease of use and the reports and graphs available valuable."
  • "The solution needs more metrics for reporting."

What is our primary use case?

Our primary use case for the solution is comprehensive performance testing. It measures how our applications are doing overall with a lot of users. For example, if we want to simulate 100 users doing transactions simultaneously, we want to see if our app handles it well and how fast it responds. In addition, we can utilize the solution to identify time spent on operations.

What is most valuable?

We find the ease of use and the reports and graphs available valuable.

What needs improvement?

The solution needs more metrics for reporting.

For how long have I used the solution?

We have been using the solution for two years.

What do I think about the stability of the solution?

The solution is stable, and we have not had any issues.

What do I think about the scalability of the solution?

The solution is scalable, but I cannot comment on the extent of its scalability because we have yet to scale widely.

How are customer service and support?

We have not had experience with customer service and support.

How was the initial setup?

The initial setup is straightforward.

What's my experience with pricing, setup cost, and licensing?

We use the tool as an open-source tool, so we do not pay for it.

Which other solutions did I evaluate?

We chose this solution because of its affordable cost, ease of use, and popularity.

What other advice do I have?

I rate the solution a nine out of ten. I advise users considering this solution to take a course to get familiar with it quickly.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Buyer's Guide
Download our free Apache JMeter Report and get advice and tips from experienced pros sharing their opinions.
Updated: May 2024
Buyer's Guide
Download our free Apache JMeter Report and get advice and tips from experienced pros sharing their opinions.