Tushar Shankar - PeerSpot reviewer
Tech Lead - QA at a financial services firm with 10,001+ employees
Real User
Top 10
Easy to install, but it flips a bit whenever we add more than 10,000 virtual users
Pros and Cons
  • "The solution's initial setup is easy."
  • "They should improve the solution on its UI front."

What is our primary use case?

We use the solution for performance and security testing.

What is most valuable?

The solution's most valuable feature is its ability to install and automate functions with ease.

What needs improvement?

They should improve the solution on its UI front.

For how long have I used the solution?

 We have been using the solution for six years.

Buyer's Guide
Apache JMeter
April 2024
Learn what your peers think about Apache JMeter. Get advice and tips from experienced pros sharing their opinions. Updated: April 2024.
768,246 professionals have used our research since 2012.

What do I think about the stability of the solution?

I rate the solution's stability as a seven or eight.

What do I think about the scalability of the solution?

We are an enterprise business using the solution. It flips a bit whenever we add more than 10,000 virtual users to the solution. It becomes impossible to get the expected result. We have to use distributed testing to deal with the issue. I rate the solution's scalability as a six.

How are customer service and support?

We check with the solution's community support forum in case of any queries. It is very active.

Which solution did I use previously and why did I switch?

We tried out solutions such as LoadRunner and NeoLoad. As these were commercial tools, we settled for JMeter. Also, the reviews from those who have used the solution helped us switch to it.

How was the initial setup?

I rate the solution's initial setup as an eight. It is easy.

Regarding deployment, you have to download the installation file and save it in the system. If it has specific prerequisites, such as installing Java, you need to ensure it is compatible with JMeter's current version.

Which other solutions did I evaluate?

The solution is free of cost as it is open source.

What other advice do I have?

The solution works well for small or medium applications but not with 10,000 or more footfall. I rate the solution as a seven.

Which deployment model are you using for this solution?

Hybrid Cloud
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Senior Cloud Performance Engineer at Oracle
Real User
Top 20
Allows us to create scripts and is useful for load testing and performance testing but could be more stable
Pros and Cons
  • "It is scalable. You can scale up to 1,000 users in JMeter. If you can put up four slave servers, you can easily ramp up to 1,000 users."
  • "JMeter should be more stable. Every time there is a new release coming up, a lot of its older functionalities or the new functionalities that are brought in are not very well-documented. It should be documented properly, and there should be proper use cases."

What is our primary use case?

We use this solution mostly for creating scripts, load testing, and performance testing. If my client doesn't have a tool or I don't have a tool, I try to leverage JMeter because it's an open-source tool.

I personally use JMeter for things which cannot be covered by our load testing tool, which is OATS, Oracle Application Testing Suite. This is a tool that was developed by Oracle but is no longer in use because Oracle has stopped developing it.

The solution is deployed on-prem and on private and public clouds.

What needs improvement?

JMeter should be more stable. Every time there is a new release coming up, a lot of its older functionalities or the new functionalities that are brought in are not very well-documented. It should be documented properly, and there should be proper use cases. A lot of the newer features don't work, and sometimes you have to spend a lot of time maintaining the scripts. That is something JMeter could probably look at.

For example, in JMeter 5 they brought in a lot of new controllers. But there isn't a lot of documentation available on the Apache site on how you're supposed to use those controllers. They've explained the controller functionality, but there aren't any proper use cases to show that. 

For how long have I used the solution?

I have been using JMeter for a long time and do a lot of work with this solution.

What do I think about the stability of the solution?

It's not stable. With every new release, they come up with newer features, which aren't always very stable. So, stability is a concern.

What do I think about the scalability of the solution?

It is scalable. You can scale up to 1,000 users in JMeter. If you can put up four slave servers, you can easily ramp up to 1,000 users. That's not a problem.

Because it's open-source, a lot of organizations try to leverage JMeter into everything. I don't think JMeter is currently very adaptable to all the technologies. That is something Apache should think of – incorporating other technologies and other tech stacks, which can be scripted from JMeter and tested using JMeter.

How are customer service and support?

On a scale of 1 to 5, I would rate technical support 2.5

They're not very good because JMeter is an open-source tool. You can raise a bug to JMeter, and they might fix it or they might say that, "We will actually fix this in the next release." So, because it's an open-source tool, you do not get dedicated support. You have to raise tickets and wait. If you use BlazeMeter, the support is probably a little better because you can take your issues there.

I don't think support is great if you compare it with tools like NeoLoad or LoadRunner where they have a dedicated support team. You can raise tickets. You have a direct conversation with their engineers. They can help you understand where the issue is exactly. That kind of support is not in JMeter, at least not now. BlazeMeter has it, but I have not used BlazeMeter support, so I'm not sure how it is. But from what I have seen with JMeter, support is not great.

How was the initial setup?

It is straightforward, but for JMeter 5, since they have introduced SSL handshake at the slave level, that becomes a little bit of a challenge for somebody who is doing it for the first time if you're doing a distributed execution, that becomes a challenge.

But since there was not enough documentation, I had to do a lot of troubleshooting on my own, since it was new. Now there's a lot of documentation available, but initially, there was not much documentation.

JMeter is pretty easy to use if you are using it for the purpose of only developing scripts. You can just uninstall the file and you can start using it. The only challenge happens if you're trying to access the internet over any kind of proxy. Then, you'll have to start it via the proxy mode.

Otherwise, deploying JMeter is pretty easy compared to other tools. You just have to download, unzip, and you are ready to go.

What about the implementation team?

We installed JMeter ourselves.

What other advice do I have?

I would rate this solution 7 out of 10.

Which deployment model are you using for this solution?

Hybrid Cloud
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Buyer's Guide
Apache JMeter
April 2024
Learn what your peers think about Apache JMeter. Get advice and tips from experienced pros sharing their opinions. Updated: April 2024.
768,246 professionals have used our research since 2012.
Gonçalo Teixeira - PeerSpot reviewer
Business Development and Product Owner at wrightia
Real User
Top 5
Good for performance testing but UI needs imrpovement
Pros and Cons
  • "We are using this for performance testing and some automation."
  • "In terms of setup, it could be nicer, to be honest. Sometimes, I get a little bit lost."

What is our primary use case?

We are using this for performance testing and some automation. We consolidate the test data in our own systems and then use an API to send this data to JMeter. The software testing team then uses it to perform all the tests they wish to do. Nowadays, we are mainly focused on regression testing and working with that.

What is most valuable?

It works really well. 

What needs improvement?

To be honest, the UI could be more user-friendly. As a UX guy, I believe it's quite cold. The solution that I have nowadays is a very traditional one. So, there is room for improvement in the UI of Apache JMeter. 

For how long have I used the solution?

I have been using Apache JMeter for two years. We have it in-house. It's a solution that my company has been using for a long time.

What do I think about the scalability of the solution?

There are around seven users in my company using this solution. 

How was the initial setup?

In terms of setup, it's quite simple. It has its benefits, but we are already used to it. In terms of experience, it could be nicer, to be honest. Sometimes, I get a little bit lost.

What about the implementation team?

Two people are required for the deployment and maintenance. They can be he managers, tech leads, engineers, or developers.

What's my experience with pricing, setup cost, and licensing?

The users need to pay for licenses.

Which other solutions did I evaluate?

We are not switching because we have several testing teams, and we sell them to several customers. So the solution sometimes is not ours; it's the customer's, and they provide some licenses because usually, companies like Vodafone have corporate licensing. They can provide licensing without being responsible for it. 

We also have our own solutions, but we are not sometimes responsive before saying I don't want to use this or I don't want to use that. Because we are an outsourcing company, we put people accordingly to the field desired by our customers. So if I need a Selenium expert or an Optimum or TestRail, whatever, I go to the market, and I outsource this to the customer.

What other advice do I have?

Overall, I would rate the solution a seven out of ten. I recommend it because I know a lot of people who use it, and they don't have any complaints.

Disclosure: My company has a business relationship with this vendor other than being a customer: Partner
PeerSpot user
Senior Engineer at Apexon
Real User
Top 5
An open-source tool that is easy to use and can be integrated with multiple solutions
Pros and Cons
  • "It is an open-source tool that is easy to use. It can be easily integrated with multiple tools, including Selenium."
  • "The UI of the solution needs to be better. The UI takes up a lot of our bandwidth."

What is our primary use case?

Load testing is something that we used to do on Apache JMeter. We have regular releases every two weeks with varying features and modules. For major releases, where most of the EPS are modified or new features are introduced with new pages, we perform a performance test once every three to four months. We have a fixed schedule for performance testing before the sale, such as Thanksgiving and Black Friday, to ensure stability and performance during the sales period.

What is most valuable?

It is an open-source tool that is easy to use. It can be easily integrated with multiple tools, including Selenium. The tool also provides a recording and playback feature, along with the ability for modification and parameterization. Since it is an open-source tool, it can be easily integrated with many other tools, such as BlazeMeter, making the integration process very helpful.

What needs improvement?

The UI of the solution needs to be better. The UI takes up a lot of our bandwidth. So, we always run on the command line. Hence, improving the UI is needed. If it can be more lightweight, the editing can also be made easier.

For how long have I used the solution?

I have been using Apache JMeter for four to five years.

What do I think about the stability of the solution?

Apache JMeter is a stable tool. Around 10,000-12,000 users are using the tool. One can increase its usage, but we haven't done so since we will need multiple machines to be connected to a network to generate the load. So, we haven't exceeded its use beyond 10,000 users.

What do I think about the scalability of the solution?

Apache JMeter is a scalable tool.

How are customer service and support?

We haven't used the solution's technical support.

Which solution did I use previously and why did I switch?

We used other solutions in the past, but they were costly since they require a license, whereas Apache JMeter is free. Hence, we prefer Apace JMeter.

How was the initial setup?

The solution's initial setup process was straightforward since setup can be done by opening a JAR file. It can be deployed in half an hour. Experienced people can deploy it in 15-20 mins, and newer ones may take up to an hour.

Also, we don't deploy on any server. Normally, the tests are on local ones.

For deployment and maintenance, you need knowledge of scripting and APIs. But otherwise, maintenance should be easy. Once you record and have the script ready, until and unless there are modifications to the application, maintaining it should not be much hassle.

What about the implementation team?

The implementation was done in-house.

What was our ROI?

There is no investment as such. Only the resourcing part is there in the tool.

What's my experience with pricing, setup cost, and licensing?

Apache JMeter is a free tool.

What other advice do I have?

I recommend Apache JMeter to others who want to use it. I rate the overall solution an eight out of ten.

Which deployment model are you using for this solution?

On-premises
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Harish Kawade - PeerSpot reviewer
Performance Specialist at DKATALIS
Real User
Top 5
Good for entire performance testing process and offers good open source community
Pros and Cons
  • "JMeter is basically the art of the entire performance testing process."
  • "There are certain things like we can't merge custom metrics into the JMeter reports. We're limited to JMeter metrics, and other server metrics can't be integrated with JMeter dashboard. This forces us to rely on another tool."

What is our primary use case?

We primarily use it for conducting different types of performance testing, such as load testing, spike testing, and endurance testing.

How has it helped my organization?

JMeter is basically the art of the entire performance testing process. We generate load on our application using JMeter and then monitor various metrics like CPU with different monitoring tools. It's the essential foundation for our performance testing.

What is most valuable?


What needs improvement?

JMeter is doing some good things with upcoming releases, but the main area for improvement is the extensions available. 

Another area of improvement is the reporting part, specifically regarding report generation. 

There are certain things like we can't merge custom metrics into the JMeter reports. We're limited to JMeter metrics, and other server metrics can't be integrated with JMeter dashboard. This forces us to rely on another tool. 

We should be able to add or custom-configure server details directly in JMeter reports.

For how long have I used the solution?

We have been using it for three years.

What do I think about the stability of the solution?

I would rate the stability a nine out of ten.  It's generally quite stable, it hardly has crashes or issues.

What do I think about the scalability of the solution?

Scalability is good for my use cases, but to generate a large load, you must go into distribution mode, which is more complex to configure and requires powerful machines. So, while it's fine for my needs, but the scalability wouldn't be a perfect ten. I would rate it a seven out of ten, as there are some limitations for large-scale testing.

I'm the one who uses it most extensively. And the other we have four to five people are using it just for their local testing. It's development testing kind of stuff.  

How are customer service and support?

It's an open-source community. So we can post our queries there. We generally get good responses from the forums. So it's good enough.

Which solution did I use previously and why did I switch?

I used another tool like HP LoadRunner. And now it's offered by some different companies, ownership-wise, but it was long back. 

How was the initial setup?

I would rate my experience with the initial setup an eight out of ten, where one is difficult, and ten is easy. Even for new users, the installation is straightforward based on the documentation. 

However, customizing and building something extra can be complex. But overall, it's easy enough to download and start working with.

Our main system is on the cloud, so we primarily use JMeter on the cloud. However, some use cases require on-premises deployment, and we use it there as well.

What about the implementation team?

One person is enough for deployment. The deployment won't take much time. It is very fast, typically within five minutes.

What's my experience with pricing, setup cost, and licensing?

We use the open-source version. 

What other advice do I have?

I'll definitely advise that you should at least give it a try. If it serves your initial needs and meets your expectations, you should go for it. 

It's quite an old and up-to-mark tool with a proven track record in the industry, and there's a strong community behind it. So it's definitely worth giving a shot.

Overall, I would rate the solution an eight out of ten. 

Which deployment model are you using for this solution?

Hybrid Cloud
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Flag as inappropriate
PeerSpot user
Olamitan (Gabriel) Akinmoladun - PeerSpot reviewer
Quality Assurance Engineer at Carry1st
Real User
Top 20
An open source Java application designed to load test functional behavior and gauge software performance
Pros and Cons
  • "JMeter is user-friendly, and that's a notable advantage of JVTech. It's straightforward and easy to use, unlike some other load testing tools, making it very easy to understand."
  • "I need to consider it further because as features increase, it might become more complicated, and my goal has always been simplicity. Currently, I have to focus on other tasks, and I'm handling multiple responsibilities, so I can't juggle everything at once. However, if you ask me, I believe EJB covers most functionalities that are crucial. One improvement I'd suggest is adding a graphical aspect to the Gateway, making it a bit more colorful. Unlike JMeter, which lacks color, having a bit of color in the graphical aspects would be beneficial. Overall, for the essential features, EJB should work fine."

What is our primary use case?

We utilize it solely for load testing and performance testing. 

What is most valuable?

JMeter is user-friendly, and that's a notable advantage of JVTech. It's straightforward and easy to use, unlike some other load testing tools, making it very easy to understand.                

What needs improvement?

As features increase, it might become more complicated, and my goal has always been simplicity. Currently, I have to focus on other tasks, and I'm handling multiple responsibilities, so I can't juggle everything at once. However, if you ask me, I believe EJB covers most functionalities that are crucial. One improvement I'd suggest is adding a graphical aspect to the Gateway, making it a bit more colorful. Unlike JMeter, which lacks color, having a bit of color in the graphical aspects would be beneficial. Overall, for the essential features, EJB should work fine.

For how long have I used the solution?

I have been using Apache JMeter for the past 4 to 5 years. 

What do I think about the stability of the solution?

The last time I used it, there were some APIs that I tested, and they were running well before. We didn't make any changes to them, but when I tried to check them again recently, they didn't go through. It seemed like an issue at the integration level. I'm currently working on getting half an automation, where I'll have separate linear and rest. But that's the situation so far.

What other advice do I have?

I prefer tools that I can easily teach people within twenty minutes, and JMeter falls into that category. It's part of the tools I use to help others learn load testing. While JMeter can be a bit tricky, I find it easy to grasp and teach. It's user-friendly, and I can quickly introduce someone to it. It's a tool that I can easily exchange with others, and I aim to achieve proficiency in it soon because of its simplicity and ease of use.

I would rate it a seven. The reason for the seven is due to occasional stability issues that can occur. Additionally, the lack of color in its scheduling makes it less engaging, especially when teaching someone newer to the system. It can become a bit boring in terms of appearance.
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Flag as inappropriate
PeerSpot user
Solution Architect at EPAM Systems
Real User
Top 10
Helps identify bottlenecks by measuring response times whle we increase request flow rates
Pros and Cons
  • "I appreciate JMeter's simplicity and power for performance testing."
  • "Improving JMeter's sync time would be beneficial."

What is our primary use case?

Apache JMeter's key feature is its ability to manage load profiles, gradually increasing requests over time. This was crucial for us as we tested our application, handling unique protocols and increasing load steadily. JMeter helped identify bottlenecks by measuring response times as we increased request flow rates. This data guided us in optimizing our system's performance and scaling hardware when needed. Recently, new tools like Platinum Consultant have emerged, but I haven't explored them thoroughly. My colleagues prefer these newer tools over JMeter.

How has it helped my organization?

JMeter helps us track response times between request and response. As we increase our workload, response times also rise, indicating potential bottlenecks. We use JMeter to gauge when we need to upgrade hardware or optimize our application for better performance. It's effective in measuring various request types and their corresponding response times, making it a valuable tool for assessing system performance.

What is most valuable?

I appreciate JMeter's simplicity and power for performance testing. While I haven't used all its features, the ability to simulate heavy loads from multiple users is quite beneficial. However, in my current configuration, we haven't utilized this specific aspect of JMeter. Compared to other costly tools like Hewlett Packard, JMeter is free and easier to use, although there are newer tools like Gatling that I haven't tried. Overall, JMeter is simple and effective for performance testing.     

What needs improvement?

Improving JMeter's sync time could be beneficial. For example, compared to a Hewlett Packard tool that required four machines for load generation, JMeter reduced this to possibly just two machines for the same workload.

For how long have I used the solution?

I've been a junior with a few years of experience using Apache JMeter for load testing. It's a straightforward tool with useful features, although not entirely unique. 

What do I think about the stability of the solution?


The stability is great; it's optimized and efficient. I'd rate JMeter's stability a nine out of ten, based on my experience.

What do I think about the scalability of the solution?

Scalability is near-linear, especially with custom configurations.

How was the initial setup?

Setting up JMeter is straightforward, not complex at all. Deployment time depends on the code you write for JMeter, which is executed efficiently.I've used it on-premises, but it might also work in a cloud configuration

What's my experience with pricing, setup cost, and licensing?

Since it's free, there's no need for extensive support or improvements in pricing.

What other advice do I have?

Overall, I'd give JMeter a solid ten for its simplicity and effectiveness in typical tasks. While the UI could be slightly better, it's not a critical issue. JMeter provides valuable data and insights through its graphs, and its main benefit lies in being free, simple to use, and widely recognized.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
Flag as inappropriate
PeerSpot user
Consultant at Capgemini Invent
Real User
Top 5
The solution is open-source, easy to install, not user-friendly
Pros and Cons
  • "The new version of the solution is stable."
  • "The solution is not user-friendly, there is no framework for autocorrelation or parameterization."

What is our primary use case?

The primary use case for the solution is to test web applications.

What is most valuable?

The most valuable feature is that the solution is open source.

What needs improvement?

There are a lot of areas in this solution that can use improvement. The solution is not user-friendly, there is no framework for autocorrelation or parameterization.

For how long have I used the solution?

I have been using the solution for a little over one year.

What do I think about the stability of the solution?

The new version of the solution is stable.

How was the initial setup?

The initial setup is straightforward as long as you do not require an advanced setup, which can be difficult. The basic setup takes only one hour.

What's my experience with pricing, setup cost, and licensing?

The solution is open-source.

What other advice do I have?

I give the solution

The only support available for the solution is online because it is open-source and does not come with technical support.

To anyone that is thinking of using the solution, I suggest you familiarize yourself with regular expression.

Which deployment model are you using for this solution?

On-premises
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Buyer's Guide
Download our free Apache JMeter Report and get advice and tips from experienced pros sharing their opinions.
Updated: April 2024
Buyer's Guide
Download our free Apache JMeter Report and get advice and tips from experienced pros sharing their opinions.