We performed a comparison between Apache JMeter and BlazeMeter based on our users’ reviews in five categories. After reading all of the collected data, you can find our conclusion below.
Comparison Results: Since JMeter has limited scalability, BlazeMeter is the clear winner in this comparison.
"We appreciate that the solution is free to use, as an open-source tool."
"This solution is very user-friendly, and allows for a lot of data capture when testing."
"We really appreciate that the solution comes with a live community, which continuously provided plugins and support protocols."
"The biggest thing I liked about it is that there is a huge user base out there, and being shareware and being Apache, if I have any question on how to get something done, I get 18 different answers. Out of those, there would be at least a few good approaches for what I was trying to do. So, the support system out there is most valuable."
"The distributed load testing is very good with Apache JMeter."
"The most valuable feature for us is the available information on the forums and to be able to discuss and get answers from the people that are involved in using this tool."
"It's a powerful tool that is open source."
"It's a free tool."
"The solution offers flexibility with its configurations."
"For me, the best part is that we can graphically see the test result at runtime. It helps us understand the behavior of the application during all stages of the test."
"With the help of the Mock Services, we are overcoming everything. Wherever we are facing issues, whether they will be long term or temporary, by implementing the Mock Services we can bypass the faulty components that are not needed for our particular testing."
"The baseline comparison in BlazeMeter is very easy, especially considering the different tests that users can easily compare."
"The on-the-fly test data improved our testing productivity a lot. The new test data features changed how we test the applications because there are different things we can do. We can use mock data or real data. We can also build data based on different formats."
"It has a unique programming dashboard that is very user-friendly."
"The product's initial setup phase was simple."
"BlazeMeter's most valuable feature is its cloud-based platform for performance testing."
"The reporting is not very good."
"Apache JMeter could be a more user-friendly product from the end user's perspective."
"It's not easy to get the data from one place or to do customizations."
"The UI could be better."
"Report generation needs to be improved. It is quite difficult to get to."
"JMeter's reporting is extremely rudimentary. The fundamental reporting mechanisms need to be drastically improved. It doesn't utilize an automatic session management mechanism or methods other tools use like parsing cookies and variables. Everything needs to be done manually. There's no automation."
"At present, if the number of virtual users increases beyond 10,000 when testing, then it results in a Java heap which causes the solution to crash."
"What needs improvement in Apache JMeter is the very high load requirements when you want to scale it beyond certain thresholds. For example, small to mid-range testing is very easily done with Apache JMeter, but if you scale and increase the load, then it would be a problem because the tool consumes a lot of resources, probably because Apache JMeter provides an enriched UI experience, so it consumes a lot of memory and requires high CPU usage. This means you have to manage your infrastructure, or else you'll have high overhead expenses. As Apache JMeter is a heavyweight tool, that is an area for improvement, though I'm unsure if Apache can do something about it because it could be a result of the way it's architected. What I'd like to see from Apache JMeter in the future is for it to transition to the cloud, as a lot of cloud technologies emerge around the globe, and a lot of people prefer cloud-based solutions or cloud-native tools. Even if a company has a legacy system, it's still possible to transition to the cloud. I've worked with a company that was an on-premise company that moved to the cloud and became cloud-native. If Apache JMeter could transition to the cloud, similar to k6, then it could help lessen the intense resource consumption that's currently happening in Apache JMeter."
"Lacks an option to include additional users during a test run."
"Having more options for customization would be helpful."
"We encountered some minor bugs, and I would like to have the ability to add load generators to workspaces without having to use APIs. We can't do that now, so we're beholden to the APIs."
"One problem, while we are executing a test, is that it will take some time to download data. Let's say I'm performance testing with a high-end load configuration. It takes a minimum of three minutes or so to start the test itself. That's the bad part of the performance testing... every time I rerun the same test, it is downloaded again... That means I have to wait for three to four minutes again."
"A possible improvement could be the integration with APM tools."
"The should be some visibility into load testing. I'd like to capture items via snapshots."
"The seamless integration with mobiles could be improved."
"Potential areas for improvement could include pricing, configuration, setup, and addressing certain limitations."
Apache JMeter is ranked 1st in Performance Testing Tools with 82 reviews while BlazeMeter is ranked 4th in Performance Testing Tools with 41 reviews. Apache JMeter is rated 7.8, while BlazeMeter is rated 8.2. The top reviewer of Apache JMeter writes "It's a free tool with a vast knowledge base, but the reporting is lackluster, and it has a steep learning curve". On the other hand, the top reviewer of BlazeMeter writes "Reduced our test operating costs, provides quick feedback, and helps us understand how to build better test cases". Apache JMeter is most compared with Postman, Tricentis NeoLoad, Katalon Studio, OpenText LoadRunner Professional and ReadyAPI, whereas BlazeMeter is most compared with Tricentis NeoLoad, OpenText LoadRunner Cloud, OpenText LoadRunner Professional, BrowserStack and Perfecto. See our Apache JMeter vs. BlazeMeter report.
See our list of best Performance Testing Tools vendors and best Load Testing Tools vendors.
We monitor all Performance Testing Tools reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.
