We performed a comparison between Apache JMeter and SmartBear LoadNinja based on real PeerSpot user reviews.
Find out in this report how the two Performance Testing Tools solutions compare in terms of features, pricing, service and support, easy of deployment, and ROI."JMeter's most valuable feature is the RegEx Extractor."
"A lot of things are valuable. It is free. It has a lot of features, such as report generation and integration with CI/CD, which makes it very competitive with the other paid solutions available in the market. It is a good solution."
"I use all the tools, but one feature that stands out is JMeter's ability to test when services are sending a particular kind of request. We are using specific ports to send queries, and assess the performance based on the time it takes these queries to respond. You can use it with stuff other than the web performance."
"I like the fact that JMeter integrates well with other tools."
"The most valuable feature of Apache JMeter is its popularity. It is the best open-source tool with all the features needed."
"The most valuable feature for us is the available information on the forums and to be able to discuss and get answers from the people that are involved in using this tool."
"It is easy to set up."
"The solution is free. You don't need to worry about licensing costs."
"We are happy with the technical support."
"SmartBear LoadNinja is easy to use and implement."
"It's a very simple tool for performance testing."
"In Micro Focus LoadRunner we can go from the UI and we can configure it. There is no such feature in Apache JMeter. There should be UI-based recording history or logs."
"Considering the kinds of tests we are performing here, where we launch several tests at the same time as a batch request, JMeter is not the best tool for the job. Those kinds of things could be done easily with other tools, like T6."
"Report generation needs to be improved. It is quite difficult to get to."
"They can improve it a little bit in terms of distribution load testing. We struggled with it during the distribution. In terms of reporting, runtime monitoring is not currently included, and it should be included. They can also improve it on the reporting side in terms of the comparison of the reports. They can also focus more on integration with CI/CD. Currently, people are using their own customized tools. It would be nice if Apache can provide some standard tools and procedures for integration with CI/CD tools like DPR. There are some tools, but it would be nice if official standard tools and procedures are available."
"In this tool, automation in general is almost non-existent. Everything is done manually."
"Improving JMeter's sync time would be beneficial."
"I sometimes found the documentation to be not as explanatory as I would've liked it. In the cases that I can think of, I was looking for a rather hand-holding approach with Step A, B, and C, but then I realized that with a product that is open source like this, you can't do handholding. That is because there are so many different uses and different unique environments and setups for it, but I remember thinking a few times that if they only just said this."
"JMeter's reporting is extremely rudimentary. The fundamental reporting mechanisms need to be drastically improved. It doesn't utilize an automatic session management mechanism or methods other tools use like parsing cookies and variables. Everything needs to be done manually. There's no automation."
"It needs time to mature."
"On a smaller scale, there will be no budget issues, but as we expand to a larger user base, I believe we will face some pricing challenges."
"As we ran the test, we couldn't see the real-time results of how the solution behaved for 200 to 400 virtual users."
Apache JMeter is ranked 1st in Performance Testing Tools with 82 reviews while SmartBear LoadNinja is ranked 14th in Performance Testing Tools with 3 reviews. Apache JMeter is rated 7.8, while SmartBear LoadNinja is rated 7.4. The top reviewer of Apache JMeter writes "It's a free tool with a vast knowledge base, but the reporting is lackluster, and it has a steep learning curve". On the other hand, the top reviewer of SmartBear LoadNinja writes "Easy to use with good documentation and helpful support". Apache JMeter is most compared with BlazeMeter, Postman, Tricentis NeoLoad, Katalon Studio and Tricentis Tosca, whereas SmartBear LoadNinja is most compared with ReadyAPI Performance, OpenText LoadRunner Professional, BlazeMeter, Tricentis NeoLoad and Selenium HQ. See our Apache JMeter vs. SmartBear LoadNinja report.
See our list of best Performance Testing Tools vendors and best Load Testing Tools vendors.
We monitor all Performance Testing Tools reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.