We performed a comparison between Apache JMeter and Sauce Labs based on real PeerSpot user reviews.
Find out what your peers are saying about Apache, OpenText, Tricentis and others in Performance Testing Tools."The biggest thing I liked about it is that there is a huge user base out there, and being shareware and being Apache, if I have any question on how to get something done, I get 18 different answers. Out of those, there would be at least a few good approaches for what I was trying to do. So, the support system out there is most valuable."
"The most valuable feature in JMeter is the Thread Group, which helps us to see whether the performance is good."
"It is very quick and user-friendly."
"The reporting features are really good. There's a lot less latency than other solutions."
"It's easy to set up."
"Apache JMeter is quite flexible."
"Scripting with the solution is good."
"A lot of things are valuable. It is free. It has a lot of features, such as report generation and integration with CI/CD, which makes it very competitive with the other paid solutions available in the market. It is a good solution."
"Running tests in parallel."
"The most valuable feature is the ability to run concurrent automated tests up to a specified value, depending on what we are currently paying for."
"Supplying devices to a testing team of possibly close to one thousand testers and developers is a great undertaking but Sauce Labs has made this very easy and a welcomed solution."
"The most valuable feature is cross-browser, cross-OS, cross-mobile device testing."
"Allows us to do JIRA Cloud and BambooHR Integration."
"The abundance of device, platform, and browser combinations/versions that can be used in parallel."
"Sauce Connect gave us ability to test an application that was hosted locally."
"It helped to integrate our performance testing and UAT, which helped to deliver a bug free software for our customers."
"The solution is not user-friendly, there is no framework for autocorrelation or parameterization."
"Self-healing and page rendering for the end-users are not available in Apache JMeter."
"Both scalability and stability could be improved in Apache JMeter."
"In this tool, automation in general is almost non-existent. Everything is done manually."
"Considering the kinds of tests we are performing here, where we launch several tests at the same time as a batch request, JMeter is not the best tool for the job. Those kinds of things could be done easily with other tools, like T6."
"In terms of setup, it could be nicer, to be honest. Sometimes, I get a little bit lost."
"At present, if the number of virtual users increases beyond 10,000 when testing, then it results in a Java heap which causes the solution to crash."
"Apache JMeter could use improvement in reporting. Currently, it isn't easy to generate reports in PDF format. While receiving reports in PDF format is possible, it requires a lot of customization. Additionally, when comparing the load test to others solutions it could improve."
"We had some specific features that we opened tickets on, although they were not earth-shattering. For example, the way the menus scroll could be improved because it does not have a bar, the way that people are used to, where you can move up and down."
"Integration with Github, as well as several other similar tools, could be improved."
"The testing process is difficult. I need to prove the complete competency of the tool, and I am finding that challenging."
"The ability to install profiles on iOS real mobile devices should be included."
"They should provide a JIRA integration plugin so that we can easily log issues."
"The one issue I have is the 14-day trial that a new user gets for free. I understand the concept of the trial period; however, I think this could be revamped to a free 30-minute run time every few months or after a significant update once the trial period has ended."
"We encountered minor issues with stability from time to time but Sauce Labs continues to make improvements."
"Running tests in the SauceCloud can take longer than running in a local environment."
Apache JMeter is ranked 1st in Performance Testing Tools with 82 reviews while Sauce Labs is ranked 11th in Functional Testing Tools with 111 reviews. Apache JMeter is rated 7.8, while Sauce Labs is rated 8.8. The top reviewer of Apache JMeter writes "It's a free tool with a vast knowledge base, but the reporting is lackluster, and it has a steep learning curve". On the other hand, the top reviewer of Sauce Labs writes "Robust documentation, helpful support representative, good licensing model". Apache JMeter is most compared with BlazeMeter, Postman, Tricentis NeoLoad, OpenText LoadRunner Professional and Katalon Studio, whereas Sauce Labs is most compared with BrowserStack, Perfecto, LambdaTest, OpenText UFT One and Katalon Studio.
We monitor all Performance Testing Tools reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.