We performed a comparison between Apache JMeter and Sauce Labs based on real PeerSpot user reviews.
Find out what your peers are saying about Apache, OpenText, Tricentis and others in Performance Testing Tools."Apache JMeter is well-known and widely used among developers, particularly on popular developer forums. While it may not have the most user-friendly interface, it offers strong support through official manuals and various articles from companies providing load testing services. The tool is free, has a substantial community, and serves as a fundamental choice for testers, especially those new to performance testing. While other tools like K6 may be more developer-oriented, JMeter's affordability and accessibility make it suitable for those without extensive performance testing experience."
"The most valuable feature of this solution is that it is free."
"The solution offers a lot of plug-ins and a huge continuously developing community that is regularly offering new features and plug-ins."
"It is open source as well as relatively extendable. It allows us to extend and add additional functionality and features. Its deployment is also very easy."
"The biggest thing I liked about it is that there is a huge user base out there, and being shareware and being Apache, if I have any question on how to get something done, I get 18 different answers. Out of those, there would be at least a few good approaches for what I was trying to do. So, the support system out there is most valuable."
"The solution is free. You don't need to worry about licensing costs."
"Very user-friendly and easy to use."
"When someone in our organization wants to test web applications, they use Apache JMeter since they face no hurdles while using the solution."
"From an infrastructure support perspective, the number of VMs, browsers installations and versions that we would be maintaining without Sauce Labs would be a lot. This includes not only the infrastructure costs, but also the maintenance costs and people's time. The labor cost associated with maintaining all of that would be considerably high. In terms of efficiency, having concurrent VMs with various browser combinations available has allowed us to run multiple executions by all our teams."
"Sauce Labs helps us identify the root causes of bugs. The solution offers a lot of flexibility by providing the latest iOS and Android emulator versions, and even the Appium updates when it comes out in the market."
"The custom capabilities that can be provided to Sauce Labs VMs during automated testing sessions are a valuable option for experimental or niche testing."
"They offer a large number of devices and browser/operating system combinations for real device tests"
"The error logging is also very robust. If we run a test through Sauce Labs and there's some sort of issue, a log will appear on the screen. Log messages are usually heinous and horrible... Sauce Labs is incredibly good at saying things like, 'Hey, here is the exact issue. Fix this and you can run the test.' That helps in getting things up and running and executing the way they should."
"The abundance of device, platform, and browser combinations/versions that can be used in parallel."
"The most valuable feature is the cross-browser feature, it has many android and iOS devices both simulators and real devices. It's easy to integrate. I also like video recording too."
"Allows us to do JIRA Cloud and BambooHR Integration."
"Report generation needs to be improved. It is quite difficult to get to."
"We're like the solution to be more user-friendly."
"At present, if the number of virtual users increases beyond 10,000 when testing, then it results in a Java heap which causes the solution to crash."
"The UI could be better."
"In terms of platform support, they need to extend the support for backend platforms and more of the legacy types of platforms."
"In Micro Focus LoadRunner we can go from the UI and we can configure it. There is no such feature in Apache JMeter. There should be UI-based recording history or logs."
"I sometimes found the documentation to be not as explanatory as I would've liked it. In the cases that I can think of, I was looking for a rather hand-holding approach with Step A, B, and C, but then I realized that with a product that is open source like this, you can't do handholding. That is because there are so many different uses and different unique environments and setups for it, but I remember thinking a few times that if they only just said this."
"The reports in Apache JMeter could improve."
"User account management needs an overhauls, allowing for user groups rather than just a hierarchy structure."
"Every time that we run scenarios where we need to discover the geolocation of our customers, by default it shows as Palo Alto, California. That's a problem for us and we need a workaround for those cases... It would be helpful if we could enter a latitude and longitude into Sauce Labs configuration and say, "When you run a virtual Chrome device or an iPhone, make this your default location. Then, provide me that device so I can run my scenarios," because we have stores in different regions across the United States."
"Speeds up the time it takes to run end-to-end user interface (UI) tests inside their virtual machines (VMs)."
"Integration with Github, as well as several other similar tools, could be improved."
"Sauce Labs' dashboard could be improved by adding more filters and allowing more customization options. There was one instance where the dashboard on the Sauce Labs UI didn't meet our requirements, so we had to use the Sauce Labs API to create some apps and dashboards on our own. The API endpoints could be a little more robust and customizable."
"I can't remove team members that have left the organization. I can only set them as inactive. It would be really nice to clean up my data and delete them from the team management."
"Latency, due to Sauce Labs being a cloud-based solution, has been a concern. We work in different continents and countries, but last time I checked, Sauce Labs was only offering two data centers, one in the EU and another in the US. If you're not in either of those two places, you would have latency and issues running your test cases."
"Unable to segregate reports for tests that are currently being developed, and might not be returning useful results."
Apache JMeter is ranked 1st in Performance Testing Tools with 46 reviews while Sauce Labs is ranked 11th in Functional Testing Tools with 1 review. Apache JMeter is rated 7.8, while Sauce Labs is rated 8.8. The top reviewer of Apache JMeter writes "It's a free, scalable tool that's good for checking backend services". On the other hand, the top reviewer of Sauce Labs writes "Provides multiple test environments and saves time, but should have something for inspecting mobile apps screens". Apache JMeter is most compared with Postman, BlazeMeter, Tricentis NeoLoad, OpenText LoadRunner Professional and Katalon Studio, whereas Sauce Labs is most compared with BrowserStack, Perfecto, LambdaTest, Katalon Studio and Bitbar.
We monitor all Performance Testing Tools reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.