We performed a comparison between Apache JMeter and Sauce Labs based on real PeerSpot user reviews.
Find out what your peers are saying about Apache, OpenText, Tricentis and others in Performance Testing Tools."I like the fact that JMeter integrates well with other tools."
"It's a powerful tool that is open source."
"Due to process automation, I don't have to prepare reports, making it the perfect solution."
"The solution is free. You don't need to worry about licensing costs."
"User-friendly and open source."
"JMeter's most valuable feature is the RegEx Extractor."
"The most valuable feature of this solution is being able to launch many requests and scheduling simulating human interactions with the application."
"API testing, Database Testing, and MQ testing can be done with ease."
"Since this is an all-in-one testing site, we are able to take advantage of the browser OS combinations, mobile emulators and simulators, and real mobile devices. This is important to us since we have a variety of users, browsers, OS, etc."
"The solution they provide is very robust. We can quickly connect to their environment with the hub URL. They have a URL that has the entire grid of desktops, web browsers, and mobile devices. They also provide real devices, so you just provide the URL and test your application."
"It offers the single best solution for integrating deep automated browser testing in a CI/CD pipeline."
"They offer a large number of devices and browser/operating system combinations for real device tests"
"With only a few clicks, it gives us the availability to use any browser and OS combination whenever we want."
"It provides a comprehensive selection of browsers and platform versions for our test automations and CI/CD pipeline process. It also provides a comprehensive set of virtual mobile devices, which we can configure for our automation and availability. These features are valuable for us when it comes to testing our applications. We have a website and mobile applications that we want to test and diversify to various browsers and mobile devices as well as restore various versions. This helps us to find bugs that users might be facing and correct them."
"So far, the stability has proven to be quite good."
"It has significantly enhanced our testing accuracy by approximately 50%."
"If the solution was GUI based, I believe that it would be more versatile."
"They can improve it a little bit in terms of distribution load testing. We struggled with it during the distribution. In terms of reporting, runtime monitoring is not currently included, and it should be included. They can also improve it on the reporting side in terms of the comparison of the reports. They can also focus more on integration with CI/CD. Currently, people are using their own customized tools. It would be nice if Apache can provide some standard tools and procedures for integration with CI/CD tools like DPR. There are some tools, but it would be nice if official standard tools and procedures are available."
"In future releases, it would be helpful if there was an integration with ALM Octane."
"There are certain things like we can't merge custom metrics into the JMeter reports. We're limited to JMeter metrics, and other server metrics can't be integrated with JMeter dashboard. This forces us to rely on another tool."
"If JMeter could provide a web version of editing, that would be good."
"The user interface is a little bit tricky."
"The solution's setup could be easier and security could be improved to minimize vulnerabilities."
"Apache JMeter's UI can be made more colorful."
"The real concern is the load time of applications or real devices when we start our tests. It takes some time to load the application or web browser. Sometimes, it is frustrating too. Since they are real devices, we understand it takes some time to load. However, if it were to improve, then that would be a great asset to the solution. So, we would like better responsive times when opening applications and running tests."
"We have found that during automated testing this can be very slow. This causes inconsistencies with the tests. It's very difficult to rely on a service when you can't be sure if a test will pass or fail the next time it runs. This means building in a lot of sync time into the tests which in turn slows them down. If this speed could be improved then the service would be much better."
"The Jenkins Sauce OnDemand plugin could have more options available to tap into more of the custom capabilities Sauce Labs actually supports."
"I would like to see improved network connectivity and it should allow playback for native apps."
"They could improve the platform's customer support services."
"Overall, I think Sauce Labs provides us with a valuable tool and resource. As far as what could be improved, I would say the overall test execution time. Some of the calls take a bit longer than I expect, for example in web browser tests; while the execution time isn't obnoxious, it could be improved so that overall tests/test suites finish faster."
"Integration with Github, as well as several other similar tools, could be improved."
"The testing process is difficult. I need to prove the complete competency of the tool, and I am finding that challenging."
Apache JMeter is ranked 1st in Performance Testing Tools with 82 reviews while Sauce Labs is ranked 11th in Functional Testing Tools with 112 reviews. Apache JMeter is rated 7.8, while Sauce Labs is rated 8.8. The top reviewer of Apache JMeter writes "It's a free tool with a vast knowledge base, but the reporting is lackluster, and it has a steep learning curve". On the other hand, the top reviewer of Sauce Labs writes "Robust documentation, helpful support representative, good licensing model". Apache JMeter is most compared with BlazeMeter, Postman, Tricentis NeoLoad, OpenText LoadRunner Professional and Katalon Studio, whereas Sauce Labs is most compared with BrowserStack, Perfecto, LambdaTest, OpenText UFT One and Katalon Studio.
We monitor all Performance Testing Tools reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.
