We performed a comparison between Apache JMeter and Sauce Labs based on real PeerSpot user reviews.
Find out what your peers are saying about Apache, OpenText, Tricentis and others in Performance Testing Tools."The most valuable features of Apache JMeter are user-friendliness, large resource, and the quality of assistance they provide. Additionally, it is easy to integrate with cloud platforms, such as AWS."
"JMeter's most valuable feature is the RegEx Extractor."
"The biggest thing I liked about it is that there is a huge user base out there, and being shareware and being Apache, if I have any question on how to get something done, I get 18 different answers. Out of those, there would be at least a few good approaches for what I was trying to do. So, the support system out there is most valuable."
"The metrics part of it and the ability to write your custom code to do some specific tests in the performance testing space are the most valuable features."
"The distributed load testing is very good with Apache JMeter."
"Apache JMeter is well-known and widely used among developers, particularly on popular developer forums. While it may not have the most user-friendly interface, it offers strong support through official manuals and various articles from companies providing load testing services. The tool is free, has a substantial community, and serves as a fundamental choice for testers, especially those new to performance testing. While other tools like K6 may be more developer-oriented, JMeter's affordability and accessibility make it suitable for those without extensive performance testing experience."
"The solution is scalable."
"I appreciate JMeter's simplicity and power for performance testing."
"Before implementing Sauce Labs, we tested physical devices that team members had to share. It was more feasible when we were all located in one office, but we couldn't leverage our offshore capacity. With this solution, we can do everything remotely, which is essential now that most of us work from home."
"Allows us to do JIRA Cloud and BambooHR Integration."
"Our machines are mostly Windows. Being able to test with Safari, on a Mac, and other types of browser pieces without having to manage all the infrastructure is the biggest feature that our team enjoys."
"Testing my app on cloud has really helped us with save time and resources to procure various hardware and software, and set those up."
"APPIUM for mobile testing has improved our organization by allowing us to test our website on more devices and browsers than we currently possess."
"Sauce Labs is optimized for automation and integration with the major CI/CD platforms and developer tools. We have an integration with App Center that we're working on. They have a storage API that lets us retrieve APK and IPA, iOS and Android builds off the phone, so that we can continue testing with CI/CD. They integrate with Jenkins, and Jenkins is the main CI/CD."
"Supplying devices to a testing team of possibly close to one thousand testers and developers is a great undertaking but Sauce Labs has made this very easy and a welcomed solution."
"I find that the multitude of browser and OS versions are very helpful for broadening testing scope."
"Apache JMeter could be a more user-friendly product from the end user's perspective."
"The solution needs to improve reporting. Currently, there is not enough automation involved with the feature. For example, there should be an automatic way of saving reports."
"If JMeter could provide a web version of editing, that would be good."
"In terms of setup, it could be nicer, to be honest. Sometimes, I get a little bit lost."
"Apache JMeter may have difficulty recognizing dynamic objects in some critical cases, which can lead to challenges in terms of object identification."
"Report generation needs to be improved. It is quite difficult to get to."
"The solution is not user-friendly, there is no framework for autocorrelation or parameterization."
"I need to consider it further because as features increase, it might become more complicated, and my goal has always been simplicity. Currently, I have to focus on other tasks, and I'm handling multiple responsibilities, so I can't juggle everything at once. However, if you ask me, I believe EJB covers most functionalities that are crucial. One improvement I'd suggest is adding a graphical aspect to the Gateway, making it a bit more colorful. Unlike JMeter, which lacks color, having a bit of color in the graphical aspects would be beneficial. Overall, for the essential features, EJB should work fine."
"The real concern is the load time of applications or real devices when we start our tests. It takes some time to load the application or web browser. Sometimes, it is frustrating too. Since they are real devices, we understand it takes some time to load. However, if it were to improve, then that would be a great asset to the solution. So, we would like better responsive times when opening applications and running tests."
"Start execution time as each time a set of tests start, it will launch a new VM so it takes a bit of time."
"Overall, I think Sauce Labs provides us with a valuable tool and resource. As far as what could be improved, I would say the overall test execution time. Some of the calls take a bit longer than I expect, for example in web browser tests; while the execution time isn't obnoxious, it could be improved so that overall tests/test suites finish faster."
"It should provide more examples of script code."
"The pricing model of Sauce Labs could be more flexible. Sauce Labs has just one price for the type of solution and a set number of devices. Other solutions have a fee for the base solution and an additional cost per device. If you're a smaller organization, you have to consider your needs. Some smaller companies still need to test various devices, so my advice is to start small and scale up as needed. We had initially planned to start big, but that would have been a big waste."
"I may not know what should be improved on the platform, but I think it could offer a greater variety of testing solutions. I know there might be competing solutions that cover more things I'm unaware of, and it could expand a bit more. We've done a lot of automated testing scenarios, and that's all the rage these days, so I think Sauce Labs could look at potential ways to improve and cover other scenarios."
"Better and programmatic controls on request/response recordings and sharing with developers."
"Speeds up the time it takes to run end-to-end user interface (UI) tests inside their virtual machines (VMs)."
Apache JMeter is ranked 1st in Performance Testing Tools with 82 reviews while Sauce Labs is ranked 11th in Functional Testing Tools with 112 reviews. Apache JMeter is rated 7.8, while Sauce Labs is rated 8.8. The top reviewer of Apache JMeter writes "It's a free tool with a vast knowledge base, but the reporting is lackluster, and it has a steep learning curve". On the other hand, the top reviewer of Sauce Labs writes "Robust documentation, helpful support representative, good licensing model". Apache JMeter is most compared with BlazeMeter, Postman, Tricentis NeoLoad, OpenText LoadRunner Professional and Katalon Studio, whereas Sauce Labs is most compared with BrowserStack, Perfecto, LambdaTest, OpenText UFT One and Katalon Studio.
We monitor all Performance Testing Tools reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.