We performed a comparison between BlazeMeter and Sauce Labs based on real PeerSpot user reviews.
Find out what your peers are saying about Tricentis, OpenText, Perforce and others in Functional Testing Tools."It's a great platform because it's a SaaS solution, but it also builds the on-premises hosting solutions, so we have implemented a hybrid approach. BlazeMeter sets us up for our traditional hosting platforms and application stack as well as the modern cloud-based or SaaS-based application technologies."
"BlazeMeter can be used for both API and performance testing, it is a multi-facility tool."
"One thing that we are doing a lot with the solution, and it's very good, is orchestrating a lot of JMeter agents. This feature has helped us a lot because we can reuse other vendors' performance scripts that they have used with JMeter before."
"The baseline comparison in BlazeMeter is very easy, especially considering the different tests that users can easily compare."
"The most valuable feature of the solution is its ability to run high loads and generate reports."
"I really like the recording because when I use the JMeter the scripting a lot of recording it takes me a lot of time to get used to. The BlazeMeter the recording is quick."
"Using cloud-based load generators is highly valuable to us, as we can test from outside our network and increase load generation without having to upscale our hardware as much. The cloud load generator is there when we need it and is the feature we leverage the most."
"It supports any number of features and has a lot of tutorials."
"There is a huge amount of open source, community provided resources."
"From an infrastructure support perspective, the number of VMs, browsers installations and versions that we would be maintaining without Sauce Labs would be a lot. This includes not only the infrastructure costs, but also the maintenance costs and people's time. The labor cost associated with maintaining all of that would be considerably high. In terms of efficiency, having concurrent VMs with various browser combinations available has allowed us to run multiple executions by all our teams."
"Testing my app on cloud has really helped us with save time and resources to procure various hardware and software, and set those up."
"APPIUM for mobile testing has improved our organization by allowing us to test our website on more devices and browsers than we currently possess."
"I like the dashboard and seeing the test results. As a manager, I like to see the insights of the people using it, understanding the total path and run. I can see all of that as a manager. I also know team members love seeing the dashboard and seeing the test results in real-time."
"Sauce Labs helps us identify the root causes of bugs. The solution offers a lot of flexibility by providing the latest iOS and Android emulator versions, and even the Appium updates when it comes out in the market."
"It provides zero maintenance browser instances."
"I have found the live test section with Sauce Labs to be extremely valuable. When you can't quite figure out why a test is failing, you can go to the live test results section within their tool and launch your test (specifying a given OS/browser, or device) manually and step through the test to see the issue more clearly, usually opening up the developer's tool console and watching the network calls and console (within Chrome) to usually find the underlying issue."
"BlazeMeter has room for improvement in terms of its integration with GitLab, particularly in the context of CI/CD processes. While it has multiple integrations available, the level of integration with GitLab may need further enhancements. It is known to work well with Git and Jenkins, although the extent of compatibility with GitLab is uncertain."
"For a new user of BlazeMeter, it might be difficult to understand it from a programming perspective."
"From a performance perspective, BlazeMeter needs to be improved...BlazeMeter has not found the extensions for WebSockets or Java Applet."
"Scalability is an area of concern in BlazeMeter, where improvements are required."
"The seamless integration with mobiles could be improved."
"Lacks an option to include additional users during a test run."
"The Timeline Report panel has no customization options. One feature that I missed was not having a time filter, which I had in ELK. For example, there are only filter requests for a time of less than 5 seconds."
"Integration with APM tools like Dynatrace or AppDynamics needs to be improved."
"Sauce Labs' dashboard could be improved by adding more filters and allowing more customization options. There was one instance where the dashboard on the Sauce Labs UI didn't meet our requirements, so we had to use the Sauce Labs API to create some apps and dashboards on our own. The API endpoints could be a little more robust and customizable."
"We encountered minor issues with stability from time to time but Sauce Labs continues to make improvements."
"Overall, I think Sauce Labs provides us with a valuable tool and resource. As far as what could be improved, I would say the overall test execution time. Some of the calls take a bit longer than I expect, for example in web browser tests; while the execution time isn't obnoxious, it could be improved so that overall tests/test suites finish faster."
"This product is not super scalable, because you have a very specific number of VMs that you can use."
"We had some specific features that we opened tickets on, although they were not earth-shattering. For example, the way the menus scroll could be improved because it does not have a bar, the way that people are used to, where you can move up and down."
"Unable to segregate reports for tests that are currently being developed, and might not be returning useful results."
"They should provide a JIRA integration plugin so that we can easily log issues."
"Multi-domain SSO is a big concern for us right now, especially as we've been merged into a larger company. I suddenly have teams coming from 20 different domains, and because the main master Sauce Labs account is locked down to one SSO domain, there are teams that can't run a test right now. I've heard they're working on a solution and they've been very communicative with us about it. A solution to that would help us a lot."
BlazeMeter is ranked 8th in Functional Testing Tools with 41 reviews while Sauce Labs is ranked 11th in Functional Testing Tools with 113 reviews. BlazeMeter is rated 8.2, while Sauce Labs is rated 8.8. The top reviewer of BlazeMeter writes "Reduced our test operating costs, provides quick feedback, and helps us understand how to build better test cases". On the other hand, the top reviewer of Sauce Labs writes "Robust documentation, helpful support representative, good licensing model". BlazeMeter is most compared with Apache JMeter, Tricentis NeoLoad, OpenText LoadRunner Cloud, OpenText LoadRunner Professional and RadView WebLOAD, whereas Sauce Labs is most compared with BrowserStack, Perfecto, LambdaTest, OpenText UFT One and Appium.
See our list of best Functional Testing Tools vendors and best Test Automation Tools vendors.
We monitor all Functional Testing Tools reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.
