We performed a comparison between BlazeMeter and Sauce Labs based on real PeerSpot user reviews.
Find out what your peers are saying about Tricentis, OpenText, Perforce and others in Functional Testing Tools."The product's initial setup phase was simple."
"The on-the-fly test data improved our testing productivity a lot. The new test data features changed how we test the applications because there are different things we can do. We can use mock data or real data. We can also build data based on different formats."
"The orchestration feature is the most valuable. It's like the tourist backend component of BlazeMeter. It allows me to essentially give BlazeMeter multiple JMeter scripts and a YAML file, and it will orchestrate and execute that load test and all those scripts as I define them."
"BlazeMeter can be used for both API and performance testing, it is a multi-facility tool."
"It is a stable solution. When we compare BlazeMeter with other tools in the market, I can say that the solution's overall performance has also been very good in our company."
"The product's initial setup phase was straightforward."
"It has a unique programming dashboard that is very user-friendly."
"The most valuable aspect of BlazeMeter is its user-friendly nature, ability to conduct distributed load testing and comprehensive analysis and reporting features. It particularly excels in providing a clear and organized view of load test results."
"They offer a large number of devices and browser/operating system combinations for real device tests"
"Sauce Connect gave us ability to test an application that was hosted locally."
"I have found the live test section with Sauce Labs to be extremely valuable. When you can't quite figure out why a test is failing, you can go to the live test results section within their tool and launch your test (specifying a given OS/browser, or device) manually and step through the test to see the issue more clearly, usually opening up the developer's tool console and watching the network calls and console (within Chrome) to usually find the underlying issue."
"It provides zero maintenance browser instances."
"So far, the stability has proven to be quite good."
"It has significantly enhanced our testing accuracy by approximately 50%."
"The custom capabilities that can be provided to Sauce Labs VMs during automated testing sessions are a valuable option for experimental or niche testing."
"The Failure Analysis feature is really important for us, one of the most important aspects. What is the root cause? Is it because we have a defect or is it that we have a test case that we need to fix or modify? The Failure Analysis is one of the main functionalities that I am exploring all the time in Sauce Labs... The Failure Analysis helps us to discover which test cases we need to work on."
"If the solution had better support and the documentation was efficient it would do better in the market."
"The scanning capability needs improvement."
"For a new user of BlazeMeter, it might be difficult to understand it from a programming perspective."
"Integration is one of the things lacking in BlazeMeter compared to some newer options."
"The performance could be better. When reviewing finished cases, it sometimes takes a while for BlazeMeter to load. That has improved recently, but it's still a problem with unusually large test cases. The same goes for editing test cases. When editing test cases, it starts to take a long time to open those action groups and stuff."
"A possible improvement could be the integration with APM tools."
"I believe that data management and test server virtualization are things that Perforce is working on, or should be working on."
"One problem, while we are executing a test, is that it will take some time to download data. Let's say I'm performance testing with a high-end load configuration. It takes a minimum of three minutes or so to start the test itself. That's the bad part of the performance testing... every time I rerun the same test, it is downloaded again... That means I have to wait for three to four minutes again."
"Another aspect that could be improved is having the virtual devices boot up a little quicker. Sometimes we wait up to a minute before a device is available. It would be nice if that was 30 seconds or so."
"User account management needs an overhauls, allowing for user groups rather than just a hierarchy structure."
"There have been various times throughout the last month or so where the service has gone down during business hours."
"On a rare occasion, I will come into a ticket where a customer will have reached out to me after reaching out to Sauce Labs, saying, "Sauce Labs doesn't understand what I am going through. They are not being very helpful." So, I try to do clean up there. Outside of those extremely rare occasions, I have only had one or two of those support issues."
"Every time that we run scenarios where we need to discover the geolocation of our customers, by default it shows as Palo Alto, California. That's a problem for us and we need a workaround for those cases... It would be helpful if we could enter a latitude and longitude into Sauce Labs configuration and say, "When you run a virtual Chrome device or an iPhone, make this your default location. Then, provide me that device so I can run my scenarios," because we have stores in different regions across the United States."
"This product is not super scalable, because you have a very specific number of VMs that you can use."
"The ability to install profiles on iOS real mobile devices should be included."
"We have found that during automated testing this can be very slow. This causes inconsistencies with the tests. It's very difficult to rely on a service when you can't be sure if a test will pass or fail the next time it runs. This means building in a lot of sync time into the tests which in turn slows them down. If this speed could be improved then the service would be much better."
BlazeMeter is ranked 8th in Functional Testing Tools with 41 reviews while Sauce Labs is ranked 11th in Functional Testing Tools with 113 reviews. BlazeMeter is rated 8.2, while Sauce Labs is rated 8.8. The top reviewer of BlazeMeter writes "Reduced our test operating costs, provides quick feedback, and helps us understand how to build better test cases". On the other hand, the top reviewer of Sauce Labs writes "Robust documentation, helpful support representative, good licensing model". BlazeMeter is most compared with Apache JMeter, Tricentis NeoLoad, OpenText LoadRunner Cloud, OpenText LoadRunner Professional and RadView WebLOAD, whereas Sauce Labs is most compared with BrowserStack, Perfecto, LambdaTest, OpenText UFT One and Appium.
See our list of best Functional Testing Tools vendors and best Test Automation Tools vendors.
We monitor all Functional Testing Tools reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.
