We performed a comparison between Sauce Labs and SmartBear TestComplete based on real PeerSpot user reviews.
Find out in this report how the two Test Automation Tools solutions compare in terms of features, pricing, service and support, easy of deployment, and ROI."Since this is an all-in-one testing site, we are able to take advantage of the browser OS combinations, mobile emulators and simulators, and real mobile devices. This is important to us since we have a variety of users, browsers, OS, etc."
"I have found the live test section with Sauce Labs to be extremely valuable. When you can't quite figure out why a test is failing, you can go to the live test results section within their tool and launch your test (specifying a given OS/browser, or device) manually and step through the test to see the issue more clearly, usually opening up the developer's tool console and watching the network calls and console (within Chrome) to usually find the underlying issue."
"With Sauce Labs, we have a whole universe of devices: Galaxy, all the iPhones, and all the operating system versions. All our software developers are able to test on a multitude of different devices."
"The most valuable feature is the ability to easily test multiple browsers and versions, as well as off-loading our local environments using the SauceCloud."
"It helped to integrate our performance testing and UAT, which helped to deliver a bug free software for our customers."
"The abundance of device, platform, and browser combinations/versions that can be used in parallel."
"Sauce Connect gave us ability to test an application that was hosted locally."
"I like the dashboard and seeing the test results. As a manager, I like to see the insights of the people using it, understanding the total path and run. I can see all of that as a manager. I also know team members love seeing the dashboard and seeing the test results in real-time."
"The product's initial setup phase was easy."
"The ease-of-use and quality of the overall product are above average."
"TestComplete has strong reporting capabilities. The reports they generate are really good."
"It is a strong automation tool for desktop, browser, and API testing."
"The ability to run a whole suite of tests automatically (which we did overnight)."
"TestComplete is simple, it's a very easy-to-use tool."
"The solution has a very nice interface."
"The most valuable feature of this solution is regression testing tools."
"Sauce Labs' dashboard could be improved by adding more filters and allowing more customization options. There was one instance where the dashboard on the Sauce Labs UI didn't meet our requirements, so we had to use the Sauce Labs API to create some apps and dashboards on our own. The API endpoints could be a little more robust and customizable."
"Sauce Labs needs to be improved in the different platforms for farm testing, like iOS and Android farm testing and farm testing web browsers."
"We have had some issues with the Sauce Connect Proxy on our Jenkins servers failing to start, which makes the optimal CI/CD pipeline come to a halt."
"Every time that we run scenarios where we need to discover the geolocation of our customers, by default it shows as Palo Alto, California. That's a problem for us and we need a workaround for those cases... It would be helpful if we could enter a latitude and longitude into Sauce Labs configuration and say, "When you run a virtual Chrome device or an iPhone, make this your default location. Then, provide me that device so I can run my scenarios," because we have stores in different regions across the United States."
"We had some specific features that we opened tickets on, although they were not earth-shattering. For example, the way the menus scroll could be improved because it does not have a bar, the way that people are used to, where you can move up and down."
"We encountered minor issues with stability from time to time but Sauce Labs continues to make improvements."
"The pricing model of Sauce Labs could be more flexible. Sauce Labs has just one price for the type of solution and a set number of devices. Other solutions have a fee for the base solution and an additional cost per device. If you're a smaller organization, you have to consider your needs. Some smaller companies still need to test various devices, so my advice is to start small and scale up as needed. We had initially planned to start big, but that would have been a big waste."
"One of the challenging areas for us is the reporting and the matrix. It should be based on roles, but right now it is only available for the admin role. The admin role can really do a lot of stuff, but our infrastructure team, which holds the admin role, is not ready to hand it over to us on the testing team. If Sauce Labs had permissions associated with roles, where this role could do this activity and that role could do that activity, it would be easier for us."
"We were testing handheld barcode scanners running WindowsCE with many menus of warehouse functions, and our biggest problem was the timing between input and responses."
"Right now, the product only supports Windows."
"The solution needs Mac OS support. Right now, the solution has only been developed to accommodate Windows OS."
"Stability issues occurred only when connecting to the SourceSafe. Sometimes, after getting the latest version, the tool hangs and it should be reopened in order to recover."
"At times, identifying or locating an element can be somewhat challenging. However, in a recent test update, they introduced Optical Character Recognition (OCR) capability. This introduction has reduced the challenges to some extent, as we can now utilize OCR if the normal method doesn't work. Nevertheless, there is still significant potential for improvement in TestComplete's ability to identify various object elements. I don't have any specific concerns to mention. I have observed significant improvements in TestComplete over the past few years, especially in its support for highly dynamic object elements used in products like Salesforce Dynamics 365. In earlier versions, there were numerous challenges, but the current version is far superior to its predecessors."
"One notable drawback is the absence of native integration with Git."
"Increased performance with less memory and CPU usage."
"To bring it up to a 10, I would be looking for the addition of some key functional API testing."
Sauce Labs is ranked 13th in Test Automation Tools with 113 reviews while SmartBear TestComplete is ranked 7th in Test Automation Tools with 72 reviews. Sauce Labs is rated 8.8, while SmartBear TestComplete is rated 7.6. The top reviewer of Sauce Labs writes "Robust documentation, helpful support representative, good licensing model". On the other hand, the top reviewer of SmartBear TestComplete writes "A stable product that needs to improve its integration capabilities with other test management tools". Sauce Labs is most compared with BrowserStack, Perfecto, LambdaTest, Bitbar and Tricentis Tosca, whereas SmartBear TestComplete is most compared with Tricentis Tosca, Katalon Studio, Ranorex Studio, OpenText UFT One and froglogic Squish. See our Sauce Labs vs. SmartBear TestComplete report.
See our list of best Test Automation Tools vendors, best Functional Testing Tools vendors, and best Regression Testing Tools vendors.
We monitor all Test Automation Tools reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.
