We performed a comparison between Sauce Labs and SmartBear TestComplete based on real PeerSpot user reviews.
Find out in this report how the two Test Automation Tools solutions compare in terms of features, pricing, service and support, easy of deployment, and ROI."The most valuable feature is the cross-browser feature, it has many android and iOS devices both simulators and real devices. It's easy to integrate. I also like video recording too."
"The Failure Analysis feature is really important for us, one of the most important aspects. What is the root cause? Is it because we have a defect or is it that we have a test case that we need to fix or modify? The Failure Analysis is one of the main functionalities that I am exploring all the time in Sauce Labs... The Failure Analysis helps us to discover which test cases we need to work on."
"With Sauce Labs, we have a whole universe of devices: Galaxy, all the iPhones, and all the operating system versions. All our software developers are able to test on a multitude of different devices."
"From an infrastructure support perspective, the number of VMs, browsers installations and versions that we would be maintaining without Sauce Labs would be a lot. This includes not only the infrastructure costs, but also the maintenance costs and people's time. The labor cost associated with maintaining all of that would be considerably high. In terms of efficiency, having concurrent VMs with various browser combinations available has allowed us to run multiple executions by all our teams."
"Easy to integrate with the other platform for tracking purposes."
"It has a wide assortment of platforms."
"Supplying devices to a testing team of possibly close to one thousand testers and developers is a great undertaking but Sauce Labs has made this very easy and a welcomed solution."
"APPIUM for mobile testing has improved our organization by allowing us to test our website on more devices and browsers than we currently possess."
"The product has many features."
"Test items, project variables helps in managing automation suite and scheduling execution."
"The initial setup is pretty easy and it's quick to deploy."
"The reporting is ready to use and doesn't require any setup."
"The solution is mainly stable."
"It is a strong automation tool for desktop, browser, and API testing."
"The solution helps improve the stability of our product. It also decreases the work of our manual quality assurance engineers."
"The product's initial setup phase was easy."
"As a web product QA team, we sometimes need to spot check some new child site on multiple browsers and OS(es). It was a little time consuming for us since we need to click on each of the browser/OS combinations and start a new session to test. Every sprint, with new features and child pages being added, we mostly need to do the same steps over and over again."
"We have had some issues with the Sauce Connect Proxy on our Jenkins servers failing to start, which makes the optimal CI/CD pipeline come to a halt."
"The only drawback is the speed, it will be good if we have a server in Asia too. It will be great if we can improve speed while initialization and execution."
"Sauce Labs' dashboard could be improved by adding more filters and allowing more customization options. There was one instance where the dashboard on the Sauce Labs UI didn't meet our requirements, so we had to use the Sauce Labs API to create some apps and dashboards on our own. The API endpoints could be a little more robust and customizable."
"On a rare occasion, I will come into a ticket where a customer will have reached out to me after reaching out to Sauce Labs, saying, "Sauce Labs doesn't understand what I am going through. They are not being very helpful." So, I try to do clean up there. Outside of those extremely rare occasions, I have only had one or two of those support issues."
"Latency, due to Sauce Labs being a cloud-based solution, has been a concern. We work in different continents and countries, but last time I checked, Sauce Labs was only offering two data centers, one in the EU and another in the US. If you're not in either of those two places, you would have latency and issues running your test cases."
"When we were in development, it was a bit of a pain because we have onshore and offshore development. One of our development shops is in India, and we were running tests over there. When some of the users tried to log in, it was slow for them or we didn't have enough licenses. That was during the core development before we even launched."
"I can't remove team members that have left the organization. I can only set them as inactive. It would be really nice to clean up my data and delete them from the team management."
"The licensing costs are a little bit high and should be reduced."
"At times, identifying or locating an element can be somewhat challenging. However, in a recent test update, they introduced Optical Character Recognition (OCR) capability. This introduction has reduced the challenges to some extent, as we can now utilize OCR if the normal method doesn't work. Nevertheless, there is still significant potential for improvement in TestComplete's ability to identify various object elements. I don't have any specific concerns to mention. I have observed significant improvements in TestComplete over the past few years, especially in its support for highly dynamic object elements used in products like Salesforce Dynamics 365. In earlier versions, there were numerous challenges, but the current version is far superior to its predecessors."
"We were testing handheld barcode scanners running WindowsCE with many menus of warehouse functions, and our biggest problem was the timing between input and responses."
"TestComplete gives support to do requests to a SOAP web service but has no support to do HTTP requests on Restful services."
"What is currently missing from this solution is better support for mobile testing."
"SmartBear products generally have a weak link when it comes to integration with other test management tools like Inflectra."
"The solution needs Mac OS support. Right now, the solution has only been developed to accommodate Windows OS."
"The solution needs more training manuals or some form of online forum for learning. It needs more documentation."
Sauce Labs is ranked 13th in Test Automation Tools with 113 reviews while SmartBear TestComplete is ranked 7th in Test Automation Tools with 72 reviews. Sauce Labs is rated 8.8, while SmartBear TestComplete is rated 7.6. The top reviewer of Sauce Labs writes "Robust documentation, helpful support representative, good licensing model". On the other hand, the top reviewer of SmartBear TestComplete writes "A stable product that needs to improve its integration capabilities with other test management tools". Sauce Labs is most compared with BrowserStack, Perfecto, LambdaTest, OpenText UFT One and Bitbar, whereas SmartBear TestComplete is most compared with Tricentis Tosca, Katalon Studio, Ranorex Studio, OpenText UFT One and froglogic Squish. See our Sauce Labs vs. SmartBear TestComplete report.
See our list of best Test Automation Tools vendors, best Functional Testing Tools vendors, and best Regression Testing Tools vendors.
We monitor all Test Automation Tools reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.
