Sauce Labs vs SmartBear TestLeft comparison

Cancel
You must select at least 2 products to compare!
Sauce Labs Logo
6,691 views|4,974 comparisons
96% willing to recommend
SmartBear Logo
374 views|315 comparisons
100% willing to recommend
Comparison Buyer's Guide
Executive Summary

We performed a comparison between Sauce Labs and SmartBear TestLeft based on real PeerSpot user reviews.

Find out what your peers are saying about Tricentis, OpenText, Perforce and others in Functional Testing Tools.
To learn more, read our detailed Functional Testing Tools Report (Updated: April 2024).
768,740 professionals have used our research since 2012.
Featured Review
Quotes From Members
We asked business professionals to review the solutions they use.
Here are some excerpts of what they said:
Pros
"It helped to integrate our performance testing and UAT, which helped to deliver a bug free software for our customers.""The most valuable feature is the ability to easily test multiple browsers and versions, as well as off-loading our local environments using the SauceCloud.""They offer a large number of devices and browser/operating system combinations for real device tests""Before implementing Sauce Labs, we tested physical devices that team members had to share. It was more feasible when we were all located in one office, but we couldn't leverage our offshore capacity. With this solution, we can do everything remotely, which is essential now that most of us work from home.""I like the dashboard and seeing the test results. As a manager, I like to see the insights of the people using it, understanding the total path and run. I can see all of that as a manager. I also know team members love seeing the dashboard and seeing the test results in real-time.""With Sauce Labs, we have a whole universe of devices: Galaxy, all the iPhones, and all the operating system versions. All our software developers are able to test on a multitude of different devices.""From an infrastructure support perspective, the number of VMs, browsers installations and versions that we would be maintaining without Sauce Labs would be a lot. This includes not only the infrastructure costs, but also the maintenance costs and people's time. The labor cost associated with maintaining all of that would be considerably high. In terms of efficiency, having concurrent VMs with various browser combinations available has allowed us to run multiple executions by all our teams.""The most valuable feature is the ability to run concurrent automated tests up to a specified value, depending on what we are currently paying for."

More Sauce Labs Pros →

"The most valuable features are test executor and development."

More SmartBear TestLeft Pros →

Cons
"Better and programmatic controls on request/response recordings and sharing with developers.""Sauce Labs needs to be improved in the different platforms for farm testing, like iOS and Android farm testing and farm testing web browsers.​""Start execution time as each time a set of tests start, it will launch a new VM so it takes a bit of time.""It should provide more examples of script code.""Another aspect that could be improved is having the virtual devices boot up a little quicker. Sometimes we wait up to a minute before a device is available. It would be nice if that was 30 seconds or so.""With the desktop browser, we can inspect any screen with the web developer option, but they should provide something for mobiles so that we can quickly inspect elements on the device. To write the Selenium scripts, we require web locators. We have to capture them from the local and execute the script on Sauce Labs. If Sauce Labs can provide a solution where we can inspect any of the mobile devices online, it will be very helpful for us.""The Jenkins Sauce OnDemand plugin could have more options available to tap into more of the custom capabilities Sauce Labs actually supports.""I would like to see improved network connectivity and it should allow playback for native apps."

More Sauce Labs Cons →

"TestLeft captures a lot of space in terms of memory, which is one issue that can be improved."

More SmartBear TestLeft Cons →

Pricing and Cost Advice
  • "We have an enterprise account; it has worked great for our needs."
  • "Try the free trial and work with a Sauce Labs representative to see what package works best for your application(s)."
  • "It could be less like pay-per-use with a lower rate."
  • "Go ahead please. Try it at a smaller scale."
  • "Trial the product and see if it suits your needs."
  • "When you reach the Enterprise licensing tier, base level being with 10 concurrent test sessions, pricing is essentially per-unit-of-concurrency thereafter with a relatively linear increase and not much benefit for "bulk"."
  • "Compared with other services, Sauce Labs is a bit expensive."
  • "​Now that we have an enterprise license, we no longer have to worry about minutes each month!​"
  • More Sauce Labs Pricing and Cost Advice →

    report
    Use our free recommendation engine to learn which Functional Testing Tools solutions are best for your needs.
    768,740 professionals have used our research since 2012.
    Questions from the Community
    Top Answer:The solution they provide is very robust. We can quickly connect to their environment with the hub URL. They have a URL that has the entire grid of desktops, web browsers, and mobile devices. They… more »
    Top Answer:With the desktop browser, we can inspect any screen with the web developer option, but they should provide something for mobiles so that we can quickly inspect elements on the device. To write the… more »
    Top Answer:We use it for automated testing. For our company, we do web testing automation. We run our test suites containing Java-based scripts and automate the entire mobile or web application. We've 500 to 600… more »
    Ask a question

    Earn 20 points

    Ranking
    11th
    Views
    6,691
    Comparisons
    4,974
    Reviews
    1
    Average Words per Review
    2,324
    Rating
    6.0
    32nd
    Views
    374
    Comparisons
    315
    Reviews
    0
    Average Words per Review
    0
    Rating
    N/A
    Comparisons
    Learn More
    Overview

    Sauce Labs is a functional testing tool that ensures your apps and websites work flawlessly on every browser, OS, and device. The solution allows you to automate functional testing on multiple operating systems and browsers, emulating the way that a user would use the website. With Sauce Labs, you can also run tests on various operating system and browser combinations in parallel, reducing the amount of time to get results. The Sauce Labs solution provides enterprise-grade security, scalability, and reliability.

    Sauce Labs Features

    Sauce Labs has many valuable key features. Some of the most useful ones include:

    • Automated cross-browser testing
    • Mobile testing
    • Secure tunneling protocol
    • Usage reporting
    • Enterprise security
    • Provisioning
    • Centralized user account management
    • Access controls
    • Support for Selenium, Appium, and JUnit Testing

    Sauce Labs Benefits

    There are many benefits to implementing Sauce Labs. Some of the biggest advantages the solution offers include:

    • Speed up development time: The solution makes it possible for you to test web and mobile apps in parallel and accelerate your testing time by up to 10x or more. Using Sauce Labs, you can increase developer productivity because your teams will be able to spend less time with test maintenance and debug faster.
    • No worrying about infrastructure: With Sauce Labs, you don’t have to buy or maintain more servers or mobile devices. You also don’t need to worry about updating browsers or VM licenses. Sauce Labs allows you to easily scale your tests with parallelization to speed up test cycles and boost capacity on their reliable cloud.
    • Run tests securely: The solution enables you to securely run your scripts and access your data and files from behind your firewall. Sauce Labs generates single-use VMs for every test and destroys them immediately afterwards so your data always remains secure.
    • Easy integration for your CI systems: Sauce Labs automated testing platform integrates with Jenkins, Bamboo, Microsoft VSTS, and others so you can test as fast as you develop. In addition, you can share results instantly by using the solution’s simple plugins.

    Reviews from Real Users

    Sauce Labs is a solution that stands out when compared to many of its competitors. It has valuable features that include error logging, helpful dashboards, and its browser.

    Joel A., Product Manager - Data & APIs at a marketing services firm, says, "The error logging is very robust. If we run a test through Sauce Labs and there's some sort of issue, a log will appear on the screen. Log messages are usually heinous and horrible... Sauce Labs is incredibly good at saying things like, 'Hey, here is the exact issue. Fix this and you can run the test.' That helps in getting things up and running and executing the way they should."

    Savio D., Sr. IT Architect at a healthcare company, mentions, "Sauce Labs' dashboards contain multiple useful metrics in one place. Everything is represented to us visually on the dashboard, which helps us understand where to focus our attention, what the issues are, and what we need to resolve."

    PeerSpot reviewer, Rob L., Director of Quality Assurance - Shared Service at a financial services firm, writes, “The most valuable feature for us is the browser. The most critical thing is that this software aligns with our Agile and DevOps way of doing things. It integrates with kickoff scripts through DevOps.”

    SmartBear TestLeft a functional testing tool fully embedded in standard IDEs. TestLeft is a powerful yet lean functional testing tool for dev-testers working in Agile teams. It fully embeds into standard development IDEs. A built-in access to object and method library is also available with TestLeft. Dev-testers can thereby easily and quickly create robust functional automated tests without leaving their favorite IDEs such as Visual Studio. It also works well with other tools in dev eco-systems such as source control or continuous integration systems.
    Sample Customers
    Salesforce.com, Mozilla, Zendesk, Puppet Labs, Twitter, Bank of America, Eventbrite, Bleacher Report, Okta, Intuit, Travelocity, Sharecare, CapitalOne.
    American Red Cross, CISCO, HONDA, ADIDAS, TBC bank
    Top Industries
    REVIEWERS
    Healthcare Company14%
    Computer Software Company11%
    Media Company9%
    Marketing Services Firm8%
    VISITORS READING REVIEWS
    Financial Services Firm17%
    Computer Software Company17%
    Healthcare Company6%
    Retailer6%
    VISITORS READING REVIEWS
    Computer Software Company33%
    Financial Services Firm15%
    Manufacturing Company11%
    Retailer6%
    Company Size
    REVIEWERS
    Small Business25%
    Midsize Enterprise20%
    Large Enterprise55%
    VISITORS READING REVIEWS
    Small Business18%
    Midsize Enterprise11%
    Large Enterprise71%
    VISITORS READING REVIEWS
    Small Business23%
    Midsize Enterprise26%
    Large Enterprise51%
    Buyer's Guide
    Functional Testing Tools
    April 2024
    Find out what your peers are saying about Tricentis, OpenText, Perforce and others in Functional Testing Tools. Updated: April 2024.
    768,740 professionals have used our research since 2012.

    Sauce Labs is ranked 11th in Functional Testing Tools with 112 reviews while SmartBear TestLeft is ranked 32nd in Functional Testing Tools. Sauce Labs is rated 8.8, while SmartBear TestLeft is rated 7.0. The top reviewer of Sauce Labs writes "Robust documentation, helpful support representative, good licensing model". On the other hand, the top reviewer of SmartBear TestLeft writes "Simple to set up and the test execute feature is helpful, but the cost could be reduced". Sauce Labs is most compared with BrowserStack, Perfecto, LambdaTest, OpenText UFT One and Katalon Studio, whereas SmartBear TestLeft is most compared with SmartBear TestComplete and Tricentis Tosca.

    See our list of best Functional Testing Tools vendors.

    We monitor all Functional Testing Tools reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.