BrowserStack vs Sauce Labs vs SmartBear TestComplete comparison

Cancel
You must select at least 2 products to compare!
BrowserStack Logo
8,845 views|6,910 comparisons
Sauce Labs Logo
6,858 views|5,065 comparisons
SmartBear Logo
6,309 views|4,453 comparisons
Comparison Buyer's Guide
Executive Summary

We performed a comparison between BrowserStack, Sauce Labs, and SmartBear TestComplete based on real PeerSpot user reviews.

Find out what your peers are saying about Tricentis, OpenText, Perforce and others in Functional Testing Tools.
To learn more, read our detailed Functional Testing Tools Report (Updated: March 2024).
765,234 professionals have used our research since 2012.
Featured Review
Quotes From Members
We asked business professionals to review the solutions they use.
Here are some excerpts of what they said:
Pros
"It just added some flexibility. There was nothing that improved our coding standards, etc. because all of our UIs were functional before we tried it.""The most valuable feature is the variety the solution offers around the different types of devices, especially mobile devices.""BrowserStack's best feature is browser testing across different platforms, including mobile.""I like that it offers full device capability.""I have found that BrowserStack is stable.""It is a stable solution. There's no lagging and jittering.""Local testing for products with no public exposure is an advantage in development.""The most valuable feature of BrowserStack is the ability to do manual testing."

More BrowserStack Pros →

"They update for the latest browsers and mobile phones and support a lot of combinations. They have 1,000-plus desktop combinations and browser versions, which is really great. We need that at Applause. The all-in-one testing suite aspect of it is really important because most of our clients prefer to go to one place.""Sauce Labs is optimized for automation and integration with the major CI/CD platforms and developer tools. We have an integration with App Center that we're working on. They have a storage API that lets us retrieve APK and IPA, iOS and Android builds off the phone, so that we can continue testing with CI/CD. They integrate with Jenkins, and Jenkins is the main CI/CD.""Testing across multiple devices and environments is now possible to do quickly and effectively.""The most valuable feature is cross-browser, cross-OS, cross-mobile device testing.""The abundance of device, platform, and browser combinations/versions that can be used in parallel.""It helped to integrate our performance testing and UAT, which helped to deliver a bug free software for our customers.""The most critical thing is that this software aligns with our Agile and DevOps way of doing things. It integrates with kickoff scripts through DevOps.""Live device testing. As we all know, It's really hard and challenging to find/purchase many real devices to test because it will be costly and not all the team can be able to purchase all of the devices out there. We used to have a lot of real devices under our labs. However, it is really time-consuming to maintain those devices and make sure they are up to date with the testing requirements."

More Sauce Labs Pros →

"It is a strong automation tool for desktop, browser, and API testing.""The ability to run a whole suite of tests automatically (which we did overnight).""The solution is mainly stable.""The most valuable feature is the integration with Azure DevOps.""It's cross platform automation capabilities specially ranging across web, UNIX (via putty), and other systems.""Customer service and technical support responsiveness are high. Everyone is very professional.""It allows us to test both desktop and web applications.""The most valuable feature of this solution is its ability to integrate with Azure DevOps for continuous integration and deployment."

More SmartBear TestComplete Pros →

Cons
"While I was testing I was not 100% sure a that was properly mimicking the browsers or not. We had some issues with a browser, and the reason was the browser itself does not provide any support. If the local system does not provide any support, I think this was the problem. There should be better integration with other solutions, such as JIRA.""Sometimes BrowserStack is really slow and devices are not loading. it is really annoying and that's why we bought several newer devices because sometimes it's affecting us a lot.""I would like to see clearer visibility.""We are struggling to do local testing.""Connectivity can sometimes mar the testing experience.""There is some stability issue in the product, making it in areas where improvements are required.""The solution is slow.""I would like for there to be more integration with BrowserStack and other platforms."

More BrowserStack Cons →

"Sauce Labs' dashboard could be improved by adding more filters and allowing more customization options. There was one instance where the dashboard on the Sauce Labs UI didn't meet our requirements, so we had to use the Sauce Labs API to create some apps and dashboards on our own. The API endpoints could be a little more robust and customizable.""Sauce Labs needs to be improved in the different platforms for farm testing, like iOS and Android farm testing and farm testing web browsers.​""Progress towards reducing application testing time can be made.""We have faced challenges with the availability of mobile devices. There was once or twice where there were no mobile devices available.""I may not know what should be improved on the platform, but I think it could offer a greater variety of testing solutions. I know there might be competing solutions that cover more things I'm unaware of, and it could expand a bit more. We've done a lot of automated testing scenarios, and that's all the rage these days, so I think Sauce Labs could look at potential ways to improve and cover other scenarios.""Latency, due to Sauce Labs being a cloud-based solution, has been a concern. We work in different continents and countries, but last time I checked, Sauce Labs was only offering two data centers, one in the EU and another in the US. If you're not in either of those two places, you would have latency and issues running your test cases.""Unable to segregate reports for tests that are currently being developed, and might not be returning useful results.""We had some specific features that we opened tickets on, although they were not earth-shattering. For example, the way the menus scroll could be improved because it does not have a bar, the way that people are used to, where you can move up and down."

More Sauce Labs Cons →

"There could be API interfaces with this tool.""Increased performance with less memory and CPU usage.""Stability issues occurred only when connecting to the SourceSafe. Sometimes, after getting the latest version, the tool hangs and it should be reopened in order to recover.""To bring it up to a 10, I would be looking for the addition of some key functional API testing.""The code editor, though following eclipse-style, is still a work in progress and gives a very poorly formatted code once viewed via other editing tools.""One notable drawback is the absence of native integration with Git.""During the distribution of our regression test cases, the control IDs are not always recognized correctly.""The licensing costs are a little bit high and should be reduced."

More SmartBear TestComplete Cons →

Pricing and Cost Advice
  • "This solution costs less than competing products."
  • "The price is fine."
  • "There are different licenses available that can be customized. You can select the features that you want only to use which can be a cost-benefit."
  • "BrowserStack could have a better price, but good things have a price."
  • "The price of BrowserStack is high."
  • "Compared to other solutions, BrowserStack is one of the cheapest."
  • More BrowserStack Pricing and Cost Advice →

  • "We have an enterprise account; it has worked great for our needs."
  • "Try the free trial and work with a Sauce Labs representative to see what package works best for your application(s)."
  • "It could be less like pay-per-use with a lower rate."
  • "Go ahead please. Try it at a smaller scale."
  • "Trial the product and see if it suits your needs."
  • "When you reach the Enterprise licensing tier, base level being with 10 concurrent test sessions, pricing is essentially per-unit-of-concurrency thereafter with a relatively linear increase and not much benefit for "bulk"."
  • "Compared with other services, Sauce Labs is a bit expensive."
  • "​Now that we have an enterprise license, we no longer have to worry about minutes each month!​"
  • More Sauce Labs Pricing and Cost Advice →

  • "The product is becoming more and more expensive."
  • "My advice so far, is that while it’s not quite as powerful and easy to use as UFT, its price tag more than makes up for it."
  • "The price is less, compared to other products, such as QTP."
  • "Buy modules on demand. If you have a four-person team and they will each automate tests only 25% of the time, it's better to buy a floating licence and share the tool during the work day."
  • "TestComplete now have come up with three modules (Web, Desktop & Mobile), so based on the type of product for automation, it is adequate to purchase the required module."
  • "This is a pay-per-use service that is not expensive, and cost-efficient if you have a small team."
  • "The option we chose was around $2,000 USD."
  • "The licensing costs are in the range of $1,000 to $3,000."
  • More SmartBear TestComplete Pricing and Cost Advice →

    report
    Use our free recommendation engine to learn which Functional Testing Tools solutions are best for your needs.
    765,234 professionals have used our research since 2012.
    Questions from the Community
    Top Answer:With respect to pricing, they are a bit expensive. I would rate the licensing model a six out of ten, where one is… more »
    Top Answer:The issue with the product stems from the fact that when we try to do a single or multiple login on multiple browsers… more »
    Top Answer:The solution they provide is very robust. We can quickly connect to their environment with the hub URL. They have a URL… more »
    Top Answer:With the desktop browser, we can inspect any screen with the web developer option, but they should provide something for… more »
    Top Answer:We use it for automated testing. For our company, we do web testing automation. We run our test suites containing… more »
    Top Answer:This company offers end-to-end capabilities for test suite creation and execution. One feature that I particularly… more »
    Top Answer:There are certain challenges related to the license management system in place. It comes with a high cost. An annual… more »
    Top Answer:At times, identifying or locating an element can be somewhat challenging. However, in a recent test update, they… more »
    Ranking
    5th
    Views
    8,845
    Comparisons
    6,910
    Reviews
    12
    Average Words per Review
    353
    Rating
    7.9
    11th
    Views
    6,858
    Comparisons
    5,065
    Reviews
    3
    Average Words per Review
    1,689
    Rating
    8.3
    10th
    Views
    6,309
    Comparisons
    4,453
    Reviews
    8
    Average Words per Review
    502
    Rating
    7.1
    Comparisons
    Learn More
    Overview
    BrowserStack is a cloud-based cross-browser testing tool that enables developers to test their websites across various browserson different operating systems and mobile devices, without requiring users to install virtual machines, devices or emulators.

    Sauce Labs is a functional testing tool that ensures your apps and websites work flawlessly on every browser, OS, and device. The solution allows you to automate functional testing on multiple operating systems and browsers, emulating the way that a user would use the website. With Sauce Labs, you can also run tests on various operating system and browser combinations in parallel, reducing the amount of time to get results. The Sauce Labs solution provides enterprise-grade security, scalability, and reliability.

    Sauce Labs Features

    Sauce Labs has many valuable key features. Some of the most useful ones include:

    • Automated cross-browser testing
    • Mobile testing
    • Secure tunneling protocol
    • Usage reporting
    • Enterprise security
    • Provisioning
    • Centralized user account management
    • Access controls
    • Support for Selenium, Appium, and JUnit Testing

    Sauce Labs Benefits

    There are many benefits to implementing Sauce Labs. Some of the biggest advantages the solution offers include:

    • Speed up development time: The solution makes it possible for you to test web and mobile apps in parallel and accelerate your testing time by up to 10x or more. Using Sauce Labs, you can increase developer productivity because your teams will be able to spend less time with test maintenance and debug faster.
    • No worrying about infrastructure: With Sauce Labs, you don’t have to buy or maintain more servers or mobile devices. You also don’t need to worry about updating browsers or VM licenses. Sauce Labs allows you to easily scale your tests with parallelization to speed up test cycles and boost capacity on their reliable cloud.
    • Run tests securely: The solution enables you to securely run your scripts and access your data and files from behind your firewall. Sauce Labs generates single-use VMs for every test and destroys them immediately afterwards so your data always remains secure.
    • Easy integration for your CI systems: Sauce Labs automated testing platform integrates with Jenkins, Bamboo, Microsoft VSTS, and others so you can test as fast as you develop. In addition, you can share results instantly by using the solution’s simple plugins.

    Reviews from Real Users

    Sauce Labs is a solution that stands out when compared to many of its competitors. It has valuable features that include error logging, helpful dashboards, and its browser.

    Joel A., Product Manager - Data & APIs at a marketing services firm, says, "The error logging is very robust. If we run a test through Sauce Labs and there's some sort of issue, a log will appear on the screen. Log messages are usually heinous and horrible... Sauce Labs is incredibly good at saying things like, 'Hey, here is the exact issue. Fix this and you can run the test.' That helps in getting things up and running and executing the way they should."

    Savio D., Sr. IT Architect at a healthcare company, mentions, "Sauce Labs' dashboards contain multiple useful metrics in one place. Everything is represented to us visually on the dashboard, which helps us understand where to focus our attention, what the issues are, and what we need to resolve."

    PeerSpot reviewer, Rob L., Director of Quality Assurance - Shared Service at a financial services firm, writes, “The most valuable feature for us is the browser. The most critical thing is that this software aligns with our Agile and DevOps way of doing things. It integrates with kickoff scripts through DevOps.”

    What is SmartBear TestComplete?

    TestComplete is a reliable, sturdy automated testing platform created by SmartBear Software. SmartBear Software is a worldwide technological leader known for developing quality enterprise-class development and testing solutions.

    TestComplete simplifies the process of creating tests for numerous applications, including, but not limited to; Desktop, Android, IOS, Web browsers, and Windows. Application tests can be manual, scripted, and even recorded by using keyword-driven or data-driven functionality. There are even additional options for error reporting and automated playback. The object repository is extremely accurate and is fully customizable. TestComplete can easily be used by experienced developers and even by manual novice testers to develop quality automated UI tests quickly.

    TestComplete offers three different testing scenarios:

    • Desktop: Users can easily and quickly automate UI tests using today’s most popular desktop applications, such as; Windows, Java, Python,.Net, VBScript, and more.

    • Web: Users can effortlessly create renewable tests for all of today’s popular web applications, including JavaScript frameworks on 2000+ trusted browser and platform integrations.

    • Mobile: Users can safely build and automate serviceable UI tests on actual or virtual android or IOS devices, locally or in the cloud. Users can create code or codeless tests. TestComplete seamlessly integrates with many of today’s popular frameworks.

    Key Features

    • Easily create automated UI tests: TestComplete offers scriptless Record and Replay or simple keyword-driven tests to quickly develop any type of UI test users may require. Tests can be recorded once, then replayed when needed across various applications on mobile, web, or desktop environments. TestComplete integrates with many different languages, such as Java, Python, C+, and more.

    • Keyword driven tests: Users can easily divide testing steps, actions, objects, and data with an integrated keyword-driven test structure. This makes it easy for every user to participate in the test automation process; there is no programming experience needed. Everything is made simple with easy-to-use point-and-click options.

    • Data driven tests: Easily distinguish data from test commands to keep administrative efforts simple. Users can improve overall coverage by running various automated mobile, desktop, or web UI tests.

    • Record and Replay: Users can reuse created automated tests across every environment as often as desired. This helps to expand overall test coverage and represents a huge cost and time savings.

    Reviews from Real Users

    Sandhiya T S., Sr Solutions Engineer at Lexington Soft, relates, “The record and replay aspects of the solution are quite useful for people. With them, you don't have to write any scripts. Basically, you can record your actions and play them back later. The initial setup is also very easy.”

    Sai S R., Staff Test Architect at a tech services company, says, "The most valuable features of the SmartBear TestComplete are self-healing, they reduce the maintenance required. The different languages SmartBear TestComplete supports are good because some of our libraries are written in Python, JavaScript, and C#. It's very easy to put them all under one project and use them."

    Sample Customers
    Microsoft, RBS, jQuery, Expedia, Citrix, AIG
    Salesforce.com, Mozilla, Zendesk, Puppet Labs, Twitter, Bank of America, Eventbrite, Bleacher Report, Okta, Intuit, Travelocity, Sharecare, CapitalOne.
    Cisco, J.P. Morgan, Boeing, McAfee, EMC, Intuit, and Thomson Reuters.
    Top Industries
    REVIEWERS
    Computer Software Company55%
    Financial Services Firm18%
    Manufacturing Company9%
    Marketing Services Firm9%
    VISITORS READING REVIEWS
    Computer Software Company16%
    Financial Services Firm13%
    Manufacturing Company7%
    Retailer7%
    REVIEWERS
    Healthcare Company14%
    Computer Software Company10%
    Media Company10%
    Marketing Services Firm8%
    VISITORS READING REVIEWS
    Financial Services Firm17%
    Computer Software Company17%
    Insurance Company6%
    Healthcare Company6%
    REVIEWERS
    Computer Software Company32%
    Manufacturing Company13%
    Financial Services Firm10%
    Comms Service Provider6%
    VISITORS READING REVIEWS
    Computer Software Company19%
    Manufacturing Company11%
    Financial Services Firm11%
    Government7%
    Company Size
    REVIEWERS
    Small Business27%
    Midsize Enterprise27%
    Large Enterprise45%
    VISITORS READING REVIEWS
    Small Business19%
    Midsize Enterprise14%
    Large Enterprise67%
    REVIEWERS
    Small Business25%
    Midsize Enterprise20%
    Large Enterprise55%
    VISITORS READING REVIEWS
    Small Business18%
    Midsize Enterprise11%
    Large Enterprise71%
    REVIEWERS
    Small Business28%
    Midsize Enterprise28%
    Large Enterprise44%
    VISITORS READING REVIEWS
    Small Business24%
    Midsize Enterprise15%
    Large Enterprise62%
    Buyer's Guide
    Functional Testing Tools
    March 2024
    Find out what your peers are saying about Tricentis, OpenText, Perforce and others in Functional Testing Tools. Updated: March 2024.
    765,234 professionals have used our research since 2012.