Perfecto vs Sauce Labs comparison

Cancel
You must select at least 2 products to compare!
Perforce Logo
3,312 views|2,286 comparisons
88% willing to recommend
Sauce Labs Logo
4,030 views|2,976 comparisons
96% willing to recommend
Comparison Buyer's Guide
Executive Summary

We performed a comparison between Perfecto and Sauce Labs based on real PeerSpot user reviews.

Find out what your peers are saying about Tricentis, OpenText, Katalon Studio and others in Test Automation Tools.
To learn more, read our detailed Test Automation Tools Report (Updated: April 2024).
768,578 professionals have used our research since 2012.
Featured Review
Quotes From Members
We asked business professionals to review the solutions they use.
Here are some excerpts of what they said:
Pros
"In terms of cross-platform testing, they offer all of it, every device available in the market. It covers real scenarios that mimic production so that we don't miss out on any devices that our clients might be using to run the applications we develop. It's been great and very helpful.""I also like the reporting functions. We are constantly downloading these reports and sharing them with our final customers. They help us understand what kind of bugs are happening through the applications. The recording feature is handy because it lets us see a video of the process we run through the pipeline and discover the point at which the automation is breaking.""The CI dashboard tool is very good, as is the Live Stream monitoring. Whenever I want to monitor execution, I can open multiple tabs in Perfecto and it is easy for me to refer to the CI dashboard and the Live Stream.""The number one feature, which if we didn't have out-of-the-box would be missed, is the fact that we have video execution. That gives us the ability to view errors or defects in the progression, from beginning to the end of the video.""It creates a faster production cycle and is quick to market. Things get deployed earlier because the testing happens on time. We can do a lot of panelization, so a lot of test phases can happen in a panel. People don't have to wait for a device to come to them. They can access multiple devices at the same time and do testing at the same time.""We're working in Agile and we need results ASAP. The fact that the lab provides same-day access to new devices is extremely important to us.""One of the good things about Perfecto is the scalability that it provides.""The quality of our software has improved since we implemented this solution."

More Perfecto Pros →

"Sauce Labs provides us with more combinations to test, so we can keep adding platforms and devices to our network. That's been a very seamless experience. Let's say there's an iOS or a private device we need. Sauce Labs has helped get all those set up when needed.""The most valuable feature is cross-browser, cross-OS, cross-mobile device testing.""They offer a large number of devices and browser/operating system combinations for real device tests""One of the most valuable features is that we do not have to have the cross-platform testing vehicles in-house. Sauce Labs gives us the ability to test across platforms and that really helps give us confidence in our products.""Since this is an all-in-one testing site, we are able to take advantage of the browser OS combinations, mobile emulators and simulators, and real mobile devices. This is important to us since we have a variety of users, browsers, OS, etc.""The insights section provides a great overall state of the automation suite and can identify trends relatively quickly. If we see a dip in our passing rate over time, we can look at what changed when the test started failing to find the root cause rather than doing a quick fix to find that the test fails a short time later.""Allows us to do JIRA Cloud and BambooHR Integration.""It provides a comprehensive selection of browsers and platform versions for our test automations and CI/CD pipeline process. It also provides a comprehensive set of virtual mobile devices, which we can configure for our automation and availability. These features are valuable for us when it comes to testing our applications. We have a website and mobile applications that we want to test and diversify to various browsers and mobile devices as well as restore various versions. This helps us to find bugs that users might be facing and correct them."

More Sauce Labs Pros →

Cons
"We don't use Perforce's BlazeMeter with Perfecto. From my perspective, it's not really relevant.""When using devices on the cloud, it lags quite a bit at times. I know that these are real devices that are being projected on our laptop screens and monitors, but if the speed could be improved, that would be good.""Previously, we used the cradle. Every time the mobile was blocking it, we would have to ask Perfecto to provide another one. That took a lot of time away from us.""There could be some improvements done on the interface. At times, there has been a bit of a struggle when finding things on the interface. A UI revamp would be a better option in future. That UI hasn't changed much in a long time, so I think they could just make it a bit better so that people could find stuff easily and intuitively.""One improvement would be speed of execution. If it is an iOS native app, we have noticed that the speed is a bit slower. Perfecto might need to make some improvements in this area.""There was a discussion about having the capability to export the test results to a certain tool that we use in our project. If that were added it would be great not having to manually take screenshots, put them in a document, and share them on the different test management tools.""If we could run an accessibility test in Perfecto against builds, it would help us a lot. Currently, that's a very manual process for us. We haven't found a tool that can do accessibility scans for iOS and doesn't depend on engineering effort. Having a feature related to that would be really awesome for us.""We feel that Perfecto is a little slow. If they could improve on that slowness in accessing the app, when we want to click a button, that would be great because we feel the difference. An improvement in the connectivity speed is required."

More Perfecto Cons →

"Better and programmatic controls on request/response recordings and sharing with developers.""I would like for there to be more detail in regards to the quality of our code i.e. how many failures occurred, how many passed based on industry standard metrics, etc.""Multi-domain SSO is a big concern for us right now, especially as we've been merged into a larger company. I suddenly have teams coming from 20 different domains, and because the main master Sauce Labs account is locked down to one SSO domain, there are teams that can't run a test right now. I've heard they're working on a solution and they've been very communicative with us about it. A solution to that would help us a lot.""Sauce Labs has room for improvement with its price point. Using a real mobile device, and having that dedicated to your team, costs more than actually purchasing a mobile device. We haven't tried the real devices yet. This is because of their price point.""We have had some issues with the Sauce Connect Proxy on our Jenkins servers failing to start, which makes the optimal CI/CD pipeline come to a halt.""Integration with Github, as well as several other similar tools, could be improved.""Overall, I think Sauce Labs provides us with a valuable tool and resource. As far as what could be improved, I would say the overall test execution time. Some of the calls take a bit longer than I expect, for example in web browser tests; while the execution time isn't obnoxious, it could be improved so that overall tests/test suites finish faster.""Latency, due to Sauce Labs being a cloud-based solution, has been a concern. We work in different continents and countries, but last time I checked, Sauce Labs was only offering two data centers, one in the EU and another in the US. If you're not in either of those two places, you would have latency and issues running your test cases."

More Sauce Labs Cons →

Pricing and Cost Advice
  • "This is an expensive solution compared to others, by 30% to 40%."
  • "I am not sure about its pricing, but from our perspective, licensing has been easy. Anytime I have new users or requests for users that want to get added, it's a very simple process. I just give the architectural owner of the product the name and email address, and they're able to easily add a new user. We don't have any issues in regards to getting licenses, but I don't have any insights into pricing."
  • "Pricing is an area where Perfecto can do a little better. When we obtain additional licenses, we enter into negotiations with them."
  • "Although Perfecto is a good product for us to use, it is a bit expensive. It takes management a bit of work to find the appropriate funding for us to keep Perfecto. I imagine there could be some way to make it more accessible."
  • "Perfecto is about 30-40% cheaper than Device Anywhere. That was a big reason why we switched. Perfecto also solves some of the issues that we had with Device Anywhere. We have grown by 100% since we started to use Perfecto, and now we have devices roaming. When we look at the competition, we would still stick with Perfecto."
  • "Pricing-wise, it is fine. It is not as expensive as what we used to have in the past from HP, IBM, and others. It is decently priced."
  • "It's definitely on the higher end of prices for this type of service."
  • "Perfecto has definitely saved us on the costs and efforts of having to maintain our own virtual test environment. We lost about 20 devices in the past to maintenance and audit. That was a massive loss for us, as a company, because we were giving devices to someone, but don't know whether we would get it back or not. Having those virtual labs, we don't need to worry about these kinds of things. We are easily saving $5,000 to $10,000 a month on device costing."
  • More Perfecto Pricing and Cost Advice →

  • "We have an enterprise account; it has worked great for our needs."
  • "Try the free trial and work with a Sauce Labs representative to see what package works best for your application(s)."
  • "It could be less like pay-per-use with a lower rate."
  • "Go ahead please. Try it at a smaller scale."
  • "Trial the product and see if it suits your needs."
  • "When you reach the Enterprise licensing tier, base level being with 10 concurrent test sessions, pricing is essentially per-unit-of-concurrency thereafter with a relatively linear increase and not much benefit for "bulk"."
  • "Compared with other services, Sauce Labs is a bit expensive."
  • "​Now that we have an enterprise license, we no longer have to worry about minutes each month!​"
  • More Sauce Labs Pricing and Cost Advice →

    report
    Use our free recommendation engine to learn which Test Automation Tools solutions are best for your needs.
    768,578 professionals have used our research since 2012.
    Questions from the Community
    Top Answer:Mobile testing is the most valuable feature as it has reduced dependency on physical devices. We are located offshore and we don't have the physical devices, and shipping physical devices after every… more »
    Top Answer:Perfecto's price is excellent compared to other products with similar features. It was the lowest of the three we evaluated. We also established a partnership with Perfecto, so they provide discounts… more »
    Top Answer:It is slow compared to physical device testing. The interactive speed could be improved. And sometimes we have issues with our app not working properly with Perfecto. Even though it is working… more »
    Top Answer:The solution they provide is very robust. We can quickly connect to their environment with the hub URL. They have a URL that has the entire grid of desktops, web browsers, and mobile devices. They… more »
    Top Answer:With the desktop browser, we can inspect any screen with the web developer option, but they should provide something for mobiles so that we can quickly inspect elements on the device. To write the… more »
    Top Answer:We use it for automated testing. For our company, we do web testing automation. We run our test suites containing Java-based scripts and automate the entire mobile or web application. We've 500 to 600… more »
    Ranking
    4th
    Views
    3,312
    Comparisons
    2,286
    Reviews
    18
    Average Words per Review
    1,397
    Rating
    8.6
    13th
    Views
    4,030
    Comparisons
    2,976
    Reviews
    1
    Average Words per Review
    2,324
    Rating
    6.0
    Comparisons
    BrowserStack logo
    Compared 35% of the time.
    Appium logo
    Compared 10% of the time.
    AWS Device Farm logo
    Compared 6% of the time.
    Katalon Studio logo
    Compared 3% of the time.
    HeadSpin logo
    Compared 3% of the time.
    BrowserStack logo
    Compared 37% of the time.
    LambdaTest logo
    Compared 13% of the time.
    OpenText UFT One logo
    Compared 2% of the time.
    Katalon Studio logo
    Compared 2% of the time.
    Bitbar logo
    Compared 2% of the time.
    Also Known As
    Perfecto Mobile, Perfecto Web
    Learn More
    Overview

    Perfecto is a cloud-based mobile app testing tool that is designed to help test applications on different operating systems and devices. The solution lets users automate processes related to advanced test scenarios and access browser versions and devices according to individual requirements. With Perfecto’s smart test execution capabilities, teams can manage testing across web and mobile platforms using a single script, conduct parallel testing for large test suites, and design advanced user-based test scenarios to accelerate app release cycles. The solution is also helpful for IT departments, providing insights into biometrics, device vitals, audio injection, network throttling, packet loss, and rotation data to meet desired end-user conditions that align with business priorities.

    Perfecto Features

    Perfecto has many valuable key features. Some of the most useful ones include:

    • Live Stream analysis
    • Reporting/analytics
    • Activity dashboard
    • Action-word testing
    • Bug tracking
    • Debugging
    • BDD & codeless automation
    • Model-based testing
    • Real-time monitoring
    • Role-based permissions
    • User management
    • Test failure analysis
    • Real user simulation

    Perfecto Benefits

    There are many benefits to implementing Perfecto. Some of the biggest advantages the solution offers include:

    • Streamlined test creation: When you use Perfecto, test creation is easy for your teams. Testing frameworks, like Appium, allows you to scale automated test scripts without any issues.
    • Scalable test execution: Perfecto enables you to accelerate your mobile app testing and is elastically-scaled with no single point of failure, so you can get the testing cadence you need. In addition, the solution makes it possible for you to execute tests from within IDEs as well as through CI servers like Jenkins.
    • Superior application quality for mobile: By using Perfecto, you can maximize continuous testing and shift quality by combining the solution with BlazeMeter. Together, these two solutions can help you measure mobile user experience, produce high-quality test data on demand, and create realistic mock services.
    • AI-driven test automation dashboards: The solution’s unique dashboards and heatmaps give you high-level visibility with timelines and trends.
    • Cloud-based lab: Perfecto’s Smart Testing Lab gives you the tools you need to quickly test your mobile app against thousands of permutations.

    Reviews from Real Users

    Perfecto is a solution that stands out when compared to many of its competitors. Some of its major advantages are that it has fantastic testing, reporting, and automation capabilities.

    Roland C., QA Lead at BMO Financial, says, “The most valuable would be their Live Stream analysis, where I can see the live analysis of all the executions on a single device or multiple devices as well as track them. The live analysis and reporting would be the single most valuable feature.”

    Andy B., Systems Engineer at a financial services firm, writes, “I really love the interaction it has with mobile devices, the testing capabilities, as well as reporting capabilities that we get from the application. Perfecto is excellent when it comes to executing cross-platform testing.”

    A Director, QE Automation & Analytics at a financial services firm, says, “The most valuable feature is cloud-based automation and testing.”

    Another PeerSpot reviewer, Kristina B., Product Manager at a manufacturing company, states, “The solution allows us to do seamless cross-platform testing, saves time, and comes with excellent customer service.”

    Sauce Labs is a functional testing tool that ensures your apps and websites work flawlessly on every browser, OS, and device. The solution allows you to automate functional testing on multiple operating systems and browsers, emulating the way that a user would use the website. With Sauce Labs, you can also run tests on various operating system and browser combinations in parallel, reducing the amount of time to get results. The Sauce Labs solution provides enterprise-grade security, scalability, and reliability.

    Sauce Labs Features

    Sauce Labs has many valuable key features. Some of the most useful ones include:

    • Automated cross-browser testing
    • Mobile testing
    • Secure tunneling protocol
    • Usage reporting
    • Enterprise security
    • Provisioning
    • Centralized user account management
    • Access controls
    • Support for Selenium, Appium, and JUnit Testing

    Sauce Labs Benefits

    There are many benefits to implementing Sauce Labs. Some of the biggest advantages the solution offers include:

    • Speed up development time: The solution makes it possible for you to test web and mobile apps in parallel and accelerate your testing time by up to 10x or more. Using Sauce Labs, you can increase developer productivity because your teams will be able to spend less time with test maintenance and debug faster.
    • No worrying about infrastructure: With Sauce Labs, you don’t have to buy or maintain more servers or mobile devices. You also don’t need to worry about updating browsers or VM licenses. Sauce Labs allows you to easily scale your tests with parallelization to speed up test cycles and boost capacity on their reliable cloud.
    • Run tests securely: The solution enables you to securely run your scripts and access your data and files from behind your firewall. Sauce Labs generates single-use VMs for every test and destroys them immediately afterwards so your data always remains secure.
    • Easy integration for your CI systems: Sauce Labs automated testing platform integrates with Jenkins, Bamboo, Microsoft VSTS, and others so you can test as fast as you develop. In addition, you can share results instantly by using the solution’s simple plugins.

    Reviews from Real Users

    Sauce Labs is a solution that stands out when compared to many of its competitors. It has valuable features that include error logging, helpful dashboards, and its browser.

    Joel A., Product Manager - Data & APIs at a marketing services firm, says, "The error logging is very robust. If we run a test through Sauce Labs and there's some sort of issue, a log will appear on the screen. Log messages are usually heinous and horrible... Sauce Labs is incredibly good at saying things like, 'Hey, here is the exact issue. Fix this and you can run the test.' That helps in getting things up and running and executing the way they should."

    Savio D., Sr. IT Architect at a healthcare company, mentions, "Sauce Labs' dashboards contain multiple useful metrics in one place. Everything is represented to us visually on the dashboard, which helps us understand where to focus our attention, what the issues are, and what we need to resolve."

    PeerSpot reviewer, Rob L., Director of Quality Assurance - Shared Service at a financial services firm, writes, “The most valuable feature for us is the browser. The most critical thing is that this software aligns with our Agile and DevOps way of doing things. It integrates with kickoff scripts through DevOps.”

    Sample Customers
    Virgin Media, Paychex, Rabobank, R+V, Discover
    Salesforce.com, Mozilla, Zendesk, Puppet Labs, Twitter, Bank of America, Eventbrite, Bleacher Report, Okta, Intuit, Travelocity, Sharecare, CapitalOne.
    Top Industries
    REVIEWERS
    Financial Services Firm44%
    Insurance Company11%
    Comms Service Provider11%
    Computer Software Company11%
    VISITORS READING REVIEWS
    Financial Services Firm18%
    Computer Software Company17%
    Manufacturing Company8%
    Recreational Facilities/Services Company7%
    REVIEWERS
    Healthcare Company14%
    Computer Software Company11%
    Media Company9%
    Marketing Services Firm8%
    VISITORS READING REVIEWS
    Financial Services Firm17%
    Computer Software Company17%
    Healthcare Company6%
    Retailer6%
    Company Size
    REVIEWERS
    Small Business4%
    Midsize Enterprise4%
    Large Enterprise92%
    VISITORS READING REVIEWS
    Small Business21%
    Midsize Enterprise12%
    Large Enterprise67%
    REVIEWERS
    Small Business25%
    Midsize Enterprise20%
    Large Enterprise55%
    VISITORS READING REVIEWS
    Small Business18%
    Midsize Enterprise10%
    Large Enterprise71%
    Buyer's Guide
    Test Automation Tools
    April 2024
    Find out what your peers are saying about Tricentis, OpenText, Katalon Studio and others in Test Automation Tools. Updated: April 2024.
    768,578 professionals have used our research since 2012.

    Perfecto is ranked 4th in Test Automation Tools with 23 reviews while Sauce Labs is ranked 13th in Test Automation Tools with 112 reviews. Perfecto is rated 8.4, while Sauce Labs is rated 8.8. The top reviewer of Perfecto writes "Its reporting allows us to have a clear view regarding what tests have been executed". On the other hand, the top reviewer of Sauce Labs writes "Robust documentation, helpful support representative, good licensing model". Perfecto is most compared with BrowserStack, Appium, AWS Device Farm, Katalon Studio and HeadSpin, whereas Sauce Labs is most compared with BrowserStack, LambdaTest, OpenText UFT One, Katalon Studio and Bitbar.

    See our list of best Test Automation Tools vendors and best Functional Testing Tools vendors.

    We monitor all Test Automation Tools reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.