Sauce Labs Scalability

RL
Director of Quality Assurance - Shared Service at a financial services firm with 10,001+ employees

We have about 12 business units that use the service.

Scalability is good on the public Cloud. You've got all of the different devices and most of the operating systems, including beta. It's all that we can ask for in that respect.

The browsers are pretty straightforward. They usually deploy any new versions within 48 hours of the operating systems for the browser side.

We have a thousand registered users and their roles are a combination of traditional QA testers and developers. To support them, we have a small team that I call admin support. There are only a couple of us on my team and if there are any issues, we centralize that before deciding if we need to open a ticket up to the Sauce Labs support center.

Our small admin team works very well. Two people are sufficient to handle the training, education, and any configuration changes. In our company, one of them is the lead over all of the different tools and we license from different vendors. This person is a little bit more technical when it comes to the Sauce Labs configuration setup. The second is an admin for the end-users, teaching them how to use the tool appropriately. This person is also responsible for guiding end-users on how to test applications properly.

View full review »
Savio De Souza - PeerSpot reviewer
Sr. IT Architect at a healthcare company with 10,001+ employees

Sauce Labs is fully automated, so it scales well. When we initially talked about how many tests we would need, we underestimated how many seats and licenses to buy. We went back to Sauce Labs, and they provided us with additional metrics on how we need to grow. We purchased additional licenses so that we can scale accordingly.

View full review »
BL
Application Engineer at Discover Financial Services

We have no complaints about its scalability. We're able to scale to 100-plus devices, and I'm sure Sauce could provision 200 or 300 in the future. I don't see any issue.

At this point, we have about 40 people working with the solution, and they're primarily application engineers and quality assurance people.

View full review »
Buyer's Guide
Sauce Labs
March 2024
Learn what your peers think about Sauce Labs. Get advice and tips from experienced pros sharing their opinions. Updated: March 2024.
765,386 professionals have used our research since 2012.
MR
Lead Consultant at a tech services company with 10,001+ employees

It scaled well for our needs. We utilized 10 parallel instances, but they provided us with 15. If you keep on scaling it on a larger scale, the application that you're trying to automate should also support that, but it's scalable.

We are a team of 60, and 20 of us are using this solution. All of us are from the QA team. We provide the service, and we utilize this tool to make sure that everything is running fine. We ensure that every product that we get from developers is properly working, and once we certify that it's working fine, we move it to production for the developers to do their job.

View full review »
CC
Software Developer Engineer in Test at a retailer with 5,001-10,000 employees

Scalability is connected to the pricing. The solution is scalable if you have the money to scale. It's based on what they call concurrency units, and they can get expensive.

We have about a dozen users of the solution. They are mostly involved in test automation, SDET.

View full review »
SC
Vice President of IT QA at a financial services firm with 5,001-10,000 employees

Sauce Labs' scalability is good. It's possible for us to scale higher, so I don't foresee any issues with that.

View full review »
AM
Engineer at a pharma/biotech company with 10,001+ employees

So far, scalability has been great for what we need. It is hard to tell its true scalability since we are only running 25 VMs concurrently.

There is definitely room for growth. Across all our separate divisions, people are realizing that automated testing is a major opportunity for improvement. As these individual groups continue to learn from each other and ramp up their own use of automated testing in solutions like Sauce Labs, that will really drive our growth.

View full review »
AD
Senior Manager - Software QA at a hospitality company with 10,001+ employees

It has been pretty scalable. We are looking at increasing some of its concurrency capacity.

We are currently using about 40 to 50 current VMS.

One part-time resource is primarily needed to design the user groups where jobs will be run. Initially, we had all of our jobs run under a single user name, but then we decided to segregate that and divide it up amongst the teams. So, one part-time resource is needed just to analyze and manage how your jobs get run, then analyze the trends after that.

View full review »
JM
Automation Architect at a hospitality company with 10,001+ employees

The scalability is connected to our budget. The virtual machine concurrencies that we have are not great for our demand. I am talking with management about increasing the budget for 10 or 20 more virtual machines. But Sauce Labs itself provides the opportunity to scale very easily. For us, it's just a matter of budget.

View full review »
SB
Senior Quality Assurance Manager at a financial services firm with 1,001-5,000 employees

We have about 60 products and only three or four are using it. We have started getting other team members' products to use and integrate Sauce Labs in their test automation, though I am 100% sure of what every single product is doing.

View full review »
Nitu Singh - PeerSpot reviewer
Test Automation Snr. Consultant at a insurance company with 5,001-10,000 employees

With scalability, they are going in the right direction. I have attended some of their new product webinars on API testing, and I really found that to be cool. We may use it, or evaluate it at least, once we start going into that direction. That goes for visual testing as well. If they are able to deliver on some of their promises I really look forward to that and seeing how we can utilize them.

We could use Sauce Labs even more. While we are using it in our testing teams we are not yet there for things like API testing and visual regression.

Our next step, in terms of our exploration of the solution and how we want to use it as part of the CI/CD, is that we are moving into GitHub Actions. We were using Jenkins and it worked well with that. We are moving to GitHub Actions and trying to figure out how that will work.

View full review »
AP
LMTS, Software Engineering at Salesforce

I think Sauce Labs has proven that their platform is pretty scalable because they give us a broad selection of versions available for iOS and Android. They also support their emulators with good virtual machines, so Sauce Labs can scale their infrastructure to their customers' needs quite well.

I don't know exactly how many users are currently working with Sauce Labs in my company, but it's in the hundreds. We'll certainly expand usage in the future because we're planning to offer new kinds of mobile apps, and when those come out, we'll need to test them using Sauce Labs. As the number of products we offer increases, the usage will too. We use it for nearly all of our functional testing.

View full review »
AP
IT Analyst at a manufacturing company with 10,001+ employees

It is definitely scalable.

Mostly, our team consists of 15 people who run tests automation and test manually. We have other teams as well who have access to Sauce Labs, and they test certain applications in Sauce Labs. We guide them on how to use it. So, there are around 25 to 30 people who probably use it quite often.

We use it to do at least 10 test automation runs every day. We do have plans to increase our usage in the future.

View full review »
Andy Antes - PeerSpot reviewer
Senior Software Engineer at a computer software company with 10,001+ employees

This product is not super scalable, because you have a very specific number of VMs that you can use. If there was a pay-as-you-use-it model, I think that would really increase the scalability of the solution, but right now Sauce Labs is a bottleneck because you have a specified number of VMs.

We use, on average, 75 of their VMs per hour. Optimally, we're using as much of the VMs as we pay for. As such, the goal is to have our tests running often enough to maximize that usage.

I can't speak to how widespread this product is used in the company, although in my team, there are 10 of us using it. My team is serving between 30 and 40 quality assurance engineers. Other teams in the company are also using it.

View full review »
OB
Software Engineering Manager at a healthcare company with 10,001+ employees

As told by our rep, this is a fairly scalable solution.

View full review »
PB
Tech Lead at a pharma/biotech company with 10,001+ employees

We have purchased a consistent amount of licenses over the years, and we are looking to grow with a focus on automated testing this year.

View full review »
HR
Head of Automation R&D at Applause

One of Sauce Labs' competitors does not force you to select the data center you want to run against. They just figure out which data center is closest to where you are executing your test scripts from. They offer a single, unified endpoint or URLs when it comes to automation and handle everything else internally. When we're writing automation scripts, we don't need to specify, "I want to run on the European data center," or "I want to run on the American data center." We can just say, "I want to run a test case," and depending on the location you come from, the platform is smart enough to direct it to the nearest data center to reduce latency.

This may not be directly related to scalability, but this kind of capability would make it easier for us to build our SDKs faster and focus on other features, which in return would allow us to scale faster as a company. The learning curve for newcomers would also be easier, because they wouldn't need to worry about figuring out which data center to run against.

While I love the fact that we can specify the data center ourselves, because it gives us more freedom, I would love to see more data centers in different places around the world, to reduce latency, and the selection of the data center implicitly done by the platform, so we don't need to worry about it.

View full review »
reviewer1398594 - PeerSpot reviewer
Senior Software Development Engineer in Test at Autodesk, Inc.

The performance is great, we never had any slowness or trouble with running our tests.

View full review »
it_user740730 - PeerSpot reviewer
Works at a insurance company with 5,001-10,000 employees
reviewer1396422 - PeerSpot reviewer
Senior QA Automation Engineer at Bleacher Report

Very good, you can add Vs if necessary.

View full review »
it_user568584 - PeerSpot reviewer
Intern - Technology Development Program at a healthcare company with 10,001+ employees
it_user174312 - PeerSpot reviewer
QA Director at Bridgetree
it_user479826 - PeerSpot reviewer
Lead Test Automation Engineer at RevContent

We did not encounter any issues with scalability. I personally wished that we had a budget to get more parallel executions but the cost was not justifiable.

View full review »
reviewer1394535 - PeerSpot reviewer
Lead Quality Analyst at Derivco

Very good as it has the ability to appeal to a lot of users despite some lagful moments.

View full review »
it_user824424 - PeerSpot reviewer
Lead Software Test Automation Engineer at a tech vendor

The only issue is cost. Each new unit of concurrency you add to your enterprise license represents a relatively linear increase in cost.

View full review »
it_user762057 - PeerSpot reviewer
Health Systems QA Automation Engineer (SDET) at a healthcare company with 10,001+ employees
it_user180798 - PeerSpot reviewer
QA Manager at a tech company with 501-1,000 employees

At times, the brief outages or slow service responses have temporarily hampered our fairly large (in terms of concurrency) test-automation runs, but that's not very often.

View full review »
it_user174360 - PeerSpot reviewer
Sr. QA Automation Engineer with 51-200 employees

Very good, highly scalable product.

View full review »
it_user663543 - PeerSpot reviewer
Sr. Performance Test Engineer at a tech services company with 201-500 employees

We have not encountered any scalability issues. SauceCloud handles all of this for us!

View full review »
it_user661047 - PeerSpot reviewer
Test Engineer II at a tech services company with 201-500 employees

We haven't had any scalability issues so far. We have built a fairly scalable automated framework to handle expansion.

View full review »
it_user208599 - PeerSpot reviewer
Software Development Engineer at a computer software company with 501-1,000 employees

Yes, the parallelization is not possible now when cucumber and junit are used together.

View full review »
it_user733761 - PeerSpot reviewer
Software Tester at a transportation company with 10,001+ employees
it_user285555 - PeerSpot reviewer
Software Developer Trainee at a tech services company with 10,001+ employees

No. The most famous selenium integration is enough to show off your scalability.

View full review »
it_user275085 - PeerSpot reviewer
Senior Test Lead at a tech company with 10,001+ employees
it_user770031 - PeerSpot reviewer
Software Development Engineer at a computer software company with 201-500 employees

No scalability issues.

View full review »
it_user577092 - PeerSpot reviewer
QA Engineer at a retailer with 51-200 employees
it_user405354 - PeerSpot reviewer
Quality Assurance Engineer at a tech services company with 501-1,000 employees

We haven’t had any problems that we couldn’t work around, or there wasn’t any documentation on. The only problem is that hit that point where it’s unfeasible to expand our UI testing framework as the cost to run a shed load of tests is too much for our business.

View full review »
it_user251007 - PeerSpot reviewer
Business Owner at a wellness & fitness company with 51-200 employees
it_user764325 - PeerSpot reviewer
QA Manager at a tech services company with 5,001-10,000 employees
it_user748629 - PeerSpot reviewer
Test Engineer at a media company with 501-1,000 employees

If too many tests are run in parallel using Sauce Connect, sometimes the tests time out. So we had to limit the number of parallel executions.

View full review »
it_user693618 - PeerSpot reviewer
Lead Automation Engineer at a wellness & fitness company with 51-200 employees

Early on we had some difficulity with parallelizing large runs, but they were resolved.

View full review »
it_user568509 - PeerSpot reviewer
Technology Development Program Intern at a healthcare company with 10,001+ employees

Our application is relatively small so no

View full review »
it_user359028 - PeerSpot reviewer
Software Engineer at a tech services company with 51-200 employees

No issues with scalability.

View full review »
it_user356097 - PeerSpot reviewer
Test Automation Engineer at a tech services company with 51-200 employees

No issue with scalability.

View full review »
it_user215688 - PeerSpot reviewer
Consultant at a tech vendor with 1,001-5,000 employees

No issues encountered.

View full review »
reviewer1396425 - PeerSpot reviewer
Senior Automation Engineer / Senior SDET at Setel

Scalability is very good.

View full review »
it_user765375 - PeerSpot reviewer
Team Lead at a retailer with 5,001-10,000 employees
it_user702426 - PeerSpot reviewer
Snr Recruiter at a tech company with 51-200 employees

There were no scalability issues.

View full review »
it_user715854 - PeerSpot reviewer
Team Lead/Manager at a media company with 501-1,000 employees
it_user408771 - PeerSpot reviewer
Google Partner at a tech company with 10,001+ employees

We haven't had any issues with scalability.

View full review »
it_user759027 - PeerSpot reviewer
Quality Engineer at a tech services company with 10,001+ employees
it_user761610 - PeerSpot reviewer
Software Engineer at a consultancy with 1,001-5,000 employees
it_user380931 - PeerSpot reviewer
Art Director at a marketing services firm

Scaled for our needs.

View full review »
it_user765846 - PeerSpot reviewer
Quality Assurance at a tech company with 10,001+ employees
it_user762525 - PeerSpot reviewer
Team Lead at a tech vendor with 1,001-5,000 employees
it_user755598 - PeerSpot reviewer
Test Analyst at a tech services company with 10,001+ employees
it_user740562 - PeerSpot reviewer
Software Tester at a comms service provider with 10,001+ employees
it_user708351 - PeerSpot reviewer
QA Engineer at a tech services company
it_user738291 - PeerSpot reviewer
QA Engineer at a financial services firm
it_user708351 - PeerSpot reviewer
QA Engineer at a tech services company
it_user708351 - PeerSpot reviewer
QA Engineer at a tech services company

No issues with scalability.

View full review »
it_user738285 - PeerSpot reviewer
-- at a tech company with 51-200 employees
it_user821070 - PeerSpot reviewer
MTS at a tech services company with 10,001+ employees
it_user708351 - PeerSpot reviewer
QA Engineer at a tech services company

There were no scalability issues.

View full review »
it_user692865 - PeerSpot reviewer
Software Test Engineer at a media company with 501-1,000 employees
it_user771228 - PeerSpot reviewer
Software Engineer at a tech vendor with 1,001-5,000 employees

Scaling options are available for purchase, but scaling by improving and streamlining our processes has been the best approach.

View full review »
it_user569226 - PeerSpot reviewer
Senior Software Engineer in Test at a media company with 501-1,000 employees
it_user718533 - PeerSpot reviewer
Works at a tech company with 51-200 employees
Buyer's Guide
Sauce Labs
March 2024
Learn what your peers think about Sauce Labs. Get advice and tips from experienced pros sharing their opinions. Updated: March 2024.
765,386 professionals have used our research since 2012.