Sauce Labs Scalability
RL
Rob Larsen
Director of Quality Assurance - Shared Service at a financial services firm with 10,001+ employees
We have about 12 business units that use the service.
Scalability is good on the public Cloud. You've got all of the different devices and most of the operating systems, including beta. It's all that we can ask for in that respect.
The browsers are pretty straightforward. They usually deploy any new versions within 48 hours of the operating systems for the browser side.
We have a thousand registered users and their roles are a combination of traditional QA testers and developers. To support them, we have a small team that I call admin support. There are only a couple of us on my team and if there are any issues, we centralize that before deciding if we need to open a ticket up to the Sauce Labs support center.
Our small admin team works very well. Two people are sufficient to handle the training, education, and any configuration changes. In our company, one of them is the lead over all of the different tools and we license from different vendors. This person is a little bit more technical when it comes to the Sauce Labs configuration setup. The second is an admin for the end-users, teaching them how to use the tool appropriately. This person is also responsible for guiding end-users on how to test applications properly.
Sauce Labs is fully automated, so it scales well. When we initially talked about how many tests we would need, we underestimated how many seats and licenses to buy. We went back to Sauce Labs, and they provided us with additional metrics on how we need to grow. We purchased additional licenses so that we can scale accordingly.
View full review »BL
Ben Lane
Application Engineer at Discover Financial Services
We have no complaints about its scalability. We're able to scale to 100-plus devices, and I'm sure Sauce could provision 200 or 300 in the future. I don't see any issue.
At this point, we have about 40 people working with the solution, and they're primarily application engineers and quality assurance people.
View full review »Buyer's Guide
Sauce Labs
March 2024
Learn what your peers think about Sauce Labs. Get advice and tips from experienced pros sharing their opinions. Updated: March 2024.
765,386 professionals have used our research since 2012.
MR
Mohit Rathi
Lead Consultant at a tech services company with 10,001+ employees
It scaled well for our needs. We utilized 10 parallel instances, but they provided us with 15. If you keep on scaling it on a larger scale, the application that you're trying to automate should also support that, but it's scalable.
We are a team of 60, and 20 of us are using this solution. All of us are from the QA team. We provide the service, and we utilize this tool to make sure that everything is running fine. We ensure that every product that we get from developers is properly working, and once we certify that it's working fine, we move it to production for the developers to do their job.
View full review »CC
Chris Cha
Software Developer Engineer in Test at a retailer with 5,001-10,000 employees
Scalability is connected to the pricing. The solution is scalable if you have the money to scale. It's based on what they call concurrency units, and they can get expensive.
We have about a dozen users of the solution. They are mostly involved in test automation, SDET.
View full review »SC
reviewer1797372
Vice President of IT QA at a financial services firm with 5,001-10,000 employees
Sauce Labs' scalability is good. It's possible for us to scale higher, so I don't foresee any issues with that.
View full review »AM
reviewer1774524
Engineer at a pharma/biotech company with 10,001+ employees
So far, scalability has been great for what we need. It is hard to tell its true scalability since we are only running 25 VMs concurrently.
There is definitely room for growth. Across all our separate divisions, people are realizing that automated testing is a major opportunity for improvement. As these individual groups continue to learn from each other and ramp up their own use of automated testing in solutions like Sauce Labs, that will really drive our growth.
View full review »AD
reviewer1753101
Senior Manager - Software QA at a hospitality company with 10,001+ employees
It has been pretty scalable. We are looking at increasing some of its concurrency capacity.
We are currently using about 40 to 50 current VMS.
One part-time resource is primarily needed to design the user groups where jobs will be run. Initially, we had all of our jobs run under a single user name, but then we decided to segregate that and divide it up amongst the teams. So, one part-time resource is needed just to analyze and manage how your jobs get run, then analyze the trends after that.
View full review »JM
JoseMorales2
Automation Architect at a hospitality company with 10,001+ employees
The scalability is connected to our budget. The virtual machine concurrencies that we have are not great for our demand. I am talking with management about increasing the budget for 10 or 20 more virtual machines. But Sauce Labs itself provides the opportunity to scale very easily. For us, it's just a matter of budget.
View full review »SB
Sarah Barefoot
Senior Quality Assurance Manager at a financial services firm with 1,001-5,000 employees
We have about 60 products and only three or four are using it. We have started getting other team members' products to use and integrate Sauce Labs in their test automation, though I am 100% sure of what every single product is doing.
View full review »With scalability, they are going in the right direction. I have attended some of their new product webinars on API testing, and I really found that to be cool. We may use it, or evaluate it at least, once we start going into that direction. That goes for visual testing as well. If they are able to deliver on some of their promises I really look forward to that and seeing how we can utilize them.
We could use Sauce Labs even more. While we are using it in our testing teams we are not yet there for things like API testing and visual regression.
Our next step, in terms of our exploration of the solution and how we want to use it as part of the CI/CD, is that we are moving into GitHub Actions. We were using Jenkins and it worked well with that. We are moving to GitHub Actions and trying to figure out how that will work.
View full review »AP
reviewer1775700
LMTS, Software Engineering at Salesforce
I think Sauce Labs has proven that their platform is pretty scalable because they give us a broad selection of versions available for iOS and Android. They also support their emulators with good virtual machines, so Sauce Labs can scale their infrastructure to their customers' needs quite well.
I don't know exactly how many users are currently working with Sauce Labs in my company, but it's in the hundreds. We'll certainly expand usage in the future because we're planning to offer new kinds of mobile apps, and when those come out, we'll need to test them using Sauce Labs. As the number of products we offer increases, the usage will too. We use it for nearly all of our functional testing.
View full review »AP
reviewer1776888
IT Analyst at a manufacturing company with 10,001+ employees
It is definitely scalable.
Mostly, our team consists of 15 people who run tests automation and test manually. We have other teams as well who have access to Sauce Labs, and they test certain applications in Sauce Labs. We guide them on how to use it. So, there are around 25 to 30 people who probably use it quite often.
We use it to do at least 10 test automation runs every day. We do have plans to increase our usage in the future.
View full review »This product is not super scalable, because you have a very specific number of VMs that you can use. If there was a pay-as-you-use-it model, I think that would really increase the scalability of the solution, but right now Sauce Labs is a bottleneck because you have a specified number of VMs.
We use, on average, 75 of their VMs per hour. Optimally, we're using as much of the VMs as we pay for. As such, the goal is to have our tests running often enough to maximize that usage.
I can't speak to how widespread this product is used in the company, although in my team, there are 10 of us using it. My team is serving between 30 and 40 quality assurance engineers. Other teams in the company are also using it.
View full review »OB
reviewer1775046
Software Engineering Manager at a healthcare company with 10,001+ employees
As told by our rep, this is a fairly scalable solution.
View full review »PB
reviewer1768809
Tech Lead at a pharma/biotech company with 10,001+ employees
We have purchased a consistent amount of licenses over the years, and we are looking to grow with a focus on automated testing this year.
View full review »HR
Hassan Radi
Head of Automation R&D at Applause
One of Sauce Labs' competitors does not force you to select the data center you want to run against. They just figure out which data center is closest to where you are executing your test scripts from. They offer a single, unified endpoint or URLs when it comes to automation and handle everything else internally. When we're writing automation scripts, we don't need to specify, "I want to run on the European data center," or "I want to run on the American data center." We can just say, "I want to run a test case," and depending on the location you come from, the platform is smart enough to direct it to the nearest data center to reduce latency.
This may not be directly related to scalability, but this kind of capability would make it easier for us to build our SDKs faster and focus on other features, which in return would allow us to scale faster as a company. The learning curve for newcomers would also be easier, because they wouldn't need to worry about figuring out which data center to run against.
While I love the fact that we can specify the data center ourselves, because it gives us more freedom, I would love to see more data centers in different places around the world, to reduce latency, and the selection of the data center implicitly done by the platform, so we don't need to worry about it.
View full review »The performance is great, we never had any slowness or trouble with running our tests.
View full review »Very good, you can add Vs if necessary.
View full review »None so far.
View full review »We did not encounter any issues with scalability. I personally wished that we had a budget to get more parallel executions but the cost was not justifiable.
View full review »Very good as it has the ability to appeal to a lot of users despite some lagful moments.
View full review »The only issue is cost. Each new unit of concurrency you add to your enterprise license represents a relatively linear increase in cost.
Not yet.
View full review »At times, the brief outages or slow service responses have temporarily hampered our fairly large (in terms of concurrency) test-automation runs, but that's not very often.
View full review »Very good, highly scalable product.
View full review »We have not encountered any scalability issues. SauceCloud handles all of this for us!
View full review »We haven't had any scalability issues so far. We have built a fairly scalable automated framework to handle expansion.
View full review »Yes, the parallelization is not possible now when cucumber and junit are used together.
View full review »No issues.
View full review »No. The most famous selenium integration is enough to show off your scalability.
View full review »No scalability issues.
View full review »Not yet :)
View full review »We haven’t had any problems that we couldn’t work around, or there wasn’t any documentation on. The only problem is that hit that point where it’s unfeasible to expand our UI testing framework as the cost to run a shed load of tests is too much for our business.
View full review »None
View full review »No issues.
View full review »If too many tests are run in parallel using Sauce Connect, sometimes the tests time out. So we had to limit the number of parallel executions.
View full review »Early on we had some difficulity with parallelizing large runs, but they were resolved.
Our application is relatively small so no
View full review »No issues with scalability.
View full review »No issue with scalability.
View full review »No issues encountered.
View full review »Scalability is very good.
View full review »No issues.
View full review »There were no scalability issues.
View full review »We haven't had any issues with scalability.
View full review »Scaled for our needs.
View full review »No issues.
View full review »Sometimes.
View full review »No issues with scalability.
View full review »No issues.
View full review »There were no scalability issues.
View full review »Not so far.
View full review »Scaling options are available for purchase, but scaling by improving and streamlining our processes has been the best approach.
View full review »Not so far.
View full review »Buyer's Guide
Sauce Labs
March 2024
Learn what your peers think about Sauce Labs. Get advice and tips from experienced pros sharing their opinions. Updated: March 2024.
765,386 professionals have used our research since 2012.