Sauce Labs Room for Improvement

reviewer1398594
Senior Software Development Engineer in Test at Autodesk, Inc.
As a web product QA team, we sometimes need to spot check some new child site on multiple browsers and OS(es). It was a little time consuming for us since we need to click on each of the browser/OS combinations and start a new session to test. Every sprint, with new features and child pages being added, we mostly need to do the same steps over and over again. We would like to see if Sauce Labs can be able to open multiple different browsers on the same website at the same time, just by 1 click. It will reduce a lot of time for manually click and change the devices/OS combination. View full review »
reviewer1396422
Senior QA Automation Engineer at Bleacher Report
Overall, I think Sauce Labs provides us with a valuable tool and resource. As far as what could be improved, I would say the overall test execution time. Some of the calls take a bit longer than I expect, for example in web browser tests; while the execution time isn't obnoxious, it could be improved so that overall tests/test suites finish faster. Within the insights section of the Sauce Labs tool, I think it would be nice if you could go back farther than 30 days worth of data. I like all the custom filters available, but being able to go back say 90 days (or more) would show more statistics on our data/test results. In the next release, I'd like to see continual new additions of OS's. This area is usually pretty up-to-date, please keep at it! View full review »
reviewer1394535
Lead Quality Analyst at Derivco
If I had to speak of an area that could be improved it would probably have to be the speed of interaction with the devices. There is at times a considerable amount of lag while using some of the virtual and at times even physical device farms. While this is absolutely better than not having it situation Sauce Labs certainly would benefit as well as we the user would certainly benefit from gaining a software interaction speed boost. Having it more consistent would be greatly appreciated if the long run. This is the only thing affecting the testing time at the moment and can even be seen as a disadvantage in comparison to having an actual physical device in hand. View full review »
Learn what your peers think about Sauce Labs. Get advice and tips from experienced pros sharing their opinions. Updated: August 2020.
448,290 professionals have used our research since 2012.
Ryan Craven
Quality Assurance Engineer at Optum
From a company use standpoint - I have no complaints. The one issue I have is the 14-day trial that a new user gets for free. I understand the concept of the trial period; however, I think this could be revamped to a free 30-minute run time every few months or after a significant update once the trial period has ended. Personally speaking - I like to maintain my automation framework and would like to occasionally test that it continues to run on Sauce Labs after releases without stealing from Sauce Labs. View full review »
it_user495984
Senior Software Test Automation Engineer at a tech vendor with 10,001+ employees
1. They still have very slow support and ask many excessive questions before starting to fix the issue. When we submit tickets in their reporting system, we expect them to start tracking down the problem as soon as possible. Instead, it looks like they ask standard questions just to delay work to a few days. E.g. 1st day: "Could you confirm you use the latest version" - "Yes, we do" 2nd day: "Ok. Can you then try to run that with extra flag Y and grab the log for us" - "Yes, please, take the log" <2 days of silence> 5th day: ... - "Guys, is there any progress on that?" and so on... Sometimes questions are really unrelated and take time like "Have you read the Getting Started guide?" 2. They still have platform-specific issues, especially on Mobile platforms. They wouldn't affect trivial tests though. E.g. they have issues related to SauceConnect traffic routing specific to iOS 9 and Android 4. This affect tests that want to sniff the traffic only though. Please, let me know if you want more technical details. 3. Sometimes they change configuration options (e.g. rename... E.g. recently they changed desired capability for iPhone Simulator in a way like "iPhone 6 simulator" > "iPhone 6" That affected multiple tests suddenly. They haven't made any notification about that though. View full review »
reviewer1400664
QA Analyst II at Regal Entertainment Group
A service that could be improved is some of their Wiki documents are either outdated or point to broken URLs; however when contacting the customer service they are able to respond in a quick manner with either an updated document or with the steps to fix the issue. Another feature that could still be improved on is more error clarity. Sometimes when running automated scripts the test will fail on the device side instead of the script and errors only show a 500 try again message instead of a detailed script that could of a been a timeout error from the code. View full review »
reviewer1394979
Lead QA Engineer at a healthcare company with 201-500 employees
We have used Sauce Labs extensively for the last 5 years across automated and manual testing and have found some problems during this time. Firstly as we use Sauce Labs to connect the tunnel to connect to apps in our internal network we have found that during automated testing this can be very slow. This causes inconsistencies with the tests. It's very difficult to rely on a service when you can't be sure if a test will pass or fail the next time it runs. This means building in a lot of sync time into the tests which in turn slows them down. If this speed could be improved then the service would be much better. View full review »
reviewer1396401
Senior QA Engineer at Indeed.com
Improve easy way to automation testing and generate script automatically while running manual test cases on Sauce. 1. When running manual test cases, provide us a way to record and playback the same steps 2. Provide JIRA integration plugin so that we can easily log issues. 3. Provide easy way to create scripts automatically for manual steps and use sauce labs UI to execute it again 4. Sauce labs should provide their own email client and easy to send email in that user session 5. One-click setup for sauce proxy View full review »
reviewer1396425
Senior Automation Engineer / Senior SDET at Setel
The only drawback is the speed, it will be good if we have a server in Asia too. It will be great if we can improve speed while initialization and execution. View full review »
abhayr
Senior Quality Engineer at Quest Software
* Ability to configure the memory and CPU for the test machines * Ability to install profiles on iOS real mobile devices View full review »
Aj Aj
User at Infosys Technologies Ltd
More physical devices. View full review »
Learn what your peers think about Sauce Labs. Get advice and tips from experienced pros sharing their opinions. Updated: August 2020.
448,290 professionals have used our research since 2012.