We performed a comparison between Sauce Labs, Visual Studio Test Professional, and Zeenyx AscentialTest based on real PeerSpot user reviews.
Find out what your peers are saying about Tricentis, OpenText, Perforce and others in Functional Testing Tools."Running tests in parallel."
"Sauce Labs is optimized for automation and integration with the major CI/CD platforms and developer tools. We have an integration with App Center that we're working on. They have a storage API that lets us retrieve APK and IPA, iOS and Android builds off the phone, so that we can continue testing with CI/CD. They integrate with Jenkins, and Jenkins is the main CI/CD."
"It provides a comprehensive selection of browsers and platform versions for our test automations and CI/CD pipeline process. It also provides a comprehensive set of virtual mobile devices, which we can configure for our automation and availability. These features are valuable for us when it comes to testing our applications. We have a website and mobile applications that we want to test and diversify to various browsers and mobile devices as well as restore various versions. This helps us to find bugs that users might be facing and correct them."
"Testing subscription videos for on-demand software, making them better quality and bug free for our customers."
"The most valuable feature is the cross-browser feature, it has many android and iOS devices both simulators and real devices. It's easy to integrate. I also like video recording too."
"With Sauce Labs, we have a whole universe of devices: Galaxy, all the iPhones, and all the operating system versions. All our software developers are able to test on a multitude of different devices."
"They offer a large number of devices and browser/operating system combinations for real device tests"
"Sauce Labs helps us identify the root causes of bugs. The solution offers a lot of flexibility by providing the latest iOS and Android emulator versions, and even the Appium updates when it comes out in the market."
"The documentation is easy, and it helps us solve our problems."
"It is a very common and strong product. A lot of support is available for this product."
"The whole suite is made for .NET development."
"Customization is the most powerful feature of this product."
"It is a good and user-friendly tool."
"The most valuable feature has been to store all our packages in one place including SSIS packages, SQL tables, TFS and SSR."
"The initial setup is easy. It's easy to configure."
"The solution is easy to use and they have also integrated with Microsoft."
"It’s been really easy to automate the same application TestComplete struggled with. I have been able to automate two of our key applications in just a few months. I haven’t even taken their training."
"The most valuable feature of AscentialTest for us is that it fully supports PowerBuilder."
"If you use the PowerBuilder application, do choose AscentialTest without thinking twice."
"AscentialTest's object recognition in snapshots is a robust feature that goes beyond standard elements, even accurately identifying objects within Datawindows."
"Another feature that could still be improved on is more error clarity. Sometimes when running automated scripts the test will fail on the device side instead of the script and errors only show a 500 try again message instead of a detailed script that could of a been a timeout error from the code."
"Multi-domain SSO is a big concern for us right now, especially as we've been merged into a larger company. I suddenly have teams coming from 20 different domains, and because the main master Sauce Labs account is locked down to one SSO domain, there are teams that can't run a test right now. I've heard they're working on a solution and they've been very communicative with us about it. A solution to that would help us a lot."
"The only drawback is the speed, it will be good if we have a server in Asia too. It will be great if we can improve speed while initialization and execution."
"Overall, I think Sauce Labs provides us with a valuable tool and resource. As far as what could be improved, I would say the overall test execution time. Some of the calls take a bit longer than I expect, for example in web browser tests; while the execution time isn't obnoxious, it could be improved so that overall tests/test suites finish faster."
"The real concern is the load time of applications or real devices when we start our tests. It takes some time to load the application or web browser. Sometimes, it is frustrating too. Since they are real devices, we understand it takes some time to load. However, if it were to improve, then that would be a great asset to the solution. So, we would like better responsive times when opening applications and running tests."
"We had some specific features that we opened tickets on, although they were not earth-shattering. For example, the way the menus scroll could be improved because it does not have a bar, the way that people are used to, where you can move up and down."
"The pricing model of Sauce Labs could be more flexible. Sauce Labs has just one price for the type of solution and a set number of devices. Other solutions have a fee for the base solution and an additional cost per device. If you're a smaller organization, you have to consider your needs. Some smaller companies still need to test various devices, so my advice is to start small and scale up as needed. We had initially planned to start big, but that would have been a big waste."
"Integration with Github, as well as several other similar tools, could be improved."
"In Visual Studio we still don't have anything which can pinpoint memory leaks on a certain code line."
"The interface should be made attractive."
"One of the problems with this solution is you need to be highly technically skilled to operate it, it is not for everyone."
"Visual Studio Test Professional needs to improve its stability."
"It could be available for multiple platforms and other operating systems like Mac with a native port."
"Visual Studio Test Professional is a little pricey."
"It needs more integration with other tools for monitoring. Microsoft also needs to make it more modern to make it work with microservices and the cloud. It is a bit outdated currently."
"We would like to be able to easily integrate this solution with our continuous integration tools, such as Jenkins."
"Classes are not as object-oriented as I would like, but I am a programmer and not QA so I expect a lot."
"The only thing I can't wait for is for Zeenyx to add automating Mobile apps."
"Streamlining the retrieval of results from individual test set runs would be beneficial."
"I would like to see an improvement in the User Interface."
More Visual Studio Test Professional Pricing and Cost Advice →
Earn 20 points
