We performed a comparison between Sauce Labs, SmartBear TestComplete, and Zeenyx AscentialTest based on real PeerSpot user reviews.
Find out what your peers are saying about Tricentis, OpenText, Perforce and others in Functional Testing Tools."As stated earlier we use Sauce Labs for a combination of automated testing and manual testing. Therefore the most useful features are the ability to run the functional automated tests via a Sauce Labs tunnels which allows access to applications in our internal network. The second most useful feature is the manual side."
"It runs on the cloud, so you don't have physical setups to run all of this."
"The insights section provides a great overall state of the automation suite and can identify trends relatively quickly. If we see a dip in our passing rate over time, we can look at what changed when the test started failing to find the root cause rather than doing a quick fix to find that the test fails a short time later."
"They update for the latest browsers and mobile phones and support a lot of combinations. They have 1,000-plus desktop combinations and browser versions, which is really great. We need that at Applause. The all-in-one testing suite aspect of it is really important because most of our clients prefer to go to one place."
"There is a huge amount of open source, community provided resources."
"Sauce Labs is optimized for automation and integration with the major CI/CD platforms and developer tools. We have an integration with App Center that we're working on. They have a storage API that lets us retrieve APK and IPA, iOS and Android builds off the phone, so that we can continue testing with CI/CD. They integrate with Jenkins, and Jenkins is the main CI/CD."
"Testing across multiple devices and environments is now possible to do quickly and effectively."
"I like the dashboard and seeing the test results. As a manager, I like to see the insights of the people using it, understanding the total path and run. I can see all of that as a manager. I also know team members love seeing the dashboard and seeing the test results in real-time."
"This company offers end-to-end capabilities for test suite creation and execution. One feature that I particularly appreciate is the tagging system. Tags are highly valuable, as they allow you to assign tags to your test cases. When there's an impact in a specific area, you can search for and run all test cases associated with that tag. I find this functionality very useful."
"Complete works perfectly with CUTE. That includes all dialogues, right-click menus, or system dialogues, etc., which are handled well."
"It is very easy to maintain tests with this tool. It covers all necessary items in the test plan. The most painful item in testing is maintenance. When changes occur, the tests should be maintained."
"The database checkpoints detect problems which are difficult for a human resource to find."
"The most valuable feature is the integration with Azure DevOps."
"The most valuable feature of this solution is its ability to integrate with Azure DevOps for continuous integration and deployment."
"When compared to other tools, it is very simple."
"The solution has a very nice interface."
"It’s been really easy to automate the same application TestComplete struggled with. I have been able to automate two of our key applications in just a few months. I haven’t even taken their training."
"AscentialTest's object recognition in snapshots is a robust feature that goes beyond standard elements, even accurately identifying objects within Datawindows."
"The most valuable feature of AscentialTest for us is that it fully supports PowerBuilder."
"If you use the PowerBuilder application, do choose AscentialTest without thinking twice."
"With the desktop browser, we can inspect any screen with the web developer option, but they should provide something for mobiles so that we can quickly inspect elements on the device. To write the Selenium scripts, we require web locators. We have to capture them from the local and execute the script on Sauce Labs. If Sauce Labs can provide a solution where we can inspect any of the mobile devices online, it will be very helpful for us."
"The ability to configure the memory and CPU for the test machines should be included."
"It should provide more examples of script code."
"I can't remove team members that have left the organization. I can only set them as inactive. It would be really nice to clean up my data and delete them from the team management."
"I may not know what should be improved on the platform, but I think it could offer a greater variety of testing solutions. I know there might be competing solutions that cover more things I'm unaware of, and it could expand a bit more. We've done a lot of automated testing scenarios, and that's all the rage these days, so I think Sauce Labs could look at potential ways to improve and cover other scenarios."
"Another feature that could still be improved on is more error clarity. Sometimes when running automated scripts the test will fail on the device side instead of the script and errors only show a 500 try again message instead of a detailed script that could of a been a timeout error from the code."
"Sauce Labs has room for improvement with its price point. Using a real mobile device, and having that dedicated to your team, costs more than actually purchasing a mobile device. We haven't tried the real devices yet. This is because of their price point."
"Multi-domain SSO is a big concern for us right now, especially as we've been merged into a larger company. I suddenly have teams coming from 20 different domains, and because the main master Sauce Labs account is locked down to one SSO domain, there are teams that can't run a test right now. I've heard they're working on a solution and they've been very communicative with us about it. A solution to that would help us a lot."
"Right now, the product only supports Windows."
"SmartBear products generally have a weak link when it comes to integration with other test management tools like Inflectra."
"This solution could be improved by making it easier to visualize where there is a failure without having to look at it in detail."
"The artificial intelligence needs to be improved."
"During the distribution of our regression test cases, the control IDs are not always recognized correctly."
"Stability issues occurred only when connecting to the SourceSafe. Sometimes, after getting the latest version, the tool hangs and it should be reopened in order to recover."
"The integration tools could be better."
"The code editor, though following eclipse-style, is still a work in progress and gives a very poorly formatted code once viewed via other editing tools."
"I would like to see an improvement in the User Interface."
"Streamlining the retrieval of results from individual test set runs would be beneficial."
"Classes are not as object-oriented as I would like, but I am a programmer and not QA so I expect a lot."
"The only thing I can't wait for is for Zeenyx to add automating Mobile apps."
Earn 20 points
