We performed a comparison between Ranorex Studio, Sauce Labs, and Tricentis Tosca based on real PeerSpot user reviews.
Find out what your peers are saying about Tricentis, OpenText, Katalon Studio and others in Test Automation Tools."The solution is stable."
"I'm from a UFT background, so Ranorex Studio has a similar feel in terms of how it handles objects. It just felt familiar even though I'd never seen it before. However, it doesn't have all the bells and whistles of UFT, but it's a pretty good start, and it's cost-effective."
"The scalability is very good. It's probably one of the better tools I've seen on the market."
"The most valuable feature of Ranorex Studio is the capture and replay tool. You don't need to do script testing. When you launch any application from Ranorex Studio it automatically captures these test case steps. The next time you can replay the tool the flow automatically happens again. For example, when you do the logging and all the activity will be captured by the tool, and re-execute the same step by using automatization."
"The solutions's regression testing is very important for our company, as is the continuous integration process."
"Code Conversion is one of the great features because sometimes, the automation tool doesn't have the capability of maneuvering around two specific evaluations."
"Object identification is good."
"I like the recording function and Ranorex Spy."
"Live device testing. As we all know, It's really hard and challenging to find/purchase many real devices to test because it will be costly and not all the team can be able to purchase all of the devices out there. We used to have a lot of real devices under our labs. However, it is really time-consuming to maintain those devices and make sure they are up to date with the testing requirements."
"They offer a large number of devices and browser/operating system combinations for real device tests"
"Before implementing Sauce Labs, we tested physical devices that team members had to share. It was more feasible when we were all located in one office, but we couldn't leverage our offshore capacity. With this solution, we can do everything remotely, which is essential now that most of us work from home."
"Sauce Labs is optimized for automation and integration with the major CI/CD platforms and developer tools. We have an integration with App Center that we're working on. They have a storage API that lets us retrieve APK and IPA, iOS and Android builds off the phone, so that we can continue testing with CI/CD. They integrate with Jenkins, and Jenkins is the main CI/CD."
"Sauce Lab analytics helped us to get detailed knowledge on test cases execution and logs."
"It provides zero maintenance browser instances."
"I have found the live test section with Sauce Labs to be extremely valuable. When you can't quite figure out why a test is failing, you can go to the live test results section within their tool and launch your test (specifying a given OS/browser, or device) manually and step through the test to see the issue more clearly, usually opening up the developer's tool console and watching the network calls and console (within Chrome) to usually find the underlying issue."
"The most valuable feature is cross-browser, cross-OS, cross-mobile device testing."
"The most valuable features of Tricentis Tosca are the ease of use, you do not need to program if you do not want to."
"To me, what stands out the most about Tricentis Tosca is that even if I'm not a technical tester, I could pick up on how to use it very quickly because of the mechanisms of the tool, for example, its scanning mechanism. I'm not so technical, but I'm able to maneuver through Tricentis Tosca and derive capability. It's a user-friendly tool. It's not very complex."
"This solution is easy to use for everybody, including those who are not IT-educated."
"It's a simple tool, particularly in terms of system testing. You can also convert and automate using Tricentis Tosca with ease."
"With one click, it will scan all the elements on the screen, so that the user can select the required elements for automation tests."
"The most valuable features of Tricentis Tosca are the Salesforce scanning. There are two scanning for Salesforce applications. There is Salesforce scanning and normal application scanning. Object identification has been really useful in Tricentis Tosca."
"As a codeless automation tool, the product offers a user-friendly experience without requiring extensive coding knowledge. Users can easily handle various applications, including web applications, SAP applications, Windows applications, and even Salesforce applications, without manual coding."
"One notable feature is its ability to handle negative XPath healing processes. If one XPath fails, Tosca can utilize backup XPaths to ensure test cases do not fail due to locator issues, thereby focusing on identifying application-side issues, which is the ultimate goal."
"If there are many queries on the web page, Ranorex will not render the page correctly. I had about 1,000 queries on the page, and the solution was not able to handle it."
"Other OS Support, Ranorex Spy performance improvement (Especially for Silverlight controls)."
"I would like to be able to customize the data grids. They are currently written in Visual Basic and we are unable to get down to the cell level without hard-code."
"When Ranorex is upgraded, the compatibility with other projects, in version control, in-house or on-premise, fails on occasion. However, overall, the stability is good."
"Binding to other sources is very good but the object recognition in .NET desktop applications often doesn't work."
"The solution's technical support team could be responsive."
"I'd like to know their testing strategies and to know what they can automate and what they can't. It can become pretty frustrating if you're trying to automate something that changes on a monthly or weekly basis."
"The object detection functionality needs to be improved."
"Overall, I think Sauce Labs provides us with a valuable tool and resource. As far as what could be improved, I would say the overall test execution time. Some of the calls take a bit longer than I expect, for example in web browser tests; while the execution time isn't obnoxious, it could be improved so that overall tests/test suites finish faster."
"If I had to speak of an area that could be improved it would probably have to be the speed of interaction with the devices. There is at times a considerable amount of lag while using some of the virtual and at times even physical device farm"
"I may not know what should be improved on the platform, but I think it could offer a greater variety of testing solutions. I know there might be competing solutions that cover more things I'm unaware of, and it could expand a bit more. We've done a lot of automated testing scenarios, and that's all the rage these days, so I think Sauce Labs could look at potential ways to improve and cover other scenarios."
"We have faced challenges with the availability of mobile devices. There was once or twice where there were no mobile devices available."
"The ability to install profiles on iOS real mobile devices should be included."
"They should provide a JIRA integration plugin so that we can easily log issues."
"One of the challenging areas for us is the reporting and the matrix. It should be based on roles, but right now it is only available for the admin role. The admin role can really do a lot of stuff, but our infrastructure team, which holds the admin role, is not ready to hand it over to us on the testing team. If Sauce Labs had permissions associated with roles, where this role could do this activity and that role could do that activity, it would be easier for us."
"Unable to segregate reports for tests that are currently being developed, and might not be returning useful results."
"The tool lags in client-based applications. We have also encountered issues with the features in integrations."
"A disadvantage of Tricentis Tosca is that you have to customize it according to your need, during the early stages of the software, particularly during upstream testing, before system and unit testing."
"The support we received from Tricentis Tosca was good, but it can improve."
"Parallel execution is not yet implemented for Tosca. This means you can't execute the same test case on multiple machines remotely."
"In Tosca, I see that there are no user guides."
"The document object model or some aspects of it has a bit of a learning curve."
"The reporting function was lacking in usability and detail."
"Their license management should be improved. One of our customers is a global customer. They want to use one licensed server and then split the licenses based on the different users of the different business units, but currently, there is only one license server that everybody can access. There is no control, and that's why sometimes congestion can happen."