We performed a comparison between Ranorex Studio, Sauce Labs, and SmartBear TestComplete based on real PeerSpot user reviews.
Find out what your peers are saying about Tricentis, OpenText, Perforce and others in Functional Testing Tools.
"Easy integration with CI Tools like Jenkins, TFS, and TeamCity."
"The solution is stable."
"The solution is fast and includes built-in libraries that record and playback."
"The scalability is very good. It's probably one of the better tools I've seen on the market."
"Support is very quick. You can write to them and on the same day, they will respond. This is one of the best features."
"Object identification is good."
"The most valuable feature of Ranorex Studio is its user-friendly interface."
"Code Conversion is one of the great features because sometimes, the automation tool doesn't have the capability of maneuvering around two specific evaluations."
"They offer a large number of devices and browser/operating system combinations for real device tests"
"I find that the multitude of browser and OS versions are very helpful for broadening testing scope."
"The abundance of device, platform, and browser combinations/versions that can be used in parallel."
"There is a huge amount of open source, community provided resources."
"Sauce Labs helps us identify the root causes of bugs. The solution offers a lot of flexibility by providing the latest iOS and Android emulator versions, and even the Appium updates when it comes out in the market."
"With Sauce Labs, we have a whole universe of devices: Galaxy, all the iPhones, and all the operating system versions. All our software developers are able to test on a multitude of different devices."
"Easy to integrate with the other platform for tracking purposes."
"From an infrastructure support perspective, the number of VMs, browsers installations and versions that we would be maintaining without Sauce Labs would be a lot. This includes not only the infrastructure costs, but also the maintenance costs and people's time. The labor cost associated with maintaining all of that would be considerably high. In terms of efficiency, having concurrent VMs with various browser combinations available has allowed us to run multiple executions by all our teams."
"The solution is mainly stable."
"The reporting is ready to use and doesn't require any setup."
"You can record your actions and play them back later."
"The most valuable feature is the integration with Azure DevOps."
"It is very easy to maintain tests with this tool. It covers all necessary items in the test plan. The most painful item in testing is maintenance. When changes occur, the tests should be maintained."
"Runs in different remote machines. We have multiple versions of the software being tested."
"It is a strong automation tool for desktop, browser, and API testing."
"Selenium integration."
"Part of the challenge is that Ranorex's support is over in Europe, so we can't get responses on the same day. If we had support in the United States that was a bit more timely, that would be helpful."
"One of the areas the service could be improved would be to have the training in Italian."
"The solution does not support dual or regression testing."
"Other OS Support, Ranorex Spy performance improvement (Especially for Silverlight controls)."
"Binding to other sources is very good but the object recognition in .NET desktop applications often doesn't work."
"When Ranorex is upgraded, the compatibility with other projects, in version control, in-house or on-premise, fails on occasion. However, overall, the stability is good."
"I'd like to know their testing strategies and to know what they can automate and what they can't. It can become pretty frustrating if you're trying to automate something that changes on a monthly or weekly basis."
"I would like to be able to customize the data grids. They are currently written in Visual Basic and we are unable to get down to the cell level without hard-code."
"Unable to segregate reports for tests that are currently being developed, and might not be returning useful results."
"Sauce Labs' dashboard could be improved by adding more filters and allowing more customization options. There was one instance where the dashboard on the Sauce Labs UI didn't meet our requirements, so we had to use the Sauce Labs API to create some apps and dashboards on our own. The API endpoints could be a little more robust and customizable."
"If I had to speak of an area that could be improved it would probably have to be the speed of interaction with the devices. There is at times a considerable amount of lag while using some of the virtual and at times even physical device farm"
"We encountered minor issues with stability from time to time but Sauce Labs continues to make improvements."
"This product is not super scalable, because you have a very specific number of VMs that you can use."
"I can't remove team members that have left the organization. I can only set them as inactive. It would be really nice to clean up my data and delete them from the team management."
"Sometimes pasting text while using "text object" does not seem to work, and it slows down testing times quite a bit."
"Speeds up the time it takes to run end-to-end user interface (UI) tests inside their virtual machines (VMs)."
"The test object repository needs to be improved. The hierarchy and the way we identify the objects in different applications, irrespective of technology, needs adjustments. The located and test objects are not as flexible compared to other commercial tools."
"Product is not stable enough and it crashes often."
"I didn't use it very heavily. One issue that I found was that there wasn't a quick way or a button to move Visual Basic scripts to TestComplete. We have a lot of such scripts in our organization, and it would be very useful to have some option to easily move these scripts. It is currently possible to convert these scripts to TestComplete, but it is not easy. I have to write some code, but everything is not available immediately."
"To bring it up to a 10, I would be looking for the addition of some key functional API testing."
"The solution needs to extend the possibilities so that we can test on other operating systems, platforms and publications for Android as well as iOS."
"In the cross-browser domain, it has a few snags with Microsoft Edge and Chrome; although, these problems are not critical."
"The solution needs more training manuals or some form of online forum for learning. It needs more documentation."
"Error handling features in the tool are a little limited."
