We performed a comparison between OpenText Silk Test, Sauce Labs, and Selenium HQ based on real PeerSpot user reviews.
Find out what your peers are saying about Tricentis, OpenText, Perforce and others in Functional Testing Tools."The statistics that are available are very good."
"The ability to develop scripts in Visual Studio, Visual Studio integration, is the most valuable feature."
"Scripting is the most valuable. We are able to record and then go in and modify the script that it creates. It has a lot of generative scripts."
"A good automation tool that supports SAP functional testing."
"The major thing it has helped with is to reduce the workload on testing activities."
"The feature I like most is the ease of reporting."
"The scalability of the solution is quite good. You can easily expand the product if you need to."
"It offers the single best solution for integrating deep automated browser testing in a CI/CD pipeline."
"APPIUM for mobile testing has improved our organization by allowing us to test our website on more devices and browsers than we currently possess."
"The abundance of device, platform, and browser combinations/versions that can be used in parallel."
"The most valuable feature is the ability to easily test multiple browsers and versions, as well as off-loading our local environments using the SauceCloud."
"The most valuable feature is the ability to run concurrent automated tests up to a specified value, depending on what we are currently paying for."
"It has significantly enhanced our testing accuracy by approximately 50%."
"It provides zero maintenance browser instances."
"With only a few clicks, it gives us the availability to use any browser and OS combination whenever we want."
"Selenium HQ lets you create your customized functions with whatever language you want to use, like Python, Java, .NET, etc. You can integrate with Selenium and write."
"All the features in Selenium to automate the UI."
"The plugins, the components, and the method of the library with Selenium is very user defined."
"Due to its popularity, you can find pretty much any answer in open discussions from the community."
"The most valuable aspect of Selenium is that it gives you the flexibility to customize or write your own code, your own features, etc. It's not restricted by licensing."
"It has helped to complete tests in less time, which would not be possible relying on manual testing only."
"Selenium WebDriver and Selenium IDE are useful."
"The most valuable features of Selenium HQ are the automation of all UI tests, its open-source, reliability, and is supported by Google."
"They should extend some of the functions that are a bit clunky and improve the integration."
"The support for automation with iOS applications can be better."
"We moved to Ranorex because the solution did not easily scale, and we could not find good and short term third-party help. We needed to have a bigger pool of third-party contractors that we could draw on for specific implementations. Silk didn't have that, and we found what we needed for Ranorex here in the Houston area. It would be good if there is more community support. I don't know if Silk runs a user conference once a year and how they set up partners. We need to be able to talk to somebody more than just on the phone. It really comes right down to that. The generated automated script was highly dependent upon screen position and other keys that were not as robust as we wanted. We found the automated script generated by Ranorex and the other key information about a specific data point to be more robust. It handled the transition better when we moved from computer to computer and from one size of the application to the other size. When we restarted Silk, we typically had to recalibrate screen elements within the script. Ranorex also has some of these same issues, but when we restart, it typically is faster, which is important."
"The solution has a lack of compatibility with newer technologies."
"The pricing is an issue, the program is very expensive. That is something that can improve."
"Everything is very manual. It's up to us to find out exactly what the issues are."
"Could be more user-friendly on the installation and configuration side."
"Sauce Labs has room for improvement with its price point. Using a real mobile device, and having that dedicated to your team, costs more than actually purchasing a mobile device. We haven't tried the real devices yet. This is because of their price point."
"We have found that during automated testing this can be very slow. This causes inconsistencies with the tests. It's very difficult to rely on a service when you can't be sure if a test will pass or fail the next time it runs. This means building in a lot of sync time into the tests which in turn slows them down. If this speed could be improved then the service would be much better."
"We encountered minor issues with stability from time to time but Sauce Labs continues to make improvements."
"Overall, I think Sauce Labs provides us with a valuable tool and resource. As far as what could be improved, I would say the overall test execution time. Some of the calls take a bit longer than I expect, for example in web browser tests; while the execution time isn't obnoxious, it could be improved so that overall tests/test suites finish faster."
"As a web product QA team, we sometimes need to spot check some new child site on multiple browsers and OS(es). It was a little time consuming for us since we need to click on each of the browser/OS combinations and start a new session to test. Every sprint, with new features and child pages being added, we mostly need to do the same steps over and over again."
"The one issue I have is the 14-day trial that a new user gets for free. I understand the concept of the trial period; however, I think this could be revamped to a free 30-minute run time every few months or after a significant update once the trial period has ended."
"Running tests in the SauceCloud can take longer than running in a local environment."
"Speeds up the time it takes to run end-to-end user interface (UI) tests inside their virtual machines (VMs)."
"They should leverage the tools for supporting Windows apps."
"Selenium could offer better ways to record and create scripts. IDE is available, however, it can be improved."
"We do not have enough resources or enough people to employ and hire. So, I'm hiring whoever I find, and they don't always have enough technical knowledge to operate Selenium."
"For now, I guess Selenium could add some other features like object communications for easy expansion."
"I would like to see a library of bomb files with an automated process and integration with Jenkins and Slack."
"The initial setup was difficult."
"Handling frames and windows needs to be improved."
"There are stability issues with Internet Explorer only."
Earn 20 points
