We performed a comparison between ReadyAPI, Sauce Labs, and Selenium HQ based on real PeerSpot user reviews.
Find out what your peers are saying about Tricentis, OpenText, Perforce and others in Functional Testing Tools."The two most valuable features we use are the functional test and the security test."
"The most valuable features are the integration with Jira and the test management tools."
"It can create stress tests very fast, and some features help you do it fast."
"The feature that allows you to import an API collection or a project is valuable."
"The most valuable features of ReadyAPI are its robust functionality and collaboration capabilities."
"When we are doing API testing we have found it to be very efficient to receive results. Additionally, you are able to do tests directly from the API."
"The most valuable feature has been the assertion as a test step as this has allowed us to increase the scope of testing and validation."
"I haven't seen any other tool that offers both types of tests. This is very helpful for us, and it's one of the main reasons why we chose this service."
"Before implementing Sauce Labs, we tested physical devices that team members had to share. It was more feasible when we were all located in one office, but we couldn't leverage our offshore capacity. With this solution, we can do everything remotely, which is essential now that most of us work from home."
"Sauce Labs helps us identify the root causes of bugs. The solution offers a lot of flexibility by providing the latest iOS and Android emulator versions, and even the Appium updates when it comes out in the market."
"Our machines are mostly Windows. Being able to test with Safari, on a Mac, and other types of browser pieces without having to manage all the infrastructure is the biggest feature that our team enjoys."
"Live device testing. As we all know, It's really hard and challenging to find/purchase many real devices to test because it will be costly and not all the team can be able to purchase all of the devices out there. We used to have a lot of real devices under our labs. However, it is really time-consuming to maintain those devices and make sure they are up to date with the testing requirements."
"With Sauce Labs, we have a whole universe of devices: Galaxy, all the iPhones, and all the operating system versions. All our software developers are able to test on a multitude of different devices."
"The most valuable feature is the cross-browser feature, it has many android and iOS devices both simulators and real devices. It's easy to integrate. I also like video recording too."
"The error logging is also very robust. If we run a test through Sauce Labs and there's some sort of issue, a log will appear on the screen. Log messages are usually heinous and horrible... Sauce Labs is incredibly good at saying things like, 'Hey, here is the exact issue. Fix this and you can run the test.' That helps in getting things up and running and executing the way they should."
"Since this is an all-in-one testing site, we are able to take advantage of the browser OS combinations, mobile emulators and simulators, and real mobile devices. This is important to us since we have a variety of users, browsers, OS, etc."
"It's easy for new people to get trained on this solution. If we are hiring new people, the resource pool in the market in test automation is largely around Selenium."
"Selenium WebDriver and Selenium IDE are useful."
"The most valuable aspect of Selenium is that it gives you the flexibility to customize or write your own code, your own features, etc. It's not restricted by licensing."
"The solution is very flexible; there are different ways of using it. It's open-source and has a lot of support on offer."
"The most valuable feature of Selenium HQ is it provides support for third-party tools, such as screenshots, and automates Windows-based applications."
"The solution is very easy to implement."
"The initial setup is straightforward. Deployment took about seven months."
"Selenium is the fastest tool compared to other competitors. It can run on any language, like Java, Python, C++, and .NET. So we can test any application on Selenium, whether it's mobile or desktop."
"They have performance testing also. However, it's not that great."
"ReadyAPI could improve by adding a conversion tool from one file type to another. Import support for multiple file types would be beneficial."
"There is room for improvement in ReadyAPI, particularly in the user interface."
"In terms of features, I have already raised different change requests on the ReadyAPI side. One of the largest functions I've requested is the validation of the payload for the REST APIs."
"The overall scope of this solution is limited and could be improved."
"Can be improved by including an inherent feature for UI automation."
"Areas for improvement include the security files, endpoints, and process sessions."
"It is challenging doing upgrades and patches because sometimes the environmental variables or suits in the projects get erased."
"The Jenkins Sauce OnDemand plugin could have more options available to tap into more of the custom capabilities Sauce Labs actually supports."
"Multi-domain SSO is a big concern for us right now, especially as we've been merged into a larger company. I suddenly have teams coming from 20 different domains, and because the main master Sauce Labs account is locked down to one SSO domain, there are teams that can't run a test right now. I've heard they're working on a solution and they've been very communicative with us about it. A solution to that would help us a lot."
"The testing process is difficult. I need to prove the complete competency of the tool, and I am finding that challenging."
"Integration with Github, as well as several other similar tools, could be improved."
"User account management needs an overhauls, allowing for user groups rather than just a hierarchy structure."
"The ability to configure the memory and CPU for the test machines should be included."
"The ability to install profiles on iOS real mobile devices should be included."
"If I had to speak of an area that could be improved it would probably have to be the speed of interaction with the devices. There is at times a considerable amount of lag while using some of the virtual and at times even physical device farm"
"We do not have enough resources or enough people to employ and hire. So, I'm hiring whoever I find, and they don't always have enough technical knowledge to operate Selenium."
"Selenium HQ doesn't support Windows-based applications, so we need to integrate with the third-party vendor. It would be great if Selenium could include Windows-based automation. You need to integrate it with a third-party tool if you want to upload any files. When we interact with a Windows application, we usually use Tosca."
"I have found that at times the tool does not catch the class features of website content correctly. The product's AWS configuration is also hard."
"The reporting part can be better."
"Coding skills are required to use Selenium, so it could be made more user-friendly for non-programmers."
"In the beginning, we had issues with several test cases failing during regression. Over a period of time, we built our own framework around Selenium which helped us overcome of these issues."
"The login could be improved, to obviate the need for relying on another one for integration with Selenium HQ"
"I would like to see Selenium HQ support legacy platforms."