We performed a comparison between Galen Framework, IBM Rational Functional Tester, and Sauce Labs based on real PeerSpot user reviews.
Find out what your peers are saying about Tricentis, OpenText, Perforce and others in Functional Testing Tools."What I like most about Galen Framework are its advantages, particularly its spec language and the spec file feature."
"IBM Rational Functional Tester is very contextual."
"It is compatible with all sorts of Dark Net applications. Its coverage is very good."
"The most valuable feature is the UI component tester."
"Test automation is most valuable because it saves a lot of time."
"I find that the multitude of browser and OS versions are very helpful for broadening testing scope."
"The most valuable feature is the ability to run concurrent automated tests up to a specified value, depending on what we are currently paying for."
"It helped to integrate our performance testing and UAT, which helped to deliver a bug free software for our customers."
"There is a huge amount of open source, community provided resources."
"The error logging is also very robust. If we run a test through Sauce Labs and there's some sort of issue, a log will appear on the screen. Log messages are usually heinous and horrible... Sauce Labs is incredibly good at saying things like, 'Hey, here is the exact issue. Fix this and you can run the test.' That helps in getting things up and running and executing the way they should."
"Sauce Labs provides us with more combinations to test, so we can keep adding platforms and devices to our network. That's been a very seamless experience. Let's say there's an iOS or a private device we need. Sauce Labs has helped get all those set up when needed."
"One of the most valuable features is that we do not have to have the cross-platform testing vehicles in-house. Sauce Labs gives us the ability to test across platforms and that really helps give us confidence in our products."
"Since this is an all-in-one testing site, we are able to take advantage of the browser OS combinations, mobile emulators and simulators, and real mobile devices. This is important to us since we have a variety of users, browsers, OS, etc."
"There don't seem to be functions available for automatically generating Galen values based on the specifications in the spec file, and this could be a potential improvement for Galen Framework."
"They need to do a complete revamp so that even a non-technical person can manage the tool."
"The latest version has increased load time before testing can be run."
"If the solution is running on Linux, there are some issues around application compatibility."
"As many of our products are moving from PC to mobile, the most important thing that this solution needs is mobile app support."
"Sauce Labs' dashboard could be improved by adding more filters and allowing more customization options. There was one instance where the dashboard on the Sauce Labs UI didn't meet our requirements, so we had to use the Sauce Labs API to create some apps and dashboards on our own. The API endpoints could be a little more robust and customizable."
"There have been various times throughout the last month or so where the service has gone down during business hours."
"We had some specific features that we opened tickets on, although they were not earth-shattering. For example, the way the menus scroll could be improved because it does not have a bar, the way that people are used to, where you can move up and down."
"The real concern is the load time of applications or real devices when we start our tests. It takes some time to load the application or web browser. Sometimes, it is frustrating too. Since they are real devices, we understand it takes some time to load. However, if it were to improve, then that would be a great asset to the solution. So, we would like better responsive times when opening applications and running tests."
"Another aspect that could be improved is having the virtual devices boot up a little quicker. Sometimes we wait up to a minute before a device is available. It would be nice if that was 30 seconds or so."
"The pricing model of Sauce Labs could be more flexible. Sauce Labs has just one price for the type of solution and a set number of devices. Other solutions have a fee for the base solution and an additional cost per device. If you're a smaller organization, you have to consider your needs. Some smaller companies still need to test various devices, so my advice is to start small and scale up as needed. We had initially planned to start big, but that would have been a big waste."
"The ability to configure the memory and CPU for the test machines should be included."
"When we were in development, it was a bit of a pain because we have onshore and offshore development. One of our development shops is in India, and we were running tests over there. When some of the users tried to log in, it was slow for them or we didn't have enough licenses. That was during the core development before we even launched."
More IBM Rational Functional Tester Pricing and Cost Advice →
