We performed a comparison between Galen Framework, Sauce Labs, and SmartBear TestComplete based on real PeerSpot user reviews.
Find out what your peers are saying about Tricentis, OpenText, Perforce and others in Functional Testing Tools."What I like most about Galen Framework are its advantages, particularly its spec language and the spec file feature."
"There is a huge amount of open source, community provided resources."
"Sauce Labs' dashboards contain multiple useful metrics in one place. Everything is represented to us visually on the dashboard, which helps us understand where to focus our attention, what the issues are, and what we need to resolve."
"It runs on the cloud, so you don't have physical setups to run all of this."
"The solution they provide is very robust. We can quickly connect to their environment with the hub URL. They have a URL that has the entire grid of desktops, web browsers, and mobile devices. They also provide real devices, so you just provide the URL and test your application."
"The most valuable feature is the ability to easily test multiple browsers and versions, as well as off-loading our local environments using the SauceCloud."
"They offer a large number of devices and browser/operating system combinations for real device tests"
"Sauce Lab analytics helped us to get detailed knowledge on test cases execution and logs."
"Since this is an all-in-one testing site, we are able to take advantage of the browser OS combinations, mobile emulators and simulators, and real mobile devices. This is important to us since we have a variety of users, browsers, OS, etc."
"Complete works perfectly with CUTE. That includes all dialogues, right-click menus, or system dialogues, etc., which are handled well."
"It's cross platform automation capabilities specially ranging across web, UNIX (via putty), and other systems."
"In TestComplete, I saw a conformed package of a tool that kept everybody in consistency. The team was able to regenerate further tests without having to manipulate more code because the record feature is great."
"The ability to run a whole suite of tests automatically (which we did overnight)."
"Test items, project variables helps in managing automation suite and scheduling execution."
"The most valuable feature of this solution is regression testing tools."
"Selenium integration."
"The solution helps improve the stability of our product. It also decreases the work of our manual quality assurance engineers."
"There don't seem to be functions available for automatically generating Galen values based on the specifications in the spec file, and this could be a potential improvement for Galen Framework."
"The ability to install profiles on iOS real mobile devices should be included."
"The only drawback is the speed, it will be good if we have a server in Asia too. It will be great if we can improve speed while initialization and execution."
"Sauce Labs needs to be improved in the different platforms for farm testing, like iOS and Android farm testing and farm testing web browsers."
"Sauce Labs' dashboard could be improved by adding more filters and allowing more customization options. There was one instance where the dashboard on the Sauce Labs UI didn't meet our requirements, so we had to use the Sauce Labs API to create some apps and dashboards on our own. The API endpoints could be a little more robust and customizable."
"I would like for there to be more detail in regards to the quality of our code i.e. how many failures occurred, how many passed based on industry standard metrics, etc."
"One of the challenging areas for us is the reporting and the matrix. It should be based on roles, but right now it is only available for the admin role. The admin role can really do a lot of stuff, but our infrastructure team, which holds the admin role, is not ready to hand it over to us on the testing team. If Sauce Labs had permissions associated with roles, where this role could do this activity and that role could do that activity, it would be easier for us."
"Latency, due to Sauce Labs being a cloud-based solution, has been a concern. We work in different continents and countries, but last time I checked, Sauce Labs was only offering two data centers, one in the EU and another in the US. If you're not in either of those two places, you would have latency and issues running your test cases."
"They should provide a JIRA integration plugin so that we can easily log issues."
"The way objects are added and used when utilizing descriptive programming could be improved. It is a little unwieldy, compared to UFT."
"Name Mapping feature should be clearer. Whenever I use it, I do not really know what will work and what will not work."
"The integration tools could be better."
"SmartBear products generally have a weak link when it comes to integration with other test management tools like Inflectra."
"Increased performance with less memory and CPU usage."
"Stability issues occurred only when connecting to the SourceSafe. Sometimes, after getting the latest version, the tool hangs and it should be reopened in order to recover."
"The code editor, though following eclipse-style, is still a work in progress and gives a very poorly formatted code once viewed via other editing tools."
"It is very hard to read the test log generated by TestComplete Executor if the log file is very big. TestComplete Executor is a small tool for just running the TestComplete test framework (not for developing)."
