We performed a comparison between Sauce Labs, SmartBear TestComplete, and Worksoft Certify based on real PeerSpot user reviews.
Find out what your peers are saying about Tricentis, OpenText, Perforce and others in Functional Testing Tools.
"Sauce Connect gave us ability to test an application that was hosted locally."
"Sauce Labs is optimized for automation and integration with the major CI/CD platforms and developer tools. We have an integration with App Center that we're working on. They have a storage API that lets us retrieve APK and IPA, iOS and Android builds off the phone, so that we can continue testing with CI/CD. They integrate with Jenkins, and Jenkins is the main CI/CD."
"The error logging is also very robust. If we run a test through Sauce Labs and there's some sort of issue, a log will appear on the screen. Log messages are usually heinous and horrible... Sauce Labs is incredibly good at saying things like, 'Hey, here is the exact issue. Fix this and you can run the test.' That helps in getting things up and running and executing the way they should."
"Our machines are mostly Windows. Being able to test with Safari, on a Mac, and other types of browser pieces without having to manage all the infrastructure is the biggest feature that our team enjoys."
"With Sauce Labs, we have a whole universe of devices: Galaxy, all the iPhones, and all the operating system versions. All our software developers are able to test on a multitude of different devices."
"Since this is an all-in-one testing site, we are able to take advantage of the browser OS combinations, mobile emulators and simulators, and real mobile devices. This is important to us since we have a variety of users, browsers, OS, etc."
"Sauce Lab analytics helped us to get detailed knowledge on test cases execution and logs."
"The most critical thing is that this software aligns with our Agile and DevOps way of doing things. It integrates with kickoff scripts through DevOps."
"The most valuable feature is the integration with Azure DevOps."
"In TestComplete, I saw a conformed package of a tool that kept everybody in consistency. The team was able to regenerate further tests without having to manipulate more code because the record feature is great."
"The initial setup is pretty easy and it's quick to deploy."
"The reporting is ready to use and doesn't require any setup."
"The solution helps improve the stability of our product. It also decreases the work of our manual quality assurance engineers."
"It allows us to test both desktop and web applications."
"It is a strong automation tool for desktop, browser, and API testing."
"It's cross platform automation capabilities specially ranging across web, UNIX (via putty), and other systems."
"It is very user-friendly with an appealing UI, unlike a lot of other automation tools that we have evaluated. The fact that it can be used to across SAP and non-SAP applications (including web-based apps) is a big advantage. Using Certify Process Capture functionality has helped in hassle free test design creation, without the need to spend any extra effort to capture test steps and screenshots. The integration elements across HPE ALM and Solution Manager also work well."
"With Worksoft, we have been able to automate six of our smoke tests in four months."
"It's pretty seamless with SAP and Salesforce because they've built in the field definitions and all the things that you need. You literally turn it on and execute your script and it records it. It's very simple. Then you can go back and put in some of the other functions. For example, instead of hard-coding field selections, you put in a data table so you can run it multiple times or with multiple data. It was actually written to work very well with SAP."
"It is very easy to maintain. With scripts, I can change one line and in one step. Whatever I want, I can do. I don't need to be an expert to use it."
"Certify's web UI testing abilities for testing of modern applications like SAP Fiori was good when we started and they developed it to be even better. We all know that web applications can change objects in DOM quite fast and it breaks tests. To counter it Certify has made object recognition more flexible and generic, so we don't have any troubles."
"The ability to work with the data, with recordsets, and plug those into the scripts is very easy and very powerful. We use it extensively."
"The solution has cut our clients' test maintenance time for changes, like patches or system upgrades. They used to take a lot of time until the production validation completed. Now, it is just seconds until it is ready, so they can do executions within couple of minutes."
"The Worksoft Capture feature is most valuable. For example, if you are creating a sales order in SAP, you do not need to go to each field and do everything. You do not need to write code for each and every line. You can just turn on the Worksoft Capture feature and manually perform your actions. It will capture all manual actions, and it will give you the steps. It will write the steps for you."
"When we were in development, it was a bit of a pain because we have onshore and offshore development. One of our development shops is in India, and we were running tests over there. When some of the users tried to log in, it was slow for them or we didn't have enough licenses. That was during the core development before we even launched."
"We have found that during automated testing this can be very slow. This causes inconsistencies with the tests. It's very difficult to rely on a service when you can't be sure if a test will pass or fail the next time it runs. This means building in a lot of sync time into the tests which in turn slows them down. If this speed could be improved then the service would be much better."
"I can't remove team members that have left the organization. I can only set them as inactive. It would be really nice to clean up my data and delete them from the team management."
"Multi-domain SSO is a big concern for us right now, especially as we've been merged into a larger company. I suddenly have teams coming from 20 different domains, and because the main master Sauce Labs account is locked down to one SSO domain, there are teams that can't run a test right now. I've heard they're working on a solution and they've been very communicative with us about it. A solution to that would help us a lot."
"They could improve the platform's customer support services."
"As a web product QA team, we sometimes need to spot check some new child site on multiple browsers and OS(es). It was a little time consuming for us since we need to click on each of the browser/OS combinations and start a new session to test. Every sprint, with new features and child pages being added, we mostly need to do the same steps over and over again."
"We had some specific features that we opened tickets on, although they were not earth-shattering. For example, the way the menus scroll could be improved because it does not have a bar, the way that people are used to, where you can move up and down."
"Running tests in the SauceCloud can take longer than running in a local environment."
"This solution could be improved by making it easier to visualize where there is a failure without having to look at it in detail."
"Right now, the product only supports Windows."
"In the cross-browser domain, it has a few snags with Microsoft Edge and Chrome; although, these problems are not critical."
"I didn't use it very heavily. One issue that I found was that there wasn't a quick way or a button to move Visual Basic scripts to TestComplete. We have a lot of such scripts in our organization, and it would be very useful to have some option to easily move these scripts. It is currently possible to convert these scripts to TestComplete, but it is not easy. I have to write some code, but everything is not available immediately."
"Increased performance with less memory and CPU usage."
"SmartBear products generally have a weak link when it comes to integration with other test management tools like Inflectra."
"In SmartBear TestComplete the integration with Jenkins could be easier. Additionally, some of the controls could have better customization options. For example, if a grid is used and it contains multiple controls within it, it can be a checkbox, radio button, or any kind of control, the way the Object Spy is operating currently there is a lot of room for improvement."
"Error handling features in the tool are a little limited."
"The technical support comes on, and says, "Oh, so-and-so link is here, go through that link, and make the modifications." I'm not comfortable in making those changes. I want to schedule a call, share my screen, and have them fix it for me."
"With the codeless process automation across packaged applications, once in a while, if we get a weird application that's not widely used, it gets a little stickier. First, the software has to learn the fields, so you have to identify all the fields. Once you do that, as long as there isn’t any non-standard code in the application, then it works fine. But there's that one step that you have to do, a step you don't have to do with SAP and Salesforce, for example."
"The web application should be more robust."
"For the couple of the issues that we were really scratching our heads over, we were in communication with the technical support several times, but they never got back to us."
"Reportings are not user-friendly."
"It would be great if our business testers could develop their own automated test cases. With every release you do, you have to go back and touch your old test cases and bring them up to speed, or develop new test cases. In the beginning, that is a challenge because you have to have someone who is certified in the tool to help you develop these test cases."
"It is very easy to use, but there are some places where they need to improve their security. E.g., the BPP tool is just a URL, which does not ask you for a username and password. Anyone can login and can see it."
"The problem with Worksoft Certify is that it's not always stable. It runs on a live platform that's constantly changing, so the test script needs to be adjusted every time, which is very painful."
