Most Helpful Review
Our automation engineers can create tests more easily, but the code editor gives poorly formatted code.
By automating our scripts, we were able to do more comprehensive testing and therefore eliminate the number of...
Find out what your peers are saying about SmartBear TestComplete vs. Worksoft Certify and other solutions. Updated: January 2019.
317,758 professionals have used our research since 2012.
We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
The database checkpoints detect problems which are difficult for a human resource to find.
Customer service and technical support responsiveness are high. Everyone is very professional.
Test items, project variables helps in managing automation suite and scheduling execution.
It's cross platform automation capabilities specially ranging across web, UNIX (via putty), and other systems.
The ability to run a whole suite of tests automatically (which we did overnight).
TestComplete fits almost perfectly with a large amount of stacks, such as Delphi, C#, Java and web applications.
Runs in different remote machines. We have multiple versions of the software being tested.
With autotesting, we have been able to eliminate duplication of test cases across those four areas. This has helped us knock down our number of test cases. Our test cases are also running more optimally. Therefore, it has very much helped in that sense, so we were able to eliminate a lot of test cases and get out of manual silos by running on autotesting, which is more efficient.
It is a pretty easy tool to use as far as automated testing tools go.
If we write a new test that's 80 percent the same as an existing test, it is pretty straightforward to reuse the steps from existing tests for our new tests and build upon them.
We do a fair amount of end-to-end testing with the ability to create an end-to-end script, which cuts across all functional powers, from sales and distribution, manufacturing production planning, purchasing, raw materials, and logistics for receiving then shipping our invoicing and financial postings. When we have a change which affects the whole stream, our functional support teams can't test it because they don't have the expertise across those towers. They would have to do it manually, which could take them a week or more to get to a script like that done, whereas we can get it done in minutes.
It is very user-friendly with an appealing UI, unlike a lot of other automation tools that we have evaluated. The fact that it can be used to across SAP and non-SAP applications (including web-based apps) is a big advantage. Using Certify Process Capture functionality has helped in hassle free test design creation, without the need to spend any extra effort to capture test steps and screenshots. The integration elements across HPE ALM and Solution Manager also work well.
The ease of use is superior to anything on the market. It's very easy to integrate. We've been very impressed with the tool. Because we primarily use the configuration with SAP, the integration is pretty seamless. But we have used our own in-house VB app as well, and it's worked very well with that.
We love the Capture 2.0 feature. It seems to work very well.
The ability to work with the data, with recordsets, and plug those into the scripts is very easy and very powerful. We use it extensively.
Name Mapping feature should be clearer. Whenever I use it, I do not really know what will work and what will not work.
Stability issues occurred only when connecting to the SourceSafe. Sometimes, after getting the latest version, the tool hangs and it should be reopened in order to recover.
Increased performance with less memory and CPU usage.
Error handling features in the tool are a little limited.
The code editor, though following eclipse-style, is still a work in progress and gives a very poorly formatted code once viewed via other editing tools.
We were testing handheld barcode scanners running WindowsCE with many menus of warehouse functions, and our biggest problem was the timing between input and responses.
TestComplete gives support to do requests to a SOAP web service but has no support to do HTTP requests on Restful services.
Product is not stable enough and it crashes often.
It would be great if our business testers could develop their own automated test cases. With every release you do, you have to go back and touch your old test cases and bring them up to speed, or develop new test cases. In the beginning, that is a challenge because you have to have someone who is certified in the tool to help you develop these test cases.
One feature that we have been asking for has been to treat tests as code and store the source code for tests in a configuration management tool. Right now, for version control of testing, it's all internally within the tool. If we have a test of a business process and want to revive that test, our methodology now is purely manual work. We go into the tool, create a copy of the existing test, and call the next one: v2. Now, we have two of them and the only way you can tell them apart is by its naming convention.
I would like to do a cloud application, taking it off the remote desktop. Many of us are starting to move to S/4HANA, away from SAP ECC, and into the cloud with S/4HANA. I'm doing implementation project on that now. If we could access the S/4HANA quality system from our remote desktop, and have the Worksoft Certify application in the cloud, it would solve most of my infrastructure issues.
Our interactions with technical support has not been the best always and there is room for improvement especially with respect to the time taken to respond to cases. However, with the right contacts and reasonable escalations we have always managed to get quick attention on our cases.
In the past, when we've tried to automate some of our web apps, it has not been as robust. If there were one thing that could be improved, it's interaction with web applications. The issue we were running into is that it was harder to identify the objects than it is with some of the other architectured applications.
The definitions for the objects need to be automated. They need to be recognized automatically by Worksoft Certify instead of changing them back and forth manually. This is also something that Worksoft is currently working on.
It is poor for a web based application.
Reportings are not user-friendly.
Pricing and Cost Advice
The license price for a physical machine is cheap, and for virtual machine, it is very expensive.
Our ROI is about $10,000 a year.
TestComplete now have come up with three modules (Web, Desktop & Mobile), so based on the type of product for automation, it is adequate to purchase the required module.
Buy modules on demand. If you have a four-person team and they will each automate tests only 25% of the time, it's better to buy a floating licence and share the tool during the work day.
The price is less, compared to other products, such as QTP.
My advice so far, is that while it’s not quite as powerful and easy to use as UFT, its price tag more than makes up for it.
The product is becoming more and more expensive.
There is a cost involved to doing it, but once you get over the initial cost, then you'll start reaping the benefits and seeing that testing is getting done more quickly and efficiently. We are still early on with it, but the expectation and what we're seeing is that we will start seeing some savings coming out on the back-end once we have this done.
The price is in line with everyone else's in the market. They are not cheaper nor more expensive than anyone else who was in our RFP.
The initial upfront cost in terms of licenses, plus all the money that we spent developing tests, has proven it's worth. Now, we can do a regression test suite in ten days as opposed to sixteen weeks.
Our ROI is primarily a reduction in testing time. The testing, when we were doing it manually, was 30 to 40 percent of the project's cost.
We ended up buying too many licenses. They were very good at selling it to us, and probably oversold it a little. We bought 45 licenses and have never used more than twenty. However, they gave us a pretty significant discount on the bigger license, so it made sense for us to buy enough that we wouldn't have to go back and ask for more.
We could use Certify to do robotic process automation, which is basically running a process on your correction system instead of your test system. Therefore, we may do that in the future.
The initial investment is probably a little high. It was a little hard for me to sell, but it's a one shot deal and that's why it's so high. All we are doing now is paying annual maintenance, which we don't have to if we don't want upgrades, but we do.
It is expensive compared to some of the other automation tools in the market. However, the benefits and ROI has proved that it has been a good investment.
out of 44 in Functional Testing Tools
out of 44 in Functional Testing Tools
Compared 17% of the time.
Compared 13% of the time.
Compared 7% of the time.
Compared 31% of the time.
Compared 20% of the time.
Compared 15% of the time.
TestComplete is a powerful and robust automated testing tool for mobile, web and desktop applications. Quickly and easily create accurate and repeatable tests across multiple devices, platforms and environments – regardless of experience level. It supports multiple languages, modern control sets and integrates with open source frameworks and tools like Selenium, SoapUI and Jenkins.
|Worksoft is a leading global provider of automation software for high-velocity business process testing and discovery. Enterprises worldwide use Worksoft intelligent automation to innovate faster, lower technology risk, reduce costs, improve quality, and deeply understand their real end-to-end business processes. Global 5000 companies across all industries choose Worksoft for high speed process discovery and functional testing of digital, web, cloud, mobile, big data, and dozens of enterprise applications, including SAP, Oracle, and Salesforce.com.|
Learn more about SmartBear TestComplete
Learn more about Worksoft Certify
|Cisco, J.P. Morgan, Boeing, McAfee, EMC, Intuit, and Thomson Reuters.||Kraft, Reliant Energy, Richemont, Applied Materials, Siemens PLM, Mosaic, Dow Corning, ebay, IBM, Accenture, Fortis BC, US Government, Southwest Airlines|
Software R&D Company13%
Comms Service Provider13%
Financial Services Firm16%
Software R&D Company34%
Financial Services Firm8%