We performed a comparison between Katalon Studio and SmartBear TestComplete based on real PeerSpot user reviews.
Find out in this report how the two Test Automation Tools solutions compare in terms of features, pricing, service and support, easy of deployment, and ROI."Video capture on failure is a must have. A picture is worth a thousand words. A video is worth a thousand pictures (literally)."
"Smart Wait and XPath healing are valuable features."
"It is good for API testing. It is also good for continuous integration testing. You can connect it to Jenkins."
"The functionality of the data is very good. You can upload and disperse data using the solution."
"The best feature is the split up between test cases and the test object. This allows us to easily change an error."
"One of the features that I like is Object Recognition. It worked very well, and it allowed me to create a dynamic expert based on my requirements."
"The initial setup of Katalon Studio was easy."
"The product provides ease of automation for the cloud."
"The product's initial setup phase was easy."
"Recording and playback of tests were easier with SmartBear TestComplete...It is a scalable solution."
"The most valuable feature of this solution is its ability to integrate with Azure DevOps for continuous integration and deployment."
"It is very easy to maintain tests with this tool. It covers all necessary items in the test plan. The most painful item in testing is maintenance. When changes occur, the tests should be maintained."
"In TestComplete, I saw a conformed package of a tool that kept everybody in consistency. The team was able to regenerate further tests without having to manipulate more code because the record feature is great."
"Customer service and technical support responsiveness are high. Everyone is very professional."
"Selenium integration."
"TestComplete has strong reporting capabilities. The reports they generate are really good."
"The tool's maintenance is very difficult since they do not follow call by value or call by reference. Due to this, any change happening is not reflected throughout all the test cases. There are some issues with data parameterization as well."
"Katalon lacks integration with other software, including integrating other languages like .NET and PHP."
"My recently-updated Katalon studio version hangs a lot and is not a stable version."
"The product’s regression testing time could be reduced."
"Katalon doesn't support testing of hybrid applications. It's a limitation."
"Katalon Studio should improve its usability, it still needs some improvement where users can easily use it to build their automation suite. It requires some initial work to set it up. There should be more keywords in the library to limit the coding requirements, this will allow a non-technical person easily start using it, which would be better."
"The price of Katalon Studio is an area of concern where improvement is required."
"They need to work on documentation to make it more centralized and easier to find what you are looking for."
"In SmartBear TestComplete the integration with Jenkins could be easier. Additionally, some of the controls could have better customization options. For example, if a grid is used and it contains multiple controls within it, it can be a checkbox, radio button, or any kind of control, the way the Object Spy is operating currently there is a lot of room for improvement."
"The solution needs Mac OS support. Right now, the solution has only been developed to accommodate Windows OS."
"The licensing costs are a little bit high and should be reduced."
"We were testing handheld barcode scanners running WindowsCE with many menus of warehouse functions, and our biggest problem was the timing between input and responses."
"There could be API interfaces with this tool."
"The code editor, though following eclipse-style, is still a work in progress and gives a very poorly formatted code once viewed via other editing tools."
"I didn't use it very heavily. One issue that I found was that there wasn't a quick way or a button to move Visual Basic scripts to TestComplete. We have a lot of such scripts in our organization, and it would be very useful to have some option to easily move these scripts. It is currently possible to convert these scripts to TestComplete, but it is not easy. I have to write some code, but everything is not available immediately."
"At times, identifying or locating an element can be somewhat challenging. However, in a recent test update, they introduced Optical Character Recognition (OCR) capability. This introduction has reduced the challenges to some extent, as we can now utilize OCR if the normal method doesn't work. Nevertheless, there is still significant potential for improvement in TestComplete's ability to identify various object elements. I don't have any specific concerns to mention. I have observed significant improvements in TestComplete over the past few years, especially in its support for highly dynamic object elements used in products like Salesforce Dynamics 365. In earlier versions, there were numerous challenges, but the current version is far superior to its predecessors."
Katalon Studio is ranked 3rd in Test Automation Tools with 42 reviews while SmartBear TestComplete is ranked 7th in Test Automation Tools with 72 reviews. Katalon Studio is rated 7.8, while SmartBear TestComplete is rated 7.6. The top reviewer of Katalon Studio writes " Functional automation features and the recording functionality saves time but the performance and script execution is slow ". On the other hand, the top reviewer of SmartBear TestComplete writes "A stable product that needs to improve its integration capabilities with other test management tools". Katalon Studio is most compared with Tricentis Tosca, Postman, OpenText UFT One, Testim and Apache JMeter, whereas SmartBear TestComplete is most compared with Tricentis Tosca, Ranorex Studio, OpenText UFT One, froglogic Squish and Eggplant Test. See our Katalon Studio vs. SmartBear TestComplete report.
See our list of best Test Automation Tools vendors, best Regression Testing Tools vendors, and best Regression Testing Tools vendors.
We monitor all Test Automation Tools reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.