Katalon Studio vs SmartBear TestComplete comparison

Cancel
You must select at least 2 products to compare!
Katalon Studio Logo
7,480 views|5,117 comparisons
88% willing to recommend
SmartBear Logo
5,647 views|3,948 comparisons
85% willing to recommend
Comparison Buyer's Guide
Executive Summary

We performed a comparison between Katalon Studio and SmartBear TestComplete based on real PeerSpot user reviews.

Find out in this report how the two Regression Testing Tools solutions compare in terms of features, pricing, service and support, easy of deployment, and ROI.
To learn more, read our detailed Katalon Studio vs. SmartBear TestComplete Report (Updated: March 2024).
768,857 professionals have used our research since 2012.
Featured Review
Quotes From Members
We asked business professionals to review the solutions they use.
Here are some excerpts of what they said:
Pros
"It has been good so far for API testing on Mac. It is not that hard to learn and use. There is so much support out there, so if anyone wants to start using it, there is enough help.""I personally like the 'Object Spy' feature of this tool. It makes it easy to find an element on the web page.""The initial setup is pretty straightforward and easy enough to complete.""It supports multiple easy-to-learn languages.""It is easy for a non-technical person to use and adopt.""The best feature is the split up between test cases and the test object. This allows us to easily change an error.""The most valuable features of Katalon Studio are its user-friendliness and the AI smart healing capabilities.""The most important feature is the Jenkins integration; it is pretty straight forward and allows us to run nightly builds."

More Katalon Studio Pros →

"This company offers end-to-end capabilities for test suite creation and execution. One feature that I particularly appreciate is the tagging system. Tags are highly valuable, as they allow you to assign tags to your test cases. When there's an impact in a specific area, you can search for and run all test cases associated with that tag. I find this functionality very useful.""Test items, project variables helps in managing automation suite and scheduling execution.""You can record your actions and play them back later.""The solution is mainly stable.""It's cross platform automation capabilities specially ranging across web, UNIX (via putty), and other systems.""Runs in different remote machines. We have multiple versions of the software being tested.""It works very fine. It is fast on almost any machine, and it is also very well organized. I like its object mapping and its capability to find and interact with almost everything that exists on Windows.""The solution has a very nice interface."

More SmartBear TestComplete Pros →

Cons
"The free version of the solution is not user friendly at all.""We would like to see improved integration with various reporting tools; this would make our testing data more complete.""I can say that in my company, we struggle a lot with iOS automation.""Katalon doesn't support testing of hybrid applications. It's a limitation.""It seems to lack a few requirements that a typical customer would want. Compared to other solutions, this product is lacking.""Currently, I'm the only one who can use it because I have a Mac. It is giving a hard time to my team members who are on Linux. My team members are using Linux, and Katalon doesn't support Linux very well. It keeps on crashing. It crashes and shuts down almost every time they save their work, so they are not able to use it. It should have good support for Linux. We don't know what the problem is. If the Katalon team can pick up this issue, it will be very helpful.""What it lacks is the Selenium Grid capabilities.""I've seen that our clients are not truly aware of the power behind Katalon."

More Katalon Studio Cons →

"At times, identifying or locating an element can be somewhat challenging. However, in a recent test update, they introduced Optical Character Recognition (OCR) capability. This introduction has reduced the challenges to some extent, as we can now utilize OCR if the normal method doesn't work. Nevertheless, there is still significant potential for improvement in TestComplete's ability to identify various object elements. I don't have any specific concerns to mention. I have observed significant improvements in TestComplete over the past few years, especially in its support for highly dynamic object elements used in products like Salesforce Dynamics 365. In earlier versions, there were numerous challenges, but the current version is far superior to its predecessors.""The code editor, though following eclipse-style, is still a work in progress and gives a very poorly formatted code once viewed via other editing tools.""The licensing costs are a little bit high and should be reduced.""The initial setup of SmartBear TestComplete was complex.""I didn't use it very heavily. One issue that I found was that there wasn't a quick way or a button to move Visual Basic scripts to TestComplete. We have a lot of such scripts in our organization, and it would be very useful to have some option to easily move these scripts. It is currently possible to convert these scripts to TestComplete, but it is not easy. I have to write some code, but everything is not available immediately.""The solution needs Mac OS support. Right now, the solution has only been developed to accommodate Windows OS.""TestComplete gives support to do requests to a SOAP web service but has no support to do HTTP requests on Restful services.""Increased performance with less memory and CPU usage."

More SmartBear TestComplete Cons →

Pricing and Cost Advice
  • "There is no cost for setup or licensing."
  • "This product is freeware, so there is no charge for using it."
  • "The tool is free to use."
  • "It is freeware software, so start using it."
  • "There is a free version of the tool to use and support is available through the community forums, but there is a licensed version as well."
  • "We were using the free version of this tool."
  • "Katalon Studio is a free tool."
  • "We are using the free version of Katalon Studio at this point."
  • More Katalon Studio Pricing and Cost Advice →

  • "The product is becoming more and more expensive."
  • "My advice so far, is that while it’s not quite as powerful and easy to use as UFT, its price tag more than makes up for it."
  • "The price is less, compared to other products, such as QTP."
  • "Buy modules on demand. If you have a four-person team and they will each automate tests only 25% of the time, it's better to buy a floating licence and share the tool during the work day."
  • "TestComplete now have come up with three modules (Web, Desktop & Mobile), so based on the type of product for automation, it is adequate to purchase the required module."
  • "This is a pay-per-use service that is not expensive, and cost-efficient if you have a small team."
  • "The option we chose was around $2,000 USD."
  • "The licensing costs are in the range of $1,000 to $3,000."
  • More SmartBear TestComplete Pricing and Cost Advice →

    report
    Use our free recommendation engine to learn which Regression Testing Tools solutions are best for your needs.
    768,857 professionals have used our research since 2012.
    Questions from the Community
    Top Answer:It is a good tool and provides all the essential features for our business requirements.
    Top Answer:The product is affordable. It has an average and competitive pricing compared to other vendors.
    Top Answer:Katalon Studio's pricing is expensive.
    Top Answer:This company offers end-to-end capabilities for test suite creation and execution. One feature that I particularly appreciate is the tagging system. Tags are highly valuable, as they allow you to… more »
    Top Answer:There are certain challenges related to the license management system in place. It comes with a high cost. An annual price is around four thousand five hundred plus per user, whereas UiPath is only… more »
    Top Answer:At times, identifying or locating an element can be somewhat challenging. However, in a recent test update, they introduced the Optical Character Recognition (OCR) capability. This introduction has… more »
    Ranking
    3rd
    Views
    7,480
    Comparisons
    5,117
    Reviews
    17
    Average Words per Review
    387
    Rating
    7.4
    6th
    Views
    5,647
    Comparisons
    3,948
    Reviews
    7
    Average Words per Review
    503
    Rating
    7.1
    Comparisons
    Learn More
    Overview

    Katalon Studio is a regression testing tool that enables you to go low-code, boost productivity, and ease scalability. It is suitable for all platforms and operating systems, regardless of application complexity. The software is built on top of the open-source automation frameworks Selenium and Appium, with a specialized IDE interface for web, API, mobile, and desktop application testing. As a robust automation tool, Katalon Studio lets you run automated tests of UI elements, including pop-ups, iFrames, and wait time. The solution is ideal for both large and small organizations.

    Katalon Studio Features

    Katalon Studio has many valuable key features. Some of the most useful ones include:

    • Object spying
    • Record and playback
    • Content assist utilities
    • Advanced debugger
    • Reusable test artifacts
    • Fast scripting with keyword-driven testing
    • BDD convention supported
    • Flexible test listener
    • Extensive data-driven testing
    • Self-healing
    • Test scheduling and parallel execution
    • Native CI/CD integrations

    Katalon Studio Benefits

    There are many benefits to implementing Katalon Studio. Some of the biggest advantages the solution offers include:

    • Versatile abilities: The solution enables you to identify, capture, and store all on-screen objects. Additionally, you can view every single property, method, field, and event in detail. You can create tests twice as fast with low-code options, recycle recorded artifacts, and also work from any steps on active browsers.
    • Built-in project templates: Katalon Studio’s ready-made test scenarios, keywords, and object repositories allow you to get started quickly.
    • One place for end-to-end testing: With the solution, you can combine all of your activities for web UI and API testing in one single project.
    • Flexible test design options: Katalon Studio is equipped with manual and scripting modes for both beginners and advanced users.
    • Broad data support: The solution supports multiple data sources (XLS, CSV) and databases with effective parameterization to maximize test coverage.
    • Smart runtime engine: Because of its smart runtime engine, Katalon Studio can streamline test execution and lower maintenance efforts.

    Reviews from Real Users

    Katalon Studio is a solution that stands out when compared to many of its competitors. Some of its major advantages are that it has a valuable record and playback feature, is user friendly, and has fantastic integration capabilities.

    Khurram K., Head of SQA, Project Manager at Vroozi, says, "The best thing about the solution is that there is a record and playback functionality. The solution allows for specific object files [and it] has great multi-parallel languages that work in the facilities here.”

    Another PeerSpot user expresses the multiple benefits the solution provides for him exclaiming, “I'd describe it as extremely user-friendly. There's a lot of information that is readily available on the internet, and therefore it's easy to learn about the product itself. The scalability of the product is good. The solution was quite stable throughout the time I used it. We found the installation process to be quite simple. There is also very helpful online documentation that can help you if you ever get stuck during the implementation process itself,” comments a Senior Quality Assurance Analyst at an educational organization.

    Tinnaphan W., Professional Services Manager at a non-profit, talks about the Katalon Studio’s advantages. He mentions, “The solution has very good integration capabilities overall. The client has an extremely stable testing framework, and therefore they rely on Katalon to get the results. The reporting is very good.”

    What is SmartBear TestComplete?

    TestComplete is a reliable, sturdy automated testing platform created by SmartBear Software. SmartBear Software is a worldwide technological leader known for developing quality enterprise-class development and testing solutions.

    TestComplete simplifies the process of creating tests for numerous applications, including, but not limited to; Desktop, Android, IOS, Web browsers, and Windows. Application tests can be manual, scripted, and even recorded by using keyword-driven or data-driven functionality. There are even additional options for error reporting and automated playback. The object repository is extremely accurate and is fully customizable. TestComplete can easily be used by experienced developers and even by manual novice testers to develop quality automated UI tests quickly.

    TestComplete offers three different testing scenarios:

    • Desktop: Users can easily and quickly automate UI tests using today’s most popular desktop applications, such as; Windows, Java, Python,.Net, VBScript, and more.

    • Web: Users can effortlessly create renewable tests for all of today’s popular web applications, including JavaScript frameworks on 2000+ trusted browser and platform integrations.

    • Mobile: Users can safely build and automate serviceable UI tests on actual or virtual android or IOS devices, locally or in the cloud. Users can create code or codeless tests. TestComplete seamlessly integrates with many of today’s popular frameworks.

    Key Features

    • Easily create automated UI tests: TestComplete offers scriptless Record and Replay or simple keyword-driven tests to quickly develop any type of UI test users may require. Tests can be recorded once, then replayed when needed across various applications on mobile, web, or desktop environments. TestComplete integrates with many different languages, such as Java, Python, C+, and more.

    • Keyword driven tests: Users can easily divide testing steps, actions, objects, and data with an integrated keyword-driven test structure. This makes it easy for every user to participate in the test automation process; there is no programming experience needed. Everything is made simple with easy-to-use point-and-click options.

    • Data driven tests: Easily distinguish data from test commands to keep administrative efforts simple. Users can improve overall coverage by running various automated mobile, desktop, or web UI tests.

    • Record and Replay: Users can reuse created automated tests across every environment as often as desired. This helps to expand overall test coverage and represents a huge cost and time savings.

    Reviews from Real Users

    Sandhiya T S., Sr Solutions Engineer at Lexington Soft, relates, “The record and replay aspects of the solution are quite useful for people. With them, you don't have to write any scripts. Basically, you can record your actions and play them back later. The initial setup is also very easy.”

    Sai S R., Staff Test Architect at a tech services company, says, "The most valuable features of the SmartBear TestComplete are self-healing, they reduce the maintenance required. The different languages SmartBear TestComplete supports are good because some of our libraries are written in Python, JavaScript, and C#. It's very easy to put them all under one project and use them."

    Sample Customers
    Coca-Cola Tesla Black Board TaTa Consultancy Services Sony
    Cisco, J.P. Morgan, Boeing, McAfee, EMC, Intuit, and Thomson Reuters.
    Top Industries
    REVIEWERS
    Computer Software Company30%
    Financial Services Firm15%
    Non Tech Company10%
    Transportation Company5%
    VISITORS READING REVIEWS
    Educational Organization28%
    Computer Software Company15%
    Financial Services Firm10%
    Manufacturing Company6%
    REVIEWERS
    Computer Software Company31%
    Manufacturing Company13%
    Financial Services Firm9%
    Comms Service Provider6%
    VISITORS READING REVIEWS
    Computer Software Company18%
    Manufacturing Company11%
    Financial Services Firm11%
    Government7%
    Company Size
    REVIEWERS
    Small Business42%
    Midsize Enterprise21%
    Large Enterprise37%
    VISITORS READING REVIEWS
    Small Business18%
    Midsize Enterprise35%
    Large Enterprise47%
    REVIEWERS
    Small Business28%
    Midsize Enterprise28%
    Large Enterprise45%
    VISITORS READING REVIEWS
    Small Business24%
    Midsize Enterprise14%
    Large Enterprise62%
    Buyer's Guide
    Katalon Studio vs. SmartBear TestComplete
    March 2024
    Find out what your peers are saying about Katalon Studio vs. SmartBear TestComplete and other solutions. Updated: March 2024.
    768,857 professionals have used our research since 2012.

    Katalon Studio is ranked 3rd in Regression Testing Tools with 41 reviews while SmartBear TestComplete is ranked 6th in Regression Testing Tools with 70 reviews. Katalon Studio is rated 7.8, while SmartBear TestComplete is rated 7.6. The top reviewer of Katalon Studio writes "Useful multiple technology platform, scalable, but usability could improve". On the other hand, the top reviewer of SmartBear TestComplete writes "A stable product that needs to improve its integration capabilities with other test management tools". Katalon Studio is most compared with Tricentis Tosca, Postman, OpenText UFT One, Appium and Apache JMeter, whereas SmartBear TestComplete is most compared with Tricentis Tosca, Ranorex Studio, OpenText UFT One, froglogic Squish and Eggplant Test. See our Katalon Studio vs. SmartBear TestComplete report.

    See our list of best Regression Testing Tools vendors, best Test Automation Tools vendors, and best Regression Testing Tools vendors.

    We monitor all Regression Testing Tools reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.