Manager of Organizational Development at Banco Pichincha
Real User
Has a custom chat in the IDE, a good tutorial, and the ability to always update the solution

What is our primary use case?

I made functional scripts with Katalon Studio integrated with GitLab for another company. For now, I need to know about other tools in order to make functional tests for apps. 

How has it helped my organization?

Katalon Studio is easy to install and to learn for other technical people who work in quality assurance and don't work in developing software for a long time. In the other company, they always use Katalon to build the principal test of the business that they need to run when there are changes. 

What is most valuable?

Easy to learn, I don't need to have any expertise in software development. This tool has a custom chat in the IDE, a good tutorial, and I can always update the solution. I like to work with Gherkin language, and I think that I can have results very soon with Selenium. On the other hand, in the same framework, I can work with web applications, mobile applications or web services, and I can record a test in one browser and run it in another browser.

What needs improvement?

I would like if this tool can work without any problems for React Native.

Buyer's Guide
Katalon Studio
March 2024
Learn what your peers think about Katalon Studio. Get advice and tips from experienced pros sharing their opinions. Updated: March 2024.
769,599 professionals have used our research since 2012.

For how long have I used the solution?

One to three years.
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Practice Director - QA and SW Testing Services at a tech services company with 1,001-5,000 employees
MSP
Complete solution for testing on a variety of platforms
Pros and Cons
  • "Our clients have requested by all types of testing, including mobile, desktop, and API testing and all of those are covered by Katalon. I find that very valuable, very complete."
  • "I've seen that our clients are not truly aware of the power behind Katalon."

What is our primary use case?

Our primary use is for web automation.

We are an IT consulting services company. As part of our services, we provide testing services. That is why we are constantly looking for some tools and frameworks that might fit with our clients' needs.

We call ourselves agnostic, which means we are not going to be with only one provider. However, I've seen very powerful things behind the Katalon.

What is most valuable?

I find Katalon Studio to be a very complete product. Our clients have requested all types of testing, including mobile, desktop, and API testing and all of those are covered by Katalon. I find that very valuable, very complete.

What needs improvement?

I've seen that our clients are not truly aware of the power behind Katalon. Many of the clients are now ready for the traditional Selenium, perhaps a more friendly layer like Cucumber or SpecFlow. But I think they will understand if we start doing automation with Katalon and they would be much more interested. The automation developers are starting to have really high demand and the salaries have increased, so with Katalon they might be interested in two things - the velocity of testing plus bringing manual testing to the automation world.

For how long have I used the solution?

I have been using Katalon Studio for about a half year, now. I use it for demo purposes with our clients.

Which solution did I use previously and why did I switch?

We previously utilized Katalon for demo purposes. We also used Selenium, not Selenium HQ, but Selenium alone. And I think we are utilizing Cypress and Cucumber with Selenium, in different flavors of languages, et cetera.

What's my experience with pricing, setup cost, and licensing?

I haven't precisely checked the business model behind Katalon, and I would like to understand that as well, because most of our clients ask for licenses and prices, and we don't know. From my understanding, the basic version is free, but it would be interesting to understand the full package.

What other advice do I have?

On a scale of one to ten, I would give Katalon Studio an 8.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Buyer's Guide
Katalon Studio
March 2024
Learn what your peers think about Katalon Studio. Get advice and tips from experienced pros sharing their opinions. Updated: March 2024.
769,599 professionals have used our research since 2012.
QA Architect at a media company with 201-500 employees
Real User
Easy to setup, with fast automation and not overly technical
Pros and Cons
  • "The automation is very fast and you don't need to be overly proficient in coding."
  • "There could potentially be more reporting within the solution. We need more issue reports, for example."

What is our primary use case?

We will primarily use the solution for regression testing.

What is most valuable?

Katalon is very easy to record and then we can use the identifiers very easily. Katalon automatically gets you all the identifiers. It's very user-friendly. How it finds the objects and gets the identifiers is excellent.

The initial setup is very easy.

The automation is very fast and you don't need to be overly proficient in coding.

What needs improvement?

I just started using it, however, if I get the demo, I'm looking for mobile as well, so that I can get more area on it. As of right now, I don't have that much. I'm just starting with it. Once I get to be a full-fledged user, then I can give better input.

There could potentially be more reporting within the solution. We need more issue reports, for example. 

For how long have I used the solution?

We've only been using the solution for a couple of months at this point. It's still pretty new to us. We're still exploring the product.

What do I think about the stability of the solution?

We are still very new to the solution and we need more time to test the stability, to see if it is reliable. We haven't had any problems just yet, however, we haven't had enough time with the product to really make a judgment call on stability.

What do I think about the scalability of the solution?

We are still simply exploring the solution and therefore only have maybe ten users on the solution at this time.

How are customer service and technical support?

I've never had an opportunity to interact directly with technical support. I cannot speak to how helpful or responsive they are.

Which solution did I use previously and why did I switch?

We have used Selenium in the past.

How was the initial setup?

We did not find the initial setup to be very difficult or complex. It was straightforward. It was easy. A company shouldn't have any trouble with the process.

We were using the trial version and it was very easy to install.

What about the implementation team?

We mostly installed the trial version ourselves, although we were in touch with Katalon during the process.

Which other solutions did I evaluate?

Before implementing Katalon, we compared it with Selenium, which we were already using.

If a user has good programmatic skills, I'd go for Selenium. Otherwise, due to its relative speed and faster automation, I'd go for Katalon.

What other advice do I have?

We want to use Katalon Studio RE. I had a call with the salesperson. He said that he'll arrange one day a demo, however, that has not been scheduled yet.

In general, I would rate the solution at a seven out of ten.

I'd recommend it specifically for users that don't have that much programming prowess.

Which deployment model are you using for this solution?

On-premises
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Team Leader at a tech vendor with 10,001+ employees
Real User
Top 5
A good testing solution in a single application environment, but lacking in integration with reporting tools
Pros and Cons
  • "The recording feature of this product is very valuable for our testing purposes."
  • "We would like to see improved integration with various reporting tools; this would make our testing data more complete."

What is our primary use case?

We are currently trialing the solution's test automation functionality.

What is most valuable?

The recording feature of this product is very valuable for our testing purposes.

What needs improvement?

We would like to see improved integration with various reporting tools; this would make our testing data more complete.

For how long have I used the solution?

We have been working with this solution for six months.

What do I think about the stability of the solution?

We have found the solution to be stable during our trials.

What do I think about the scalability of the solution?

The solution is easily scalable in our experience.

How are customer service and support?

We have found the technical support for this product to be very good, and knowledgeable.

How would you rate customer service and support?

Positive

How was the initial setup?

The setup of this solution was very simple for a simple web application, and deployment only took 20 minutes.  However, for multiple applications, the lack of integration makes implementation a longer process.

What other advice do I have?

We would recommend this product for a standalone web application use case, but we would suggest that any business using multiple web applications, should try the solution beforehand using the open-source version that is available.

I would rate this solution a seven out of ten.

Which deployment model are you using for this solution?

Public Cloud
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Software Test Engineer at a tech services company with 1,001-5,000 employees
Real User
User-friendly with good object recognition, and priced well
Pros and Cons
  • "One of the features that I like is Object Recognition. It worked very well, and it allowed me to create a dynamic expert based on my requirements."
  • "Now we are having difficulties in using it and had to limit our automation experts to the features that Katalon allows us to use for free. It was free access and they claimed that it would be free for all time."

What is most valuable?

It's very user-friendly and convenient. The forum and the people who use Katalon have been very helpful.

One of the features that I like is Object Recognition. It worked very well, and it allowed me to create a dynamic expert based on my requirements. It was amazing and helped me resolve some of the issues that I was having.

Previously with another application, we had to create an expert dynamically and used the running of tests which provided a solution for it.

What needs improvement?

It would be helpful if we could develop from scripts in other languages. For example Python. It would be more convenient than working with Jira and Java. For some of my colleagues who don't have the knowledge in the development, it is easier to work with Python rather than with Java.

After two years of using this solution for free, we were limited in the features that we could use and had to start to pay for them. Now, we are having difficulties in using it and had to limit our automation experts to the features that Katalon allows us to use for free. It was free access and they claimed that it would be free for all time.

I would like to see it integrate other tools other than Jira, and to have support in other development languages would be helpful.

For how long have I used the solution?

I have been working with Katalon Studio for over a year.

What do I think about the scalability of the solution?

We have three users in our organization who are using this product.

How are customer service and technical support?

My experience with technical support was that they were kind and friendly, but when I spoke with them regarding the pricing issue and the free solution, they were not as kind.

In other read or questions and requests, they are very kind and friendly. 

Also, they have a forum that is very useful.

Which solution did I use previously and why did I switch?

Previously, we have used other applications and API. For some projects, we use a combination of applications and API.

How was the initial setup?

The initial setup was easy and straightforward. 

I didn't have any requirements.

It took a month to deploy 10 automating services.

What's my experience with pricing, setup cost, and licensing?

Katalon Studio was offered free at first, and we could easily use it. After two years, some of the features were limited and we had to pay. Because of the sanctions, we had difficulties in being able to use a solution and having to pay for it. Our economic situation is not good and has created many difficulties.

The price is reasonable, but our sanctions do not allow us to pay for any international tools.

We have to find other companies to pay for us, without it costing us any money.

The price is not high, it's good. 

Which other solutions did I evaluate?

My colleagues and I did a comparison between Ranorex Studio and Katalon Studio. 

Katalon Studio provides us with a free solution for some of our basic features. Ranorex is very expensive for us. Both are user-friendly and we can work with both of these solutions easily.

What other advice do I have?

Once we developed a new solution, Katalon was no longer free, and we had to pay for all of the features.

Katalon has provided me with a solution to the issues and limitations that I was experiencing.

I have many limitations and issues with automating their application. I did not use the mobile features offered by Katalon Studio.

I would recommend it for anyone who doesn't want to be involved in developing a lot. some people want to use some resources to automate the application of their data system.

I think that if you have some knowledge of development and using Python in addition to Robot Framework, Framework is better. It allows them to do whatever they want.

For those who do not have development knowledge, I would recommend Katalon Studio.

I would rate Katalon Studio an eight out of ten.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Senior Test Engineer at a tech services company with 51-200 employees
Real User
Provides cost-effective functional testing for web-based GUIs
Pros and Cons
  • "We can write code in Java and it is easy to link to other JARs that we find on the internet, which is very handy."
  • "The Object Spy is rather frustrating to work with, so I tend not to use it."

What is our primary use case?

We use this solution for functional testing on some backends, APIs, the ServiceNow GUI, and other web GUIs. 

We have it running on a few machines, in-house. Each developer downloads it to their machine, and we also have it running on a test server. 

What is most valuable?

This solution is written in Groovy, which means that we can write Groovy scripts that work with it. We can write code in Java and it is easy to link to other JARs that we find on the internet, which is very handy.

From a user's perspective, this solution is better than Micro Focus UFT.

The documentation for this solution could be improved. However, it is a freeware, and the documentation is still better than that of UFT.

What needs improvement?

At the moment, this solution only works for web-based products. It's sort of like a Selenium wrapper, which is quite well done.

The Object Spy is rather frustrating to work with, so I tend not to use it. Instead, I just go and look at the objects in the HTML code, in Chrome for example. A more user-friendly Object Spy would be an improvement.

I would like to see the extension to other GUIs such as Windows and SAP.

For how long have I used the solution?

We have been using this solution for less than six months.

What do I think about the stability of the solution?

The stability of this solution is good and improving.

What do I think about the scalability of the solution?

This product is installed on your own client, and it runs fine there. Scalability is not really an issue. There are two of us using this solution at the moment, and we plan on maybe going up to three or four. There is only a certain amount of testing and automation required for our project.

How are customer service and technical support?

Technical support for this solution is mainly through forums, and the forums are quite good. 

Which solution did I use previously and why did I switch?

We are trying to get away from Micro Focus products because they're extremely expensive. For functional testing, we're migrating to Katalon Studio, for example. 

In the organization as a whole, people are using UFT from Micro Focus, and they are paying a lot of money for it. From the perspective of the user, I would say that this solution is better than UFT, and would encourage people to migrate from UFT to Katalon.

Personally, I have also used Rational Functional Tester, Tricentis Tosca, and Ranorex.

Tosca has a very good analysis, but if you're working with complex web GUIs, such as Angular for example, then Tosca is a pain in the neck. Tosca is more for test analysis.

Ranorex is a good product and it is more flexible. I believe that it can handle Windows GUIs, which Katalon cannot do at the moment. However, Katalon is free, and they are also implementing Winium if we should have the need for Windows GUIs.

How was the initial setup?

The initial setup is straightforward. You just download a ZIP file, copy the contents of it into a directory, and you're ready to go. It is a bit like installing Eclipse. The deployment is quick.

What's my experience with pricing, setup cost, and licensing?

This product is freeware, so there is no charge for using it.

There is a paid service available that offers a cloud database where you can store your test cases, pull your test executions, get reports, etc. We're not currently using this service so I cannot comment on it.

Which other solutions did I evaluate?

I was recently tasked with looking at different testing tools, and I evaluated several including Katalon. Once I tried it, I liked it, and so far we've been happy with it.

What other advice do I have?

My advice for anybody who is considering this project to have some familiarity with Groovy and Java. If you don't like coding then it will not be the product for you. Otherwise, in our experience, it's a good product. It is well thought through and continues to improve.

This solution semi-automatically updates to the latest version, so it is always up to date.

I would rate this solution an eight out of ten.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
it_user752019 - PeerSpot reviewer
QA Engineer at a tech company with 11-50 employees
Vendor
It scales well, supporting the execution of large test suites

What is most valuable?

  1. Katalon Studio provides the team much flexibility to adapt to various situations to address a problem appropriately. There are certain test cases that can only be tested manually, but Katalon allows the team to automate as many test cases as possible.
  2. The “Debug from here” feature reduces the debugging time considerably.
  3. It produces detailed and useful logs, helping the team to detect a defect’s root causes easily.
  4. It scales well, supporting the execution of large test suites.
  5. It can be used to verify various issues, ranging from minor errors like typos to performance and stability problems of the system.

How has it helped my organization?

Before using Katalon Studio, we spent weeks to verify all test cases manually for every major build. Now, we need only several days to fully perform regression testing, reducing the time to market greatly.

What needs improvement?

While the web testing is great, we expect more from the API testing.

For how long have I used the solution?

More than six months.

What was my experience with deployment of the solution?

No. It's very easy to deploy.

What do I think about the stability of the solution?

Rarely.

What do I think about the scalability of the solution?

Not yet.

How are customer service and technical support?

Customer Service:

They provide very good customer service.

Technical Support:

Excellent, since they promptly respond to our requests.

Which solution did I use previously and why did I switch?

Robot Framework. However, it required more technical involvement, so the dev team needed to join and spent time setting up before our QA could join.

What about the implementation team?

In-house.

What was our ROI?

After several years using Katalon Studio, the team now already automates more than 20% of the test cases, saving much of the verification time as well as exceeding the target set when starting the test automation effort.

What's my experience with pricing, setup cost, and licensing?

The tool has been completely free until now.

Which other solutions did I evaluate?

TestComplete and UFT. They're all costly.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
PeerSpot user
Software QA Engineer at a tech vendor with self employed
Vendor
Can convert the test steps from manual mode to script mode and vice versa.

What is most valuable?

  • Ability to convert the test steps from manual mode to script mode and vice versa.
  • The web recording feature is very amazing and helpful in capturing test steps as user interacts on websites.
  • Can create common test cases for later re-use.
  • Can define custom keywords.
  • Supports data-driven testing.
  • Free.

How has it helped my organization?

We achieve better productivity with this tool because of easily created, stored, maintained tests. We don't have to perform again and again every manual test step when it comes to regression. Moreover, this tool also solves our problem of having too many manual testers that are afraid of writing scripts.

What needs improvement?

  • Restricted choice for scripting language (just Groovy).

For how long have I used the solution?

I have used this tool for three months and still do not want to leave it.

What was my experience with deployment of the solution?

I did not encounter any deployment issues.

What do I think about the stability of the solution?

I did not encounter any stability issues.

What do I think about the scalability of the solution?

I did not encounter any scalability issues.

How are customer service and technical support?

Customer Service:

Customer service is 8/10.

Katalon Studio customer service is good and fast. They rapidly answer users' questions and usually do surveys to enhance the performance.

Technical Support:

Technical support is 9/10.

Thank the technical support team for their help. I appreciate their efforts on giving us quick and correct answers. Their answers are always on point and polite.

Which solution did I use previously and why did I switch?

I previously used TestComplete, but now I use Katalon Studio because it matches my job requirements and it is free.

How was the initial setup?

Initial setup was easy.

What about the implementation team?

An in-house team implemented it. I think the tool can be easily implemented by an in-house team.

What was our ROI?

The learning curve is not steep, and it is quite easy to get used to it. I'm sure it won't take you much time, but the results will be worth it many times over. Plus, it's free, so especially teams with a low budget will find it worth investing.

What's my experience with pricing, setup cost, and licensing?

It's free (freeware license). So, go ahead!

Which other solutions did I evaluate?

Before choosing this product, I also evaluated Selenium, TestComplete, and Telerik.

What other advice do I have?

I think Katalon Studio and the team behind it did a great job. The tool is not only useful but also cost-effective. I think they are continuing to upgrade the tool (really hope so). I and other users will be very happy with upcoming astonishing features.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user