Director of Products at Computer Team SA
Real User
Top 20
AI quality platform used for UI and API testing with the ability to build code libraries
Pros and Cons
  • "The ability to build all libraries with codes and use them in many situations has been most valuable."
  • "What it lacks is the Selenium Grid capabilities."

What is our primary use case?

We use the Community Edition and use it for UI and API testing. 

What is most valuable?

The ability to build all libraries with codes and use them in many situations has been most valuable. It has a very good recorder and the ability even to connect with databases to test data and use it in your scripts.

It gives you full access to all the properties of the browser or the network so you can customize the API scripts or UI scripts.

What needs improvement?

What it lacks is the Selenium Grid capabilities. 

For how long have I used the solution?

I have been using this solution for six months. 

Buyer's Guide
Katalon Studio
March 2024
Learn what your peers think about Katalon Studio. Get advice and tips from experienced pros sharing their opinions. Updated: March 2024.
769,630 professionals have used our research since 2012.

What do I think about the stability of the solution?

This is a stable solution. I would rate it an eight out of ten for stability. 

What do I think about the scalability of the solution?

This is a scalable solution. 

How are customer service and support?

We have only used the documentation and community support for this solution and both are good. 

Which solution did I use previously and why did I switch?

We have moved away from using this solution. The solution we are using now is super fast.

How was the initial setup?

The initial setup is straightforward. Without using the manual, it took me approximately 50 to 60 hours to start being very productive. 

What's my experience with pricing, setup cost, and licensing?

We chose this solution because of cost. It is an affordable solution. It was less than a thousand euros for a server which supports three live servers for a CI/CD pipeline. They do not charge for a license per developer. 

What other advice do I have?

I would advise others take advantage of the ability to use modern software engineering practices with Katalon Studio.

I would rate this solution an eight out of ten. It has features that I haven't found in many other products. It's very advanced in my opinion.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Professional Services Manager at a non-profit with 201-500 employees
Real User
Good testing framework with a straightforward setup but needs more features
Pros and Cons
  • "The initial setup is pretty straightforward and easy enough to complete."
  • "It seems to lack a few requirements that a typical customer would want. Compared to other solutions, this product is lacking."

What is our primary use case?

We primarily use the solution according to customer requests. We don't use it for a specific feature; we tend to use it when and if we are requested to. The client dictates that on their end. It's largely used as an automation testing tool. That's how it is meant to be used.

What is most valuable?

The solution has very good integration capabilities overall. 

The client has an extremely stable testing framework, and therefore they rely on Katalon to get the results. The reporting is very good.

The initial setup is pretty straightforward and easy enough to complete.

The stability, overall, seems to be reliable.

We haven't found the scalability to be lacking.

What needs improvement?

The solution could always add more features. It seems to lack a few requirements that a typical customer would want. Compared to other solutions, this product is lacking.

I'd like the integration with Jira to be a bit better. 

The pricing could be slightly improved. 

For how long have I used the solution?

I've been using the solution for about a year at this point. It hasn't been that long. We tend to switch back and forth, between solutions. We tend to switch month to month.

What do I think about the stability of the solution?

I haven't come across any stability issues. Our clients haven't complained. It's pretty much big and glitch-free. It does not crash or freeze. Our customers have found it to be reliable.

What do I think about the scalability of the solution?

We haven't found any limitations with the scalability. Our clients haven't hit any barriers as of yet. It's my understanding that the solution can scale. 

How are customer service and technical support?

I've never been in touch with technical support in the past. Therefore, I can't speak to how easy it is to get in touch with them, or how knowledgeable or responsive they are. Unfortunately, I have no insights to share. 

Our team often Googles questions and can find answers online if they need to.

How was the initial setup?

We did not find the initial setup to be overly complex or difficult. it was very straightforward. It was simple.

We have a team that can Google questions and find information online pretty easily if there is any maintenance that needs to be handled. We tend to handle the maintenance aspect for our clients. 

What's my experience with pricing, setup cost, and licensing?

It's my understanding that the pricing could be improved upon. I cannot recall the exact pricing. I cannot speak to the cost or licensing terms. We're just basically maintaining the solution for our clients. 

What other advice do I have?

We are just end-users and use it according to our client's requirements. We don't have a specific business relationship with Katalon.

Some customers use ALM, and we use Jira, due to the lower price. These help us with project management aspects. This solution isn't well known, as it might be in other countries. 

This solution is very useful for companies, such as banks or insurance organizations, that need something that can be used for commercial purposes. It's a good solution for enterprise-level companies.

I'd rate the solution at a seven out of ten. It's okay, however, if it offered more features to its customer base, it would be much better.

Disclosure: My company has a business relationship with this vendor other than being a customer: Integrator
PeerSpot user
Buyer's Guide
Katalon Studio
March 2024
Learn what your peers think about Katalon Studio. Get advice and tips from experienced pros sharing their opinions. Updated: March 2024.
769,630 professionals have used our research since 2012.
Mudasir Shafi - PeerSpot reviewer
Testing Lead at Enstoa
Real User
Flexible and cost-effective, but should include support for more frameworks
Pros and Cons
  • "The most valuable feature is that the browser and the API testing is available in a single tool, and I don't have to look at other options."
  • "There is not much support offered for the free version, which is something that could be improved."

What is our primary use case?

This is a product that I have been using personally, rather than professionally.

Katalon Studio is basically used for automation. One of the use cases is to automate products that my company is offering to our clients. Another use case is internal automation used to make our own development more efficient.  

What is most valuable?

The most valuable feature is that the browser and the API testing is available in a single tool, and I don't have to look at other options.

The flexibility that it offers is something that I like.

It supports the Cucumber BDD framework.

What needs improvement?

There is not much support offered for the free version, which is something that could be improved.

Support for more frameworks would be a really good addition to this tool

For how long have I used the solution?

I have been using Katalon Studio for about one year.

What do I think about the stability of the solution?

The stability is fine.

What do I think about the scalability of the solution?

Our use is still in the early phase, so we haven't yet looked at scalability or even how we can scale it up. There are only two of us using it at the moment.

How are customer service and technical support?

When you have a license, the technical support is really good. However, the free version doesn't offer as much as it should. As such, we have not yet reached out to them.

How was the initial setup?

The initial setup was straightforward. Once we had approval for the product, it did not take long to roll it out across the organization. I'm still building a case for it, although there isn't much in terms of roadblocks or issues.

What about the implementation team?

We have an in-house team for deployment so we are thinking about doing it entirely on our own.

What's my experience with pricing, setup cost, and licensing?

We are using the free version of Katalon Studio at this point.

Which other solutions did I evaluate?

Prior to choosing Katalon for testing, we were looking at Selenium and Telerik Test Studio. Katalon offers the free version, which allows us to play around with it. Also, the API and the mobile features are attractive.

What other advice do I have?

With respect to the free version, it is a product that I would recommend. However, at the enterprise level, I would have to evaluate the support and see what they have to offer with the licensed version.

Overall, this is a good tool but at this time, the support is something that I would like to see improved. 

I would rate this solution a six out of ten.

Which deployment model are you using for this solution?

On-premises
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Senior Quality Assurance Analyst at a educational organization with 501-1,000 employees
Real User
A simple installation with good video tutorials and great stability
Pros and Cons
  • "The scalability of the product is good."
  • "The price of the solution is a bit high. It's one of the reasons we decided not to continue using the product."

What is our primary use case?

For Katalon Studio we tried using it for record and play tasks. We could test it on Windows and different operating systems, such as macOS.

What is most valuable?

I did a small POC and during that time I found the product to be very easy to use. I'd describe it as extremely user-friendly.

There's a lot of information that is readily available on the internet, and therefore it's easy to learn about the product itself.

The scalability of the product is good.

The solution was quite stable throughout the time I used it.

We found the installation process to be quite simple. There is also very helpful online documentation that can help you if you ever get stuck during the implementation process itself.

What needs improvement?

As of now, the product has a complete packet and they could develop more on it. It definitely could improve the interface as well for mobile. While I didn't use it too much while I was working with the solution at the time, I am using mobile a lot now, and I see how helpful it is to have a good interface in place. 

The price of the solution is a bit high. It's one of the reasons we decided not to continue using the product.

For how long have I used the solution?

I didn't use the solution for very long. I did a small POC for about one month or so.

What do I think about the stability of the solution?

The stability of the solution was quite good. There are no bugs or glitches. It doesn't crash or freeze. It's reliable and the performance is great.

What do I think about the scalability of the solution?

The solution is quite scalable. If you go ahead and use the paid version, you can expand it as you need to.

At the time, we had eight to ten people using the solution, however, we are no longer using it, and therefore do not have plans to scale or increase usage.

How are customer service and technical support?

I personally never dealt with technical support. We had a team member in DevOps that would sometimes touch base with them. I can't speak to any personal experience, however.

Which solution did I use previously and why did I switch?

We have used, and continue to use, an in-house automation tool. When that company developed our SIEM work, we built custom SEIM for work in Java and Selenium.

We simply tried Katalon as we were using different operating systems and we wanted to try a solution that worked across them.

How was the initial setup?

The initial setup was not complex at all. The installation was very easy. The configuration, as well, was very straightforward. There are videos online that really help in walking you through the process. If you get stuck at any point you can watch them and they really help navigate you through the process.  

I can't recall exactly how long the process took to complete. 

In terms of maintenance, basically, there was one DevOps employee who was doing everything related to the maintenance part. We also had a manager heading it up. We were basically in different scrum teams and we were working on the same product. We only needed one person to look after everything and manage it as necessary. 

What's my experience with pricing, setup cost, and licensing?

Originally, we did pay a licensing fee, however, the company decided not to continue with the product in the end. For us, it was too expensive.

What other advice do I have?

On Katalon I didn't work much. I did a small POC and it was just for one month. After that, I switched back to our native and our custom in-house automation tool.

We didn't deploy it on the cloud due to the fact that initially, it was freeware, and then it got paid. At that point, our company was not interested in investing that amount of money into a new product when they had their own custom-built solution. They were parallelly building the automation framework in Java and Selenium. They're using test engines for reporting. Going forward, we will be using this framework and not Katalon.

I would recommend the solution to others. I would rate it at an eight out of ten.

Which deployment model are you using for this solution?

On-premises
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Étudiant at Edifixio
Real User
A free tool with good functionality and reporting features
Pros and Cons
  • "The functionality of the data is very good. You can upload and disperse data using the solution."
  • "Katalon doesn't support testing of hybrid applications. It's a limitation."

What is most valuable?

The functionality of the data is very good. You can upload and disperse data using the solution. The reporting is excellent as well.

What needs improvement?

The browsing is messy. The solution tends to rush the tests on multiple processes. That doesn't work in most cases. They need to write a different script for the same test case on the cloud and another script to run the test on Firefox, for example.

Also, in terms of reporting, in the documentation, it's mentioned that Katalon takes screenshots if the test case fails. But not on all test cases. I need to take screenshots manually.

Often, running parallel test cases at the same time doesn't work. If it launches the first test case and it tries to launch the second test case at the same time, for example, the first test case will finish but the second will not stop. A lot of people are talking about this issue on the forums.

The application is prone to freezing when it loads.

Katalon doesn't support testing of hybrid applications. It's a limitation.

For how long have I used the solution?

I've been using the solution for one month.

What do I think about the stability of the solution?

In general, the solution is stable.

What do I think about the scalability of the solution?

For one machine it's good and easy to use. With this solution, you want to limit yourself to small tests.

How are customer service and technical support?

Technical support isn't very good. I've had problems where I couldn't find answers within the community. I've never used the ticket support system, although they do have one. I've mostly relied on the community to source answers.

Which solution did I use previously and why did I switch?

We previously used Selenium HQ.

How was the initial setup?

The initial setup was a local setup; I simply downloaded it from the website.

What about the implementation team?

I implemented the solution myself.

What's my experience with pricing, setup cost, and licensing?

The tool is free to use.

What other advice do I have?

We are using the cloud deployment model.

I would recommend the tool. For a free solution, it's very good.

I would rate the solution eight out of ten.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Senior Search Engineer at a financial services firm with 51-200 employees
Real User
Good support, reasonable price, and allows us to define a model to represent a website and reuse its components
Pros and Cons
  • "I like the feature where you can define a model that represents your website and then reuse the components from the model. It makes creating more test cases easy."
  • "One improvement would be if it could support more programming languages such as JavaScript or Python. Right now, it is only on Groovy, which I think is not a too popular language."

What is our primary use case?

I use it for automated testing. I am not using the latest version because their patches come out rather quickly. I can't patch as quickly.

What is most valuable?

I like the feature where you can define a model that represents your website and then reuse the components from the model. It makes creating more test cases easy.

What needs improvement?

One improvement would be if it could support more programming languages such as JavaScript or Python. Right now, it is only on Groovy, which I think is not a too popular language. 

Other than that, we would want to see new features in every update. We would welcome any kind of improvement in terms of performance, etc.

For how long have I used the solution?

I have been using this solution for a year.

What do I think about the stability of the solution?

Its stability and performance are okay and acceptable.

What do I think about the scalability of the solution?

I am not in a good position to comment on this because I didn't try that out. Currently, we have less than 50 users. 

How are customer service and support?

They are pretty good. They did address my problem. I am satisfied with their support.

How was the initial setup?

It is actually a complex setup. If you want to do it in a good and sustainable way, it is complex to create a model, but if you want to just test things out and very quickly try out this product, then it is easy to get started. So, it is complex to create something that is sustainable. 

Overall, it took about one and a half to two months, which included many test cases implementations. The setup was done within a week.

It does require maintenance, but the maintenance of the server is up to your company policy. It depends on how often you patch your server, and how often you upgrade Java. The maintenance of the test scripts depends on how quickly the product changes. So, it varies.

What about the implementation team?

I was using help from the proprietary vendor.

What's my experience with pricing, setup cost, and licensing?

Its pricing is quite reasonable. If you require their help in getting started, then there is a professional services fee on top of the product license cost.

What other advice do I have?

I would recommend engaging Katalon's services to get started. They do render pretty good help on it.

I would rate Katalon Studio an eight out of 10.

Which deployment model are you using for this solution?

On-premises
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Software Quality Assurance Engineer at a computer software company with 201-500 employees
Real User
Easy to deploy and not hard to learn, but keeps on crashing on Linux and is a bit slow
Pros and Cons
  • "It has been good so far for API testing on Mac. It is not that hard to learn and use. There is so much support out there, so if anyone wants to start using it, there is enough help."
  • "Currently, I'm the only one who can use it because I have a Mac. It is giving a hard time to my team members who are on Linux. My team members are using Linux, and Katalon doesn't support Linux very well. It keeps on crashing. It crashes and shuts down almost every time they save their work, so they are not able to use it. It should have good support for Linux. We don't know what the problem is. If the Katalon team can pick up this issue, it will be very helpful."

What is our primary use case?

We are using it for API testing. I am just running it from my local machine. I am using it just locally.

What is most valuable?

It has been good so far for API testing on Mac. It is not that hard to learn and use. There is so much support out there, so if anyone wants to start using it, there is enough help.

What needs improvement?

Currently, I'm the only one who can use it because I have a Mac. It is giving a hard time to my team members who are on Linux. My team members are using Linux, and Katalon doesn't support Linux very well. It keeps on crashing. It crashes and shuts down almost every time they save their work, so they are not able to use it. It should have good support for Linux. We don't know what the problem is. If the Katalon team can pick up this issue, it will be very helpful.

It is a bit slow. The other tools on my Mac are not slow, but Katalon is slow. 

For how long have I used the solution?

It has been more than six months.

Which solution did I use previously and why did I switch?

I worked on Postman, but for RPA automation, I just started working with Katalon.

How was the initial setup?

It was easy. I just had to double-click on Mac.

What's my experience with pricing, setup cost, and licensing?

I am using the free version.

What other advice do I have?

It should support all operating systems. Most of the developers use a Linux machine, but it doesn't support Linux. I would like an update from the Katalon team about why it is not working properly on a Linux machine.

I would rate it a six out of 10. It is a good product, but it needs some improvements.

Which deployment model are you using for this solution?

On-premises
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
PeerSpot user
Business Analyst at a consultancy with 10,001+ employees
Real User
User-friendly, easy to learn and use, a good regression test suite and good reporting
Pros and Cons
  • "This solution is very user-friendly to learn and implement, and less technical knowledge is required to handle automation."
  • "My recently-updated Katalon studio version hangs a lot and is not a stable version."

What is our primary use case?

I am automating my current project with web application manual testing.

It's a requirement gathering application and has lots of workflows for the user.

How has it helped my organization?

Manual testing requires a lot of manual processes and time to complete the test cycle. With the help of Katalon, the process is running more smoothly and is less time-consuming.

Regression test suit saves lots of time to complete the whole testing with inbuilt reports in PDF format.

What is most valuable?

The Keyword feature is very good to use in your test cases. 

There are lots of inbuilt Keyword features already there to use, and one can write their own for use in respective test cases.

Less Java knowledge is required to write a keyword.

This solution is very user-friendly to learn and implement, and less technical knowledge is required to handle automation.

What needs improvement?

My recently-updated Katalon studio version hangs a lot and is not a stable version.

The support system should be improved in many areas such as Katalon Studio forums and the Katalon community page, where developer responses take a lot of time to reply to user questions.

Actually support response time is more than expected.

For how long have I used the solution?

I have been using this solution for one year.

What do I think about the stability of the solution?

The stability is great.

What do I think about the scalability of the solution?

The scalability of this solution is good.

How are customer service and technical support?

Technical support for this solution is ok, but it could be improve.

Which solution did I use previously and why did I switch?

I used Selenium, but Katalon is much more user-friendly.

How was the initial setup?

The initial setup of this solution is straightforward.

What about the implementation team?

Dont know about that

What was our ROI?

NA

What's my experience with pricing, setup cost, and licensing?

It is freeware software, so start using it.

Which other solutions did I evaluate?

I did not evaluate other options.

What other advice do I have?

Great tool to start automation, easy to learn and doing.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user