Shibu Raghav - PeerSpot reviewer
Senior Manager, Test Automation Architect at IHiS
Real User
Top 10
Helps to automate web regression
Pros and Cons
  • "The tool is easy to use. The product gives me the flexibility to use Selenium. I can also use my Java capabilities in the solution."
  • "The tool's maintenance is very difficult since they do not follow call by value or call by reference. Due to this, any change happening is not reflected throughout all the test cases. There are some issues with data parameterization as well."

What is our primary use case?

We use the tool to automate our web regression. 

What is most valuable?

The tool is easy to use. The product gives me the flexibility to use Selenium. I can also use my Java capabilities in the solution. 

What needs improvement?

The tool's maintenance is very difficult since they do not follow call by value or call by reference. Due to this, any change happening is not reflected throughout all the test cases. There are some issues with data parameterization as well. 

For how long have I used the solution?

I have been working with the solution for two and a half years. 

Buyer's Guide
Katalon Studio
March 2024
Learn what your peers think about Katalon Studio. Get advice and tips from experienced pros sharing their opinions. Updated: March 2024.
768,578 professionals have used our research since 2012.

What do I think about the stability of the solution?

The tool is stable. I would rate its stability a seven out of ten. The solution takes time to load the test cases. 

What do I think about the scalability of the solution?

The tool is scalable. I would rate the tool's scalability an eight out of ten. We use around 28-30 licenses. 

How are customer service and support?

The tool's tech support needs to improve. Most of the issues that we have raised, they consider as feature enhancements. However, they are trying to work very closely with us. 

Which solution did I use previously and why did I switch?

I have used Selenium, Appium, and Micro Focus UFT. If we wanted to use Selenium or Appium, then we would require to build their framework which Katalon didn't require. Also, pricing was a factor in the decision-making process. 

How was the initial setup?

The tool's setup is straightforward. You can just download and use it. I would rate the solution's setup a nine out of ten. The tool is hosted on the Katalon server. 

What's my experience with pricing, setup cost, and licensing?

The tool's pricing is cheap compared to other alternatives. I would rate the tool's pricing a three out of ten. 

What other advice do I have?

I would rate the overall tool a seven out of ten. You should use this solution if cost is your criteria and don't want to build a framework for yourself. I would suggest using the community edition first for a year and then moving ahead with the enterprise version. 

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Principal Consultant at Inspired Testing
Real User
Top 20
Useful smart healing AI capabilities, user-friendly, and responsive support
Pros and Cons
  • "The most valuable features of Katalon Studio are its user-friendliness and the AI smart healing capabilities."
  • "Katalon Studio could improve having visual testing, but I think they're launching that feature very soon. We would like to see an increase in the usage of AI."

What is our primary use case?

Katalon Studio is on-premise and our TestOps is in the cloud. The TestOps can be in a private hybrid or public cloud.

Katalon Studio is used for end-to-end test automation, web, desktop, UI, API, and mobile.

How has it helped my organization?

Katalon Studio has improved our organization because it's improving the speed to market and the speed of delivery.

What is most valuable?

The most valuable features of Katalon Studio are its user-friendliness and the AI smart healing capabilities.

What needs improvement?

Katalon Studio could improve having visual testing, but I think they're launching that feature very soon. We would like to see an increase in the usage of AI.

For how long have I used the solution?

I have been using Katalon Studio for two years.

What do I think about the stability of the solution?

The performance of Katalon Studio has been good.

What do I think about the scalability of the solution?

I have not seen Katalon Studio scalable, but teams that are adjacent to our line of business, have.

We have approximately 50 people using the solution.

We are using Katalon Studio at approximately 80 to 100 percent. We plan on increasing usage in the future. 

How are customer service and support?

The technical support has been good, they are responsive.

How would you rate customer service and support?

Positive

Which solution did I use previously and why did I switch?

We were using Micro Focus UFT previously and switched to Katalon Studio because of pricing.

How was the initial setup?

The initial Katalon Studio is simple, you only need to download and register, and it takes approximately 10 minutes.

We did a POC and then did the implementation and then go with it.

What about the implementation team?

We did the implementation in-house, there is no need for assistance.

Katalon Studio itself doesn't require maintenance. It's the script that requires maintenance, which is normal in any test automation project.

What was our ROI?

We are still busy doing the calculations for the financial ROI, but there has been an ROI when it comes to the speed to market and delivery. That's been affected positively.

What's my experience with pricing, setup cost, and licensing?

Katalon Studio is less expensive than other solutions, such as Micro Focus UFT.

The price of the solution is approximately $1,900 for the licenses, we have 30 licenses. The cost is for the license and for the support. We are billed annually. There are not any extra features or costs for anything else, it is open source.

Which other solutions did I evaluate?

We evaluated Tricentis and Worksoft before choosing Katalon Studio.

What other advice do I have?

The reporting in TestOps could use some upgrades.

Katalon Studio is straightforward and easy to implement. It supports everything from end to end, we have not had any issues.

I rate Katalon Studio a nine out of ten.

Which deployment model are you using for this solution?

On-premises
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Buyer's Guide
Katalon Studio
March 2024
Learn what your peers think about Katalon Studio. Get advice and tips from experienced pros sharing their opinions. Updated: March 2024.
768,578 professionals have used our research since 2012.
LokeshKumar - PeerSpot reviewer
CEO, Founder at a tech services company with 11-50 employees
Real User
Top 5
Scalable solution with efficient reporting features
Pros and Cons
  • "It supports multiple easy-to-learn languages."
  • "Its stability needs improvement."

What is our primary use case?

We use the solution for application code testing. Using it, we can test around 70 modules for our clients in the insurance business.

What is most valuable?

The solution has the best reporting features. With the help of recorded reports, we can analyze the insights.

What needs improvement?

They should include standard methods in AJAX controls for the solution.

For how long have I used the solution?

I have been using the solution for two years.

What do I think about the stability of the solution?

The solution's stability in terms of UI changes needs improvement.

What do I think about the scalability of the solution?

It is a scalable solution.

Which solution did I use previously and why did I switch?

In comparison to other vendors, the solution's price is less. It supports multiple easy-to-learn languages. Also, it has the best API integration and UI features. Although, the debugging process is time-consuming for larger test cases. It takes a long time to begin the test from the start and navigate it.

How was the initial setup?

The solution's initial setup has medium complexity. It takes work to identify AJAX controls and then implement them. There should be an inbuilt method or features designed to handle these controls providing us with a straightforward deployment process.

The overall time taken to complete it is ten minutes. Although, for multiple integrations, it might take 20-30 minutes. Also, its maintenance takes time in case of UI changes.

What's my experience with pricing, setup cost, and licensing?

The solution is more affordable than other vendors.

What other advice do I have?

The solution has the best web UI. I rate it an eight.

Which deployment model are you using for this solution?

On-premises
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Consultant at Unifonic
Consultant
Top 20
Very user-friendly with a great self-healing plug-in feature; lacks integration with other software
Pros and Cons
  • "User-friendly and a good solution."
  • "Katalon lacks integration with other software, including integrating other languages like .NET and PHP."

What is our primary use case?

I'm a senior software test automation engineer and we are customers of Katalon. 

What is most valuable?

This solution is good for us. It's easy to use and a good product. I like the self-healing plug-in feature which, as far as I am aware, is not available in any other product on the market.

What needs improvement?

Katalon lacks integration ability with other software, including integrating other languages like .NET and PHP. I've also had issues with new releases as the system often crashes and the previous version is no longer supported on a particular feature. More testing needs to be carried out before new versions are released. I'd like to be able to export our test system to any other product. This is currently not possible. Finally, the product only supports XPath and not CSS. CSS is faster than XPath and most companies want to use it. There are a lot of solutions on the market and if an end-user has too many problems with a product, they will jump to a new one. 

For how long have I used the solution?

I've been using this solution for two years. 

What do I think about the stability of the solution?

Stability is one of the main issues with the system crashing if there's a new release that hasn't been sufficiently tested. The fixes can come after a couple of days but sometimes it can take a couple of months.  

What do I think about the scalability of the solution?

The solution is scalable. 

How are customer service and support?

I haven't used the support for a while but they were good. The community is also very helpful. 

Which solution did I use previously and why did I switch?

I previously worked with Selenium WebDriver and also with Ranorex. 

What's my experience with pricing, setup cost, and licensing?

The cost is on the high side and it would be helpful if there were two packages available with a distinction made between the standard features most companies are looking for at a cheaper cost and a second, more expensive license option for those wanting additional features such as auto exports. If Katalon were to do this, I think more of the smaller companies would be interested in using the solution. 

What other advice do I have?

I rate this solution seven out of 10. 

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Senior Test Automation Consultant at PROSSE
Real User
Top 5
The solution is affordable and easy to deploy, but it is slower than other products
Pros and Cons
  • "Smart Wait and XPath healing are valuable features."
  • "The product is comparatively slow."

What is our primary use case?

I have developed a framework in Katalon, and I have been managing the automation of mobile applications.

What is most valuable?

Smart Wait and XPath healing are valuable features.

What needs improvement?

The product is comparatively slow. It is very slow when calling a test case within another test case and searching for it. The product is slow in the test case and execution. The product should be made more smooth and speedy.

For how long have I used the solution?

I am using the solution currently. I have an extensive experience with the product.

What do I think about the stability of the solution?

I rate the solution’s stability a six out of ten.

What do I think about the scalability of the solution?

I rate the solution’s scalability a six out of ten. We have ten licenses for the solution.

How are customer service and support?

The technical support is fine. I rate the technical support a six to seven out of ten.

How would you rate customer service and support?

Neutral

How was the initial setup?

The initial setup is simple. We can easily download the file.

What's my experience with pricing, setup cost, and licensing?

The product’s pricing is very, very low. It’s the reason people prefer using the product.

What other advice do I have?

I recommend the solution. It's a viable solution at less cost. Overall, I rate the product a seven out of ten.

Which deployment model are you using for this solution?

Hybrid Cloud
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Quality Assurance Team Lead at Elm Co.
Real User
A scalable solution with expensive pricing
Pros and Cons
  • "I rate Katalon Studio's scalability a four out of five."
  • "Katalon Studio's pricing is expensive."

What needs improvement?

Katalon Studio's pricing is expensive. 

For how long have I used the solution?

.I have been using the product for three to four years. 

What do I think about the stability of the solution?

I rate the product's stability a nine out of ten. 

What do I think about the scalability of the solution?

I rate Katalon Studio's scalability a four out of five. 

How was the initial setup?

The tool's deployment is easy but difficult for iOS devices. Deployment speed is pretty quick.

What's my experience with pricing, setup cost, and licensing?

The tool's licensing costs are yearly. 

What other advice do I have?

I rate Katalon Studio an eight out of ten. 

Disclosure: I am a real user, and this review is based on my own experience and opinions.
Flag as inappropriate
PeerSpot user
Khurram Jamil Khan - PeerSpot reviewer
Head of SQA, Project Manager at Vroozi
Real User
Top 5
Great record and playback functionality but isn't user-friendly and needs better technical support
Pros and Cons
  • "The best thing about the solution is that there is a record and playback functionality."
  • "The free version of the solution is not user friendly at all."

What is our primary use case?

We have an application that's for secure point management. There are different values on it, starting from PR creation to PO, etc. We log into the application and then create a PR and then a PO, and from there we can run functional test cases.

We use it to identify important areas for regression testing. 

What is most valuable?

There is a free version of the solution.

The best thing about the solution is that there is a record and playback functionality. 

The solution allows for specific object files. 

The solution has great multi-parallel languages that work in the facilities here.

What needs improvement?

The free version of the solution is not user friendly at all.

The solution's most valuable aspect is related to the record and playback. However, they need to improve the record and playback facility. TestComplete and UFT both have a much better record and playback functionality in comparison. It's one of the main reasons why I have, for example, inline tools, like UFT 5.0. 

They need to improve their object repository.

The solution isn't as mature as TestComlete or UFT. Although they are continuously writing more functionalities, this is one area they really need to improve in.

Technical support needs to be improved upon.

For how long have I used the solution?

We've been using the solution for three to four years now.

What do I think about the stability of the solution?

The solution is okay in terms of stability, but just not as stable as TestComplete or UFT, two of its competitors.

What do I think about the scalability of the solution?

We have five people working with the solution right now. 

This solution was being extensively used on a daily basis in our organization.

However, for the last couple of months we are not using it as much as we were using it. From February, we have reduced the usage of Katalon because we are working on a replacement solution. We're very cost-conscious and the new tool provides us with more value. 

The solution does have potential to scale. It would be pretty easy to do so if a company needed to.

How are customer service and technical support?

We've contacted technical support in the past. The support is basically a site where you can record your issues. The feedback I've received from my team is that it's not great technical support and they aren't fully satisfied.

Which solution did I use previously and why did I switch?

We actually started with a solution called Selenium. However, the Selenium GUI was not as comprehensive and the solution itself was not easy to use. We moved to Katalon due to the fact that it was free of charge, and had the record and playback facilities we required.

How was the initial setup?

The initial setup wasn't complex. It was straightforward. I found it to be quite easy.

What about the implementation team?

Due to the fact the process wasn't that difficult, we handled the installation of the solution in-house with our own team.

What's my experience with pricing, setup cost, and licensing?

There is a free version of the solution. That said, companies should be aware that if they do go ahead with the freemium version, the effort required to do the work is extremely high and might negate the positive aspect of having a "free" solution.

Which other solutions did I evaluate?

We've since looked at both UFT and TestComplete. Katalon is cheaper, however, it doesn't offer everything we need and its features aren't as robust as the other two.

What other advice do I have?

We're using the solution as a customer and don't have any sort of relationship or contract with Katalon.

The company gave us a demo to try that includes approximately seven or eight sessions of training to all 15 resources. However, Katalon also has lesson fees associated with the solution. That means we have to spend money, and we need to be strategic and careful now when considering which tool we need to invest in. That's why we are basically working on different tools, including UFT and TestComplete.

We are working with the 4.0 and 5.0 versions, however versions 7.0 and 8.0 have also launched at this point.

Katalon is a good tool if we are comparing it with a developer tool. It's the cheaper option too, however, is not as mature as compared to the other competitors. The lack of maturity may be why it's cheaper.

If a company is looking to buy a user-friendly software testing tool while having to pay less money, Katalon may be the best option as compared to UFT or TestComplete.

I'd rate the solution overall six out of ten.

Which deployment model are you using for this solution?

Public Cloud
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
It Manager, QA Manager at a comms service provider with 1-10 employees
Real User
Top 20
Simple setup, effective testing, but support could improve
Pros and Cons
  • "The most valuable feature of Katalon Studio is visual testing. It compares the look and feel of an application which is useful."
  • "We have been seeing some error pop-ups that are difficult to understand why they were triggered."

What is our primary use case?

We use Katalon Studio mainly for functional testing.

How has it helped my organization?

For tasks, our manual testers cannot cover Katalon Studio helps us. It speeds up our testing. If we are testing a large application, it benefits if we automate it using Katalon Studio

What is most valuable?

The most valuable feature of Katalon Studio is visual testing. It compares the look and feel of an application which is useful.

What needs improvement?

We have been seeing some error pop-ups that are difficult to understand why they were triggered.

In one of our applications, the solution is not able to recognize some of the elements making it unable to use with it.

For how long have I used the solution?

I have been using Katalon Studio for approximately eight months.

What do I think about the stability of the solution?

We have had some errors on occasion. There was a learning curve when using the solution that could have contributed to the stability issues. We had to learn to use the solution from scratch.

What do I think about the scalability of the solution?

Katalon Studio is scalable.

We have seven people using this solution in my department.

How are customer service and support?

Katalon Studio could improve its support. Their response time is slow when we have premium support which includes direct connection with the agents.

New Relic had better support.

Which solution did I use previously and why did I switch?

We previously used other solutions before switching to Katalon Studio.

How was the initial setup?

The initial setup of Katalon Studio is easy. There was some confusion when we were upgrading the versions. The implementation can be done in a few hours.

What's my experience with pricing, setup cost, and licensing?

The price of Katalon Studio is reasonable. They recently had a price increase that might impact new subscribers. We are using a business license.

Which other solutions did I evaluate?

We evaluated other options before selecting Katalon Studio.

What other advice do I have?

We have not had any issues with maintaining the solution.

My advice to others is to test the solution well before purchase and confirm all the elements needed from the sales team. We had some issues at the start.

I rate Katalon Studio a seven out of ten.

Which deployment model are you using for this solution?

On-premises
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user