We performed a comparison between Apache JMeter and Katalon Studio based on real PeerSpot user reviews.
Find out in this report how the two API Testing Tools solutions compare in terms of features, pricing, service and support, easy of deployment, and ROI."The recording and playback functionality is helpful."
"Very user-friendly and easy to use."
"The reporting features are really good. There's a lot less latency than other solutions."
"JMeter is easy to use for a user who doesn't have too much knowledge of programming or certain languages."
"The solution's initial setup is easy."
"It is an open-source tool that is easy to use. It can be easily integrated with multiple tools, including Selenium."
"JMeter lets us generate virtual users and T-load, per our requirements. It's easy to configure and adjusting the virtual users according to the DPS we want to achieve."
"It is cost-effective and simple to use."
"It provides us daily feedback on the status (failing/working) of the core features of our websites."
"The functionality of the data is very good. You can upload and disperse data using the solution."
"The tool is easy to use. The product gives me the flexibility to use Selenium. I can also use my Java capabilities in the solution."
"User-friendly and a good solution."
"The solution is easy to learn."
"The most valuable features of Katalon Studio are its user-friendliness and the AI smart healing capabilities."
"Our clients have requested by all types of testing, including mobile, desktop, and API testing and all of those are covered by Katalon. I find that very valuable, very complete."
"The most valuable feature is that the browser and the API testing is available in a single tool, and I don't have to look at other options."
"The user interface is a little bit tricky."
"It should be easier to combine multiple scripts. If you have multiple scripts, you need to write a new script to combine those scripts. The virtual user generator is slow."
"The reporting section of the solution can be better."
"The stability could be a bit better."
"There is some work to be done with the integration."
"The UI of the solution needs to be better. The UI takes up a lot of our bandwidth."
"One of the drawbacks of JMeter is that it can't handle a large amount of load, which forces us to switch to other tools when we need to load more than a 5,000 or 10,000 user load."
"What needs improvement in Apache JMeter is the very high load requirements when you want to scale it beyond certain thresholds. For example, small to mid-range testing is very easily done with Apache JMeter, but if you scale and increase the load, then it would be a problem because the tool consumes a lot of resources, probably because Apache JMeter provides an enriched UI experience, so it consumes a lot of memory and requires high CPU usage. This means you have to manage your infrastructure, or else you'll have high overhead expenses. As Apache JMeter is a heavyweight tool, that is an area for improvement, though I'm unsure if Apache can do something about it because it could be a result of the way it's architected. What I'd like to see from Apache JMeter in the future is for it to transition to the cloud, as a lot of cloud technologies emerge around the globe, and a lot of people prefer cloud-based solutions or cloud-native tools. Even if a company has a legacy system, it's still possible to transition to the cloud. I've worked with a company that was an on-premise company that moved to the cloud and became cloud-native. If Apache JMeter could transition to the cloud, similar to k6, then it could help lessen the intense resource consumption that's currently happening in Apache JMeter."
"The price of Katalon Studio is an area of concern where improvement is required."
"We would like to see improved integration with various reporting tools; this would make our testing data more complete."
"One aspect that can be improved is testing for desktop applications. I would like to see them support more technologies in this area."
"The free version of the solution is not user friendly at all."
"They need to work on documentation to make it more centralized and easier to find what you are looking for."
"Support options need improvement. It is sometimes hard to find a solution to any given problem, thus you are forced to use another solution."
"Currently, I'm the only one who can use it because I have a Mac. It is giving a hard time to my team members who are on Linux. My team members are using Linux, and Katalon doesn't support Linux very well. It keeps on crashing. It crashes and shuts down almost every time they save their work, so they are not able to use it. It should have good support for Linux. We don't know what the problem is. If the Katalon team can pick up this issue, it will be very helpful."
"The product’s regression testing time could be reduced."
Apache JMeter is ranked 3rd in API Testing Tools with 82 reviews while Katalon Studio is ranked 5th in API Testing Tools with 41 reviews. Apache JMeter is rated 7.8, while Katalon Studio is rated 7.8. The top reviewer of Apache JMeter writes "It's a free tool with a vast knowledge base, but the reporting is lackluster, and it has a steep learning curve". On the other hand, the top reviewer of Katalon Studio writes "Useful multiple technology platform, scalable, but usability could improve". Apache JMeter is most compared with BlazeMeter, Postman, Tricentis NeoLoad, OpenText LoadRunner Professional and ReadyAPI, whereas Katalon Studio is most compared with Tricentis Tosca, Postman, OpenText UFT One, Appium and Eggplant Test. See our Apache JMeter vs. Katalon Studio report.
See our list of best API Testing Tools vendors and best Regression Testing Tools vendors.
We monitor all API Testing Tools reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.