We performed a comparison between Apache JMeter and Katalon Studio based on real PeerSpot user reviews.
Find out in this report how the two API Testing Tools solutions compare in terms of features, pricing, service and support, easy of deployment, and ROI."To me, what's most valuable in Apache JMeter is that it's a lightweight tool for application testing. It's the best load-testing tool for my company because Apache JMeter simulates your application during testing. Apache JMeter also creates threads with good server utilization. Apache JMeter allows you to focus on analyzing the situation, looking into measurements, response time, and client-server responses, which I find valuable."
"JMeter lets us generate virtual users and T-load, per our requirements. It's easy to configure and adjusting the virtual users according to the DPS we want to achieve."
"We find the load testing feature valuable."
"This solution is very user-friendly, and allows for a lot of data capture when testing."
"When someone in our organization wants to test web applications, they use Apache JMeter since they face no hurdles while using the solution."
"Due to process automation, I don't have to prepare reports, making it the perfect solution."
"The distributed load testing is very good with Apache JMeter."
"I like the fact that JMeter integrates well with other tools."
"The scalability of the product is good."
"We can write code in Java and it is easy to link to other JARs that we find on the internet, which is very handy."
"I rate Katalon Studio's scalability a four out of five."
"The basic framework and project organization is very good."
"The most valuable features of Katalon Studio are its user-friendliness and the AI smart healing capabilities."
"We are now performing automated testing in 15 minutes, which were previously taking a long time when doing it manually."
"It is good for API testing. It is also good for continuous integration testing. You can connect it to Jenkins."
"It is easy for a non-technical person to use and adopt."
"Apache should have a graphic interface."
"Until now, JMeter is not supporting most of the protocols."
"Report generation needs to be improved. It is quite difficult to get to."
"In Micro Focus LoadRunner we can go from the UI and we can configure it. There is no such feature in Apache JMeter. There should be UI-based recording history or logs."
"The tool should be made a bit more robust, and better support should be made available."
"JMeter output reports can be difficult to understand without training."
"I need to consider it further because as features increase, it might become more complicated, and my goal has always been simplicity. Currently, I have to focus on other tasks, and I'm handling multiple responsibilities, so I can't juggle everything at once. However, if you ask me, I believe EJB covers most functionalities that are crucial. One improvement I'd suggest is adding a graphical aspect to the Gateway, making it a bit more colorful. Unlike JMeter, which lacks color, having a bit of color in the graphical aspects would be beneficial. Overall, for the essential features, EJB should work fine."
"The solution needs to improve reporting. Currently, there is not enough automation involved with the feature. For example, there should be an automatic way of saving reports."
"Currently, I'm the only one who can use it because I have a Mac. It is giving a hard time to my team members who are on Linux. My team members are using Linux, and Katalon doesn't support Linux very well. It keeps on crashing. It crashes and shuts down almost every time they save their work, so they are not able to use it. It should have good support for Linux. We don't know what the problem is. If the Katalon team can pick up this issue, it will be very helpful."
"The product is comparatively slow."
"One aspect that can be improved is testing for desktop applications. I would like to see them support more technologies in this area."
"Katalon Studio's pricing is expensive."
"The price of Katalon Studio is an area of concern where improvement is required."
"The free version of the solution is not user friendly at all."
"We have been seeing some error pop-ups that are difficult to understand why they were triggered."
"The price of the solution is a bit high. It's one of the reasons we decided not to continue using the product."
Apache JMeter is ranked 3rd in API Testing Tools with 82 reviews while Katalon Studio is ranked 5th in API Testing Tools with 41 reviews. Apache JMeter is rated 7.8, while Katalon Studio is rated 7.8. The top reviewer of Apache JMeter writes "It's a free tool with a vast knowledge base, but the reporting is lackluster, and it has a steep learning curve". On the other hand, the top reviewer of Katalon Studio writes "Useful multiple technology platform, scalable, but usability could improve". Apache JMeter is most compared with BlazeMeter, Postman, Tricentis NeoLoad, OpenText LoadRunner Professional and ReadyAPI, whereas Katalon Studio is most compared with Tricentis Tosca, Postman, OpenText UFT One, Testim and Eggplant Test. See our Apache JMeter vs. Katalon Studio report.
See our list of best API Testing Tools vendors and best Regression Testing Tools vendors.
We monitor all API Testing Tools reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.