We performed a comparison between Apache JMeter and Katalon Studio based on real PeerSpot user reviews.
Find out in this report how the two API Testing Tools solutions compare in terms of features, pricing, service and support, easy of deployment, and ROI."The most valuable feature for us is the available information on the forums and to be able to discuss and get answers from the people that are involved in using this tool."
"It's a powerful tool that is open source."
"We appreciate that the solution is free to use, as an open-source tool."
"The solution helps by detecting bottlenecks."
"The most valuable feature of this solution is being able to launch many requests and scheduling simulating human interactions with the application."
"Apache JMeter is well-known and widely used among developers, particularly on popular developer forums. While it may not have the most user-friendly interface, it offers strong support through official manuals and various articles from companies providing load testing services. The tool is free, has a substantial community, and serves as a fundamental choice for testers, especially those new to performance testing. While other tools like K6 may be more developer-oriented, JMeter's affordability and accessibility make it suitable for those without extensive performance testing experience."
"The new version of the solution is stable."
"It's stable and reliable."
"It is good for API testing. It is also good for continuous integration testing. You can connect it to Jenkins."
"It provides us daily feedback on the status (failing/working) of the core features of our websites."
"The product provides ease of automation for the cloud."
"One of the features that I like is Object Recognition. It worked very well, and it allowed me to create a dynamic expert based on my requirements."
"The most valuable feature is its automation security capabilities."
"The best thing about the solution is that there is a record and playback functionality."
"The most valuable feature of Katalon Studio is the ease of use of the solution."
"The tool is easy to use. The product gives me the flexibility to use Selenium. I can also use my Java capabilities in the solution."
"You really need a technical team in order to really utilize the product."
"At present, if the number of virtual users increases beyond 10,000 when testing, then it results in a Java heap which causes the solution to crash."
"Apache JMeter could be a more user-friendly product from the end user's perspective."
"Until now, JMeter is not supporting most of the protocols."
"The reporting is not very good."
"Apache JMeter may have difficulty recognizing dynamic objects in some critical cases, which can lead to challenges in terms of object identification."
"JMeter output reports can be difficult to understand without training."
"I need to consider it further because as features increase, it might become more complicated, and my goal has always been simplicity. Currently, I have to focus on other tasks, and I'm handling multiple responsibilities, so I can't juggle everything at once. However, if you ask me, I believe EJB covers most functionalities that are crucial. One improvement I'd suggest is adding a graphical aspect to the Gateway, making it a bit more colorful. Unlike JMeter, which lacks color, having a bit of color in the graphical aspects would be beneficial. Overall, for the essential features, EJB should work fine."
"Currently, I'm the only one who can use it because I have a Mac. It is giving a hard time to my team members who are on Linux. My team members are using Linux, and Katalon doesn't support Linux very well. It keeps on crashing. It crashes and shuts down almost every time they save their work, so they are not able to use it. It should have good support for Linux. We don't know what the problem is. If the Katalon team can pick up this issue, it will be very helpful."
"Katalon Studio could improve having visual testing, but I think they're launching that feature very soon. We would like to see an increase in the usage of AI."
"It should start working on Silverlight automation."
"It is difficult to identify elements on websites that use Angular or ReactJS because they don't have an option to view source code."
"My recently-updated Katalon studio version hangs a lot and is not a stable version."
"The price of Katalon Studio is an area of concern where improvement is required."
"The integration process with Jira should be enhanced and facilitated."
"The free version of the solution is not user friendly at all."
Apache JMeter is ranked 3rd in API Testing Tools with 82 reviews while Katalon Studio is ranked 5th in API Testing Tools with 41 reviews. Apache JMeter is rated 7.8, while Katalon Studio is rated 7.8. The top reviewer of Apache JMeter writes "It's a free tool with a vast knowledge base, but the reporting is lackluster, and it has a steep learning curve". On the other hand, the top reviewer of Katalon Studio writes "Useful multiple technology platform, scalable, but usability could improve". Apache JMeter is most compared with BlazeMeter, Postman, Tricentis NeoLoad, OpenText LoadRunner Professional and ReadyAPI, whereas Katalon Studio is most compared with Tricentis Tosca, Postman, OpenText UFT One, Appium and Eggplant Test. See our Apache JMeter vs. Katalon Studio report.
See our list of best API Testing Tools vendors and best Regression Testing Tools vendors.
We monitor all API Testing Tools reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.
