We performed a comparison between Apache JMeter and Katalon Studio based on real PeerSpot user reviews.
Find out in this report how the two API Testing Tools solutions compare in terms of features, pricing, service and support, easy of deployment, and ROI."The solution is free. You don't need to worry about licensing costs."
"User-friendly and open source."
"API testing, Database Testing, and MQ testing can be done with ease."
"It is open source as well as relatively extendable. It allows us to extend and add additional functionality and features. Its deployment is also very easy."
"The scripting ability is most valuable. It is easy to use. There is a UI, and you can go in there and figure those things out. After you've got a good set of tests, you basically have a scripted document that you can grab and execute in a pipeline. It is pretty quick to set up, and you can scale it and version control it."
"The solution offers a lot of plug-ins and a huge continuously developing community that is regularly offering new features and plug-ins."
"Apache JMeter is well-known and widely used among developers, particularly on popular developer forums. While it may not have the most user-friendly interface, it offers strong support through official manuals and various articles from companies providing load testing services. The tool is free, has a substantial community, and serves as a fundamental choice for testers, especially those new to performance testing. While other tools like K6 may be more developer-oriented, JMeter's affordability and accessibility make it suitable for those without extensive performance testing experience."
"JMeter lets us generate virtual users and T-load, per our requirements. It's easy to configure and adjusting the virtual users according to the DPS we want to achieve."
"We are now performing automated testing in 15 minutes, which were previously taking a long time when doing it manually."
"The basic framework and project organization is very good."
"The most valuable features of Katalon Studio are its user-friendliness and the AI smart healing capabilities."
"It is good for API testing. It is also good for continuous integration testing. You can connect it to Jenkins."
"User-friendly and a good solution."
"The scalability of the product is good."
"The most valuable feature is its automation security capabilities."
"It provides us daily feedback on the status (failing/working) of the core features of our websites."
"In terms of setup, it could be nicer, to be honest. Sometimes, I get a little bit lost."
"The memory utilization in JMeter is very poor."
"We're like the solution to be more user-friendly."
"The interface could be made more user-friendly."
"We would like more documentation to be provided for the advanced level features that are available in this solution, in order to improve development."
"They can improve it a little bit in terms of distribution load testing. We struggled with it during the distribution. In terms of reporting, runtime monitoring is not currently included, and it should be included. They can also improve it on the reporting side in terms of the comparison of the reports. They can also focus more on integration with CI/CD. Currently, people are using their own customized tools. It would be nice if Apache can provide some standard tools and procedures for integration with CI/CD tools like DPR. There are some tools, but it would be nice if official standard tools and procedures are available."
"You really need a technical team in order to really utilize the product."
"Its reporting could be improved. There should be a better visual representation. That would be helpful for easy consumption of the reports."
"One aspect that can be improved is testing for desktop applications. I would like to see them support more technologies in this area."
"It seems to lack a few requirements that a typical customer would want. Compared to other solutions, this product is lacking."
"The Object Spy is rather frustrating to work with, so I tend not to use it."
"The product is comparatively slow."
"My recently-updated Katalon studio version hangs a lot and is not a stable version."
"Katalon Studio's pricing is expensive."
"The product’s regression testing time could be reduced."
"It would be helpful to have an automatic save feature."
Apache JMeter is ranked 3rd in API Testing Tools with 82 reviews while Katalon Studio is ranked 5th in API Testing Tools with 41 reviews. Apache JMeter is rated 7.8, while Katalon Studio is rated 7.8. The top reviewer of Apache JMeter writes "It's a free tool with a vast knowledge base, but the reporting is lackluster, and it has a steep learning curve". On the other hand, the top reviewer of Katalon Studio writes "Useful multiple technology platform, scalable, but usability could improve". Apache JMeter is most compared with BlazeMeter, Postman, Tricentis NeoLoad, OpenText LoadRunner Professional and ReadyAPI, whereas Katalon Studio is most compared with Tricentis Tosca, Postman, OpenText UFT One, Testim and Eggplant Test. See our Apache JMeter vs. Katalon Studio report.
See our list of best API Testing Tools vendors and best Regression Testing Tools vendors.
We monitor all API Testing Tools reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.
