We performed a comparison between Apache JMeter and Katalon Studio based on real PeerSpot user reviews.
Find out in this report how the two API Testing Tools solutions compare in terms of features, pricing, service and support, easy of deployment, and ROI."The most valuable features are the integration with Jenkins and the reporting."
"When there's a high number of TPS I can achieve more transactions per seconds given the hyper-limitations."
"It is scalable. You can scale up to 1,000 users in JMeter. If you can put up four slave servers, you can easily ramp up to 1,000 users."
"JMeter is easy to use for a user who doesn't have too much knowledge of programming or certain languages."
"JMeter's most valuable feature is the RegEx Extractor."
"This solution is easier to use than any other tool in the market; there is not even a requirement to learn a lot of scripting in order to use it."
"It's a free tool."
"The most valuable feature of Apache JMeter is its popularity. It is the best open-source tool with all the features needed."
"One of the features that I like is Object Recognition. It worked very well, and it allowed me to create a dynamic expert based on my requirements."
"Katalon Studio's biggest advantage is its price. It's a good tool for the price, albeit with some limitations when you compare it with tools like Tricentis Tosca."
"It is good for API testing. It is also good for continuous integration testing. You can connect it to Jenkins."
"The initial setup is pretty straightforward and easy enough to complete."
"The functionality of the data is very good. You can upload and disperse data using the solution."
"The best thing about the solution is that there is a record and playback functionality."
"Smart Wait and XPath healing are valuable features."
"The most valuable feature is its automation security capabilities."
"Apache should have a graphic interface."
"The plug-ins make the reports heavy and they have to be run in non-GUI mode."
"I sometimes found the documentation to be not as explanatory as I would've liked it. In the cases that I can think of, I was looking for a rather hand-holding approach with Step A, B, and C, but then I realized that with a product that is open source like this, you can't do handholding. That is because there are so many different uses and different unique environments and setups for it, but I remember thinking a few times that if they only just said this."
"Modeling a test is difficult. If you don't have much knowledge, you won't be able to do it easily. Testing APIs is also difficult."
"Because so much is being done these days with authentication processes, a better system for either getting bearer tokens or some kind of token-based authentication prior to executing APIs would benefit the product. It is there, and you can do things. It is just not real clean at this point. There should be a better authentication process for JMeter or some automation or better guidelines for gaining and utilizing tokens on the fly."
"The reporting is not very good."
"If JMeter could provide a web version of editing, that would be good."
"Apache JMeter could be a more user-friendly product from the end user's perspective."
"Its stability needs improvement."
"One aspect that can be improved is testing for desktop applications. I would like to see them support more technologies in this area."
"Support options need improvement. It is sometimes hard to find a solution to any given problem, thus you are forced to use another solution."
"We have been seeing some error pop-ups that are difficult to understand why they were triggered."
"There could potentially be more reporting within the solution. We need more issue reports, for example."
"It would be helpful to have an automatic save feature."
"There is not much support offered for the free version, which is something that could be improved."
"The Object Spy is rather frustrating to work with, so I tend not to use it."
Apache JMeter is ranked 3rd in API Testing Tools with 82 reviews while Katalon Studio is ranked 5th in API Testing Tools with 41 reviews. Apache JMeter is rated 7.8, while Katalon Studio is rated 7.8. The top reviewer of Apache JMeter writes "It's a free tool with a vast knowledge base, but the reporting is lackluster, and it has a steep learning curve". On the other hand, the top reviewer of Katalon Studio writes "Useful multiple technology platform, scalable, but usability could improve". Apache JMeter is most compared with BlazeMeter, Postman, Tricentis NeoLoad, OpenText LoadRunner Professional and ReadyAPI, whereas Katalon Studio is most compared with Tricentis Tosca, Postman, OpenText UFT One, Testim and Eggplant Test. See our Apache JMeter vs. Katalon Studio report.
See our list of best API Testing Tools vendors and best Regression Testing Tools vendors.
We monitor all API Testing Tools reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.
