We performed a comparison between Apache JMeter and Katalon Studio based on real PeerSpot user reviews.
Find out in this report how the two API Testing Tools solutions compare in terms of features, pricing, service and support, easy of deployment, and ROI."Due to process automation, I don't have to prepare reports, making it the perfect solution."
"The most valuable feature in JMeter is the Thread Group, which helps us to see whether the performance is good."
"The ease of use is the solution's most valuable feature. Also, the ability to easily create test cases is also very good. It's easy to just ramp up on the solution."
"It's stable and reliable."
"We find the ease of use and the reports and graphs available valuable."
"It's very easy to install, and it's very easy to code and develop the script."
"We use Apache JMeter for load testing, where we provide the throughput time."
"Apache JMeter is quite flexible."
"It supports multiple easy-to-learn languages."
"The initial setup is pretty straightforward and easy enough to complete."
"The most valuable feature is its automation security capabilities."
"It has been good so far for API testing on Mac. It is not that hard to learn and use. There is so much support out there, so if anyone wants to start using it, there is enough help."
"The initial setup of Katalon Studio was easy."
"Whenever I speak to the support team of Katalon Studio, I learn that some new features will be included in the product. It is a scalable product."
"Video capture on failure is a must have. A picture is worth a thousand words. A video is worth a thousand pictures (literally)."
"The best feature is the split up between test cases and the test object. This allows us to easily change an error."
"Both scalability and stability could be improved in Apache JMeter."
"They can improve it a little bit in terms of distribution load testing. We struggled with it during the distribution. In terms of reporting, runtime monitoring is not currently included, and it should be included. They can also improve it on the reporting side in terms of the comparison of the reports. They can also focus more on integration with CI/CD. Currently, people are using their own customized tools. It would be nice if Apache can provide some standard tools and procedures for integration with CI/CD tools like DPR. There are some tools, but it would be nice if official standard tools and procedures are available."
"The reports in Apache JMeter could improve."
"The stability could be a bit better."
"The interface could be made more user-friendly."
"The solution could use some sort of educational features to offer tips and hints to help users navigate it better. They should improve the manuals and help files."
"Apache JMeter may have difficulty recognizing dynamic objects in some critical cases, which can lead to challenges in terms of object identification."
"One of the drawbacks of JMeter is that it can't handle a large amount of load, which forces us to switch to other tools when we need to load more than a 5,000 or 10,000 user load."
"Katalon Studio should improve its usability, it still needs some improvement where users can easily use it to build their automation suite. It requires some initial work to set it up. There should be more keywords in the library to limit the coding requirements, this will allow a non-technical person easily start using it, which would be better."
"The product’s regression testing time could be reduced."
"During parallel execution, some reports are randomly switched."
"Now we are having difficulties in using it and had to limit our automation experts to the features that Katalon allows us to use for free. It was free access and they claimed that it would be free for all time."
"It seems to lack a few requirements that a typical customer would want. Compared to other solutions, this product is lacking."
"I've seen that our clients are not truly aware of the power behind Katalon."
"The free version of the solution is not user friendly at all."
"We would like to see improved integration with various reporting tools; this would make our testing data more complete."
Apache JMeter is ranked 3rd in API Testing Tools with 82 reviews while Katalon Studio is ranked 5th in API Testing Tools with 41 reviews. Apache JMeter is rated 7.8, while Katalon Studio is rated 7.8. The top reviewer of Apache JMeter writes "It's a free tool with a vast knowledge base, but the reporting is lackluster, and it has a steep learning curve". On the other hand, the top reviewer of Katalon Studio writes "Useful multiple technology platform, scalable, but usability could improve". Apache JMeter is most compared with BlazeMeter, Postman, Tricentis NeoLoad, OpenText LoadRunner Professional and ReadyAPI, whereas Katalon Studio is most compared with Tricentis Tosca, Postman, OpenText UFT One, Testim and Eggplant Test. See our Apache JMeter vs. Katalon Studio report.
See our list of best API Testing Tools vendors and best Regression Testing Tools vendors.
We monitor all API Testing Tools reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.