We performed a comparison between Apache JMeter and Katalon Studio based on real PeerSpot user reviews.
Find out in this report how the two API Testing Tools solutions compare in terms of features, pricing, service and support, easy of deployment, and ROI."The solution is scalable."
"I use all the tools, but one feature that stands out is JMeter's ability to test when services are sending a particular kind of request. We are using specific ports to send queries, and assess the performance based on the time it takes these queries to respond. You can use it with stuff other than the web performance."
"To me, what's most valuable in Apache JMeter is that it's a lightweight tool for application testing. It's the best load-testing tool for my company because Apache JMeter simulates your application during testing. Apache JMeter also creates threads with good server utilization. Apache JMeter allows you to focus on analyzing the situation, looking into measurements, response time, and client-server responses, which I find valuable."
"Apache JMeter is stable."
"I like the fact that JMeter integrates well with other tools."
"We find the ease of use and the reports and graphs available valuable."
"The metrics part of it and the ability to write your custom code to do some specific tests in the performance testing space are the most valuable features."
"The scripting ability is most valuable. It is easy to use. There is a UI, and you can go in there and figure those things out. After you've got a good set of tests, you basically have a scripted document that you can grab and execute in a pipeline. It is pretty quick to set up, and you can scale it and version control it."
"I personally like the 'Object Spy' feature of this tool. It makes it easy to find an element on the web page."
"The most valuable feature of Katalon Studio is visual testing. It compares the look and feel of an application which is useful."
"It is easy for a non-technical person to use and adopt."
"This solution is very user-friendly to learn and implement, and less technical knowledge is required to handle automation."
"User-friendly and a good solution."
"The tool is easy to use. The product gives me the flexibility to use Selenium. I can also use my Java capabilities in the solution."
"The product provides ease of automation for the cloud."
"We are now performing automated testing in 15 minutes, which were previously taking a long time when doing it manually."
"Modeling a test is difficult. If you don't have much knowledge, you won't be able to do it easily. Testing APIs is also difficult."
"If JMeter could provide a web version of editing, that would be good."
"In terms of setup, it could be nicer, to be honest. Sometimes, I get a little bit lost."
"The user interface is a little bit tricky."
"The solution could use some sort of educational features to offer tips and hints to help users navigate it better. They should improve the manuals and help files."
"Considering the kinds of tests we are performing here, where we launch several tests at the same time as a batch request, JMeter is not the best tool for the job. Those kinds of things could be done easily with other tools, like T6."
"Apache JMeter's UI can be made more colorful."
"JMeter output reports can be difficult to understand without training."
"The free version of the solution is not user friendly at all."
"One improvement would be if it could support more programming languages such as JavaScript or Python. Right now, it is only on Groovy, which I think is not a too popular language."
"Support options need improvement. It is sometimes hard to find a solution to any given problem, thus you are forced to use another solution."
"My recently-updated Katalon studio version hangs a lot and is not a stable version."
"It would be helpful if they can integrate a feature for performance testing."
"The product’s regression testing time could be reduced."
"The price of the solution is a bit high. It's one of the reasons we decided not to continue using the product."
"The price of Katalon Studio is an area of concern where improvement is required."
Apache JMeter is ranked 3rd in API Testing Tools with 82 reviews while Katalon Studio is ranked 5th in API Testing Tools with 42 reviews. Apache JMeter is rated 7.8, while Katalon Studio is rated 7.8. The top reviewer of Apache JMeter writes "It's a free tool with a vast knowledge base, but the reporting is lackluster, and it has a steep learning curve". On the other hand, the top reviewer of Katalon Studio writes " Functional automation features and the recording functionality saves time but the performance and script execution is slow ". Apache JMeter is most compared with BlazeMeter, Postman, Tricentis NeoLoad, OpenText LoadRunner Professional and ReadyAPI, whereas Katalon Studio is most compared with Tricentis Tosca, Postman, OpenText UFT One, Testim and Functionize. See our Apache JMeter vs. Katalon Studio report.
See our list of best API Testing Tools vendors and best Regression Testing Tools vendors.
We monitor all API Testing Tools reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.