Compare Apache JMeter vs. Katalon Studio

Cancel
You must select at least 2 products to compare!
Worksoft Certify Logo
14,364 views|4,034 comparisons
Apache JMeter Logo
15,009 views|12,504 comparisons
Katalon Studio Logo
13,449 views|9,684 comparisons
Most Helpful Review
Find out what your peers are saying about Apache JMeter vs. Katalon Studio and other solutions. Updated: January 2021.
455,962 professionals have used our research since 2012.
Quotes From Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:

Pros
"The ease of use is superior to anything on the market. It's very easy to integrate. We've been very impressed with the tool. Because we primarily use the configuration with SAP, the integration is pretty seamless. But we have used our own in-house VB app as well, and it's worked very well with that.""We love the Capture 2.0 feature. It seems to work very well.""The ability to work with the data, with recordsets, and plug those into the scripts is very easy and very powerful. We use it extensively.""It's script-free, which is really important for our end users because we are usually dealing with colleagues who are not developers and who do not always have the technical background of developing and scripting. It's very useful that there is a nice UI and the tool is script-free.""One big advantage of Worksoft Certify is its integration with SAP Solution Manager...""It is very user-friendly with an appealing UI, unlike a lot of other automation tools that we have evaluated. The fact that it can be used to across SAP and non-SAP applications (including web-based apps) is a big advantage. Using Certify Process Capture functionality has helped in hassle free test design creation, without the need to spend any extra effort to capture test steps and screenshots. The integration elements across HPE ALM and Solution Manager also work well.""If we write a new test that's 80 percent the same as an existing test, it is pretty straightforward to reuse the steps from existing tests for our new tests and build upon them.""It is very easy to maintain. With scripts, I can change one line and in one step. Whatever I want, I can do. I don't need to be an expert to use it."

More Worksoft Certify Pros »

"The solution is free. You don't need to worry about licensing costs.""The solution offers a lot of plug-ins and a huge continuously developing community that is regularly offering new features and plug-ins.""API testing, Database Testing, and MQ testing can be done with ease.""The ease of use is the solution's most valuable feature. Also, the ability to easily create test cases is also very good. It's easy to just ramp up on the solution.""The most valuable feature for us is the available information on the forums and to be able to discuss and get answers from the people that are involved in using this tool.""JMeter is easy to use for a user who doesn't have too much knowledge of programming or certain languages.""The most valuable feature in JMeter is the Thread Group, which helps us to see whether the performance is good.""The most valuable features are the integration with Jenkins and the reporting."

More Apache JMeter Pros »

"We can write code in Java and it is easy to link to other JARs that we find on the internet, which is very handy.""The functionality of the data is very good. You can upload and disperse data using the solution.""This solution is very user-friendly to learn and implement, and less technical knowledge is required to handle automation.""The basic framework and project organization is very good.""This is a product that is well ahead of its immediate competition in features and functionality.""The most important feature is the Jenkins integration; it is pretty straight forward and allows us to run nightly builds.""It is easy for a non-technical person to use and adopt.""The most valuable feature is that the browser and the API testing is available in a single tool, and I don't have to look at other options."

More Katalon Studio Pros »

Cons
"In the past, when we've tried to automate some of our web apps, it has not been as robust. If there were one thing that could be improved, it's interaction with web applications. The issue we were running into is that it was harder to identify the objects than it is with some of the other architectured applications.""The definitions for the objects need to be automated. They need to be recognized automatically by Worksoft Certify instead of changing them back and forth manually. This is also something that Worksoft is currently working on.""Our interactions with technical support has not been the best always and there is room for improvement especially with respect to the time taken to respond to cases. However, with the right contacts and reasonable escalations we have always managed to get quick attention on our cases.""One feature that we have been asking for has been to treat tests as code and store the source code for tests in a configuration management tool. Right now, for version control of testing, it's all internally within the tool. If we have a test of a business process and want to revive that test, our methodology now is purely manual work. We go into the tool, create a copy of the existing test, and call the next one: v2. Now, we have two of them and the only way you can tell them apart is by its naming convention.""I would like to see the impact analysis integrated with the performance testing tool. We have multiple tools doing multiple items. I would like to have one common tool.""We are looking for some enhancements on the Capture 2.0 tool. This would give us the ability to control it directly, like we could with Capture 1.0. Right now, Capture 2.0 doesn't really work for our Business Analysts.""There was a change to Capture 2.0. In the end, there have been some challenges with the newer version. Therefore, the company testers, the local ones, do not want to use Capture 2.0.""When it is unstable, there will be times when a test that we are running in Certify will just stop, and it will say, "Aborted." There will be errors. There will be no explanation as to why it happens. It has now happened maybe one out of 20 times. When it happens, I just tell our QA team to stop Certify and restart it, hoping we don't see it again."

More Worksoft Certify Cons »

"The user interface is a little bit tricky.""The solution could use some sort of educational features to offer tips and hints to help users navigate it better. They should improve the manuals and help files.""The tool should be made a bit more robust, and better support should be made available.""In future releases, it would be helpful if there was an integration with ALM Octane.""There is some work to be done with the integration.""Considering the kinds of tests we are performing here, where we launch several tests at the same time as a batch request, JMeter is not the best tool for the job. Those kinds of things could be done easily with other tools, like T6.""Automation is difficult in JMeter.""The interface could be made more user-friendly."

More Apache JMeter Cons »

"The Object Spy is rather frustrating to work with, so I tend not to use it.""Katalon doesn't support testing of hybrid applications. It's a limitation.""My recently-updated Katalon studio version hangs a lot and is not a stable version.""We have had some issues when it comes to stability, which is something that needs to be improved.""They need to work on documentation to make it more centralized and easier to find what you are looking for.""It would be helpful to have an automatic save feature.""It is difficult to identify elements on websites that use Angular or ReactJS because they don't have an option to view source code.""There is not much support offered for the free version, which is something that could be improved."

More Katalon Studio Cons »

Pricing and Cost Advice
"We would purchase more licenses right now if they were cheaper. Pricing is a little bit of a hindrance.""It is expensive compared to some of the other automation tools in the market. However, the benefits and ROI has proved that it has been a good investment.""The initial upfront cost in terms of licenses, plus all the money that we spent developing tests, has proven it's worth. Now, we can do a regression test suite in ten days as opposed to sixteen weeks.""Our ROI is primarily a reduction in testing time. The testing, when we were doing it manually, was 30 to 40 percent of the project's cost.""We ended up buying too many licenses. They were very good at selling it to us, and probably oversold it a little. We bought 45 licenses and have never used more than twenty. However, they gave us a pretty significant discount on the bigger license, so it made sense for us to buy enough that we wouldn't have to go back and ask for more.""We could use Certify to do robotic process automation, which is basically running a process on your correction system instead of your test system. Therefore, we may do that in the future.""By using automation, it reduced about 75 percent of the time when compared to any other tool.""Saving money and better quality, these are the benefits of Certify."

More Worksoft Certify Pricing and Cost Advice »

"Free""I switched to Apache because it is free. Other tools are much too expensive and can cost up to $50,000 a year if you are looking at commercial options.""This is an open-source solution, and there are no fees.""This is an open-source product.""I was using the free version of the software.""In terms of open-source adoption, it is completely free."

More Apache JMeter Pricing and Cost Advice »

"This product is freeware, so there is no charge for using it.""The tool is free to use.""It is freeware software, so start using it.""There is a free version of the tool to use and support is available through the community forums, but there is a licensed version as well.""We were using the free version of this tool.""Katalon Studio is a free tool.""We are using the free version of Katalon Studio at this point.""The price is not high it's good."

More Katalon Studio Pricing and Cost Advice »

report
Use our free recommendation engine to learn which API Testing Tools solutions are best for your needs.
455,962 professionals have used our research since 2012.
Questions from the Community
Top Answer: It does allow for good reusability. When it's designed properly and utilized properly, we can put things in a way that… more »
Top Answer: Looking at it as a product fully packaged, I would like to see more documentation or ease of use of the documentation… more »
Top Answer: When there's a high number of TPS I can achieve more transactions per seconds given the hyper-limitations.
Top Answer: We have some scenarios for diameter load testing where TPS requirements are very high, 30K or 40K TPS. In the telco… more »
Top Answer: It is easy for a non-technical person to use and adopt.
Top Answer: It is difficult to identify elements on websites that use Angular or ReactJS because they don't have an option to view… more »
Popular Comparisons
Compared 31% of the time.
Compared 26% of the time.
Compared 30% of the time.
Compared 9% of the time.
Compared 6% of the time.
Compared 12% of the time.
Compared 11% of the time.
Compared 8% of the time.
Also Known As
JMeter
Learn
Worksoft
Apache
Katalon Studio
Overview
Worksoft is a leading global provider of automation software for high-velocity business process testing and discovery. Enterprises worldwide use Worksoft intelligent automation to innovate faster, lower technology risk, reduce costs, improve quality, and deeply understand their real end-to-end business processes. Global 5000 companies across all industries choose Worksoft for high speed process discovery and functional testing of digital, web, cloud, mobile, big data, and dozens of enterprise applications, including SAP, Oracle, and Salesforce.com.

Apache JMeter may be used to test performance both on static and dynamic resources, Web dynamic applications. It can be used to simulate a heavy load on a server, group of servers, network or object to test its strength or to analyze overall performance under different load types.


Katalon Studio is a simple and powerful automation solution built by KMS Technology for testers everywhere. The tool provides features comparable to popular commercial solutions while eliminating the hassle of building an automation framework from open sources. Best of all, we are committed to keeping Katalon Studio free.

Offer
Learn more about Worksoft Certify
Learn more about Apache JMeter
Learn more about Katalon Studio
Sample Customers
Kraft, Reliant Energy, Richemont, Applied Materials, Siemens PLM, Mosaic, Dow Corning, ebay, IBM, Accenture, Fortis BC, US Government, Southwest AirlinesAOL, Orbitz, Innopath Software, PrepMe, Sapient, Corporate Express Australia, CSIRO, Ephibian, Talis, DATACOM, ALALOOP, eFusion, Panter, Sourcepole, University of Western Cape Coca-Cola Tesla Black Board TaTa Consultancy Services Sony
Top Industries
REVIEWERS
Manufacturing Company28%
Consumer Goods Company13%
Energy/Utilities Company13%
Logistics Company8%
VISITORS READING REVIEWS
Computer Software Company36%
Comms Service Provider11%
Manufacturing Company8%
Financial Services Firm6%
REVIEWERS
Financial Services Firm33%
Computer Software Company20%
University7%
Comms Service Provider7%
VISITORS READING REVIEWS
Computer Software Company40%
Comms Service Provider18%
Financial Services Firm6%
Media Company4%
VISITORS READING REVIEWS
Computer Software Company36%
Comms Service Provider19%
Financial Services Firm5%
Government5%
Company Size
REVIEWERS
Small Business6%
Midsize Enterprise9%
Large Enterprise85%
VISITORS READING REVIEWS
Small Business9%
Midsize Enterprise9%
Large Enterprise82%
REVIEWERS
Small Business24%
Midsize Enterprise24%
Large Enterprise53%
REVIEWERS
Small Business44%
Midsize Enterprise6%
Large Enterprise50%
Find out what your peers are saying about Apache JMeter vs. Katalon Studio and other solutions. Updated: January 2021.
455,962 professionals have used our research since 2012.

Apache JMeter is ranked 6th in API Testing Tools with 15 reviews while Katalon Studio is ranked 5th in API Testing Tools with 11 reviews. Apache JMeter is rated 7.6, while Katalon Studio is rated 8.0. The top reviewer of Apache JMeter writes "Good performance and easy to configure but could use better UI". On the other hand, the top reviewer of Katalon Studio writes "Powerful yet easy-to-use and focuses on the end-user as well as interface testing". Apache JMeter is most compared with Postman, BlazeMeter, Micro Focus LoadRunner Professional, LoadUI Pro and Micro Focus LoadRunner Cloud, whereas Katalon Studio is most compared with SmartBear TestComplete, Tricentis Tosca, Ranorex Studio, TestProject and Micro Focus UFT One. See our Apache JMeter vs. Katalon Studio report.

See our list of best API Testing Tools vendors.

We monitor all API Testing Tools reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.