Apache JMeter vs Worksoft Certify comparison

Cancel
You must select at least 2 products to compare!
Apache Logo
8,414 views|6,767 comparisons
87% willing to recommend
Worksoft Logo
4,859 views|2,371 comparisons
95% willing to recommend
Comparison Buyer's Guide
Executive Summary

We performed a comparison between Apache JMeter and Worksoft Certify based on real PeerSpot user reviews.

Find out in this report how the two API Testing Tools solutions compare in terms of features, pricing, service and support, easy of deployment, and ROI.
To learn more, read our detailed Apache JMeter vs. Worksoft Certify Report (Updated: March 2024).
768,924 professionals have used our research since 2012.
Featured Review
Quotes From Members
We asked business professionals to review the solutions they use.
Here are some excerpts of what they said:
Pros
"Very user-friendly and easy to use.""I use all the tools, but one feature that stands out is JMeter's ability to test when services are sending a particular kind of request. We are using specific ports to send queries, and assess the performance based on the time it takes these queries to respond. You can use it with stuff other than the web performance.""JMeter is basically the art of the entire performance testing process.""The most valuable features are the integration with Jenkins and the reporting.""A lot of things are valuable. It is free. It has a lot of features, such as report generation and integration with CI/CD, which makes it very competitive with the other paid solutions available in the market. It is a good solution.""I appreciate JMeter's simplicity and power for performance testing.""The biggest thing I liked about it is that there is a huge user base out there, and being shareware and being Apache, if I have any question on how to get something done, I get 18 different answers. Out of those, there would be at least a few good approaches for what I was trying to do. So, the support system out there is most valuable.""API testing, Database Testing, and MQ testing can be done with ease."

More Apache JMeter Pros →

"A specific feature that I found to be the most valuable in the solution for our company's work processes stems from the fact that it is useful as a low-code automation tool.""Worksoft Certify Mostly is an easy-to-learn tool and does not require any extensive training.""It is very easy to maintain. With scripts, I can change one line and in one step. Whatever I want, I can do. I don't need to be an expert to use it.""Improvement means for us that we have to be better in quality. Due to automation, you can run every automated test case twice a week. If you do it manually, you do it once per release. This is a quality improvement.""It's script-free, which is really important for our end users because we are usually dealing with colleagues who are not developers and who do not always have the technical background of developing and scripting. It's very useful that there is a nice UI and the tool is script-free.""The most valuable feature is the ability to automate quickly and to maintain and update scripts.""One of the biggest advantages for this solution is codeless automation. Because it is codeless, you can train people within a couple of hours.""The scripting methodology is easy to learn. It is easy to maintain because it is presented in a simple, narrative way. You don't need to know programming." "It has reduced our test maintenance time by more than 50 percent because we don't have to do manual test processes. We have saved over 150 man-hours monthly. It has increased our delivery times. We went from 200 man-hours down (three weeks work time frame) to approximately 40 man-hours (three days work time frame)."

More Worksoft Certify Pros →

Cons
"Because so much is being done these days with authentication processes, a better system for either getting bearer tokens or some kind of token-based authentication prior to executing APIs would benefit the product. It is there, and you can do things. It is just not real clean at this point. There should be a better authentication process for JMeter or some automation or better guidelines for gaining and utilizing tokens on the fly.""It should be easier to combine multiple scripts. If you have multiple scripts, you need to write a new script to combine those scripts. The virtual user generator is slow.""We would like some reporting and analysis tools to be added to this solution.""The UI has room for improvement.""The tool should be made a bit more robust, and better support should be made available.""Modeling a test is difficult. If you don't have much knowledge, you won't be able to do it easily. Testing APIs is also difficult.""Report generation needs to be improved. It is quite difficult to get to.""It will be much easier, and beneficial for the individual to run it on their own machines rather than having a high-end infrastructure, more CPUs, or more memory that has been consumed by Apache JMeter."

More Apache JMeter Cons →

"Worksoft Certify needs a bit of improvement for its web-based processes. It can be difficult because you need to recall the maps, then you still have to add-on for your browser. When you are using the browser-based testing, you cannot even move your mouse or do anything on your system when you are using the web-based testing. Therefore, it needs a bit of improvement on that side. While it does work, it needs improvement. From the SAP side, there is nothing better than Worksoft Certify. However, from the web-based, we are moving towards Fiori. SAP will soon be totally web-based. For Fiori, they need to be great with SAP testing. Thus, Worksoft has to improve the web-based testing part for Certify.""The problem with Worksoft Certify is that it's not always stable. It runs on a live platform that's constantly changing, so the test script needs to be adjusted every time, which is very painful.""With one of our applications where we do check-in, Worksoft is not able to identify the Java-based application. We raised the ticket, but we were unable to resolve this using Worksoft.""We would like this to be able to be used outside of SAP applications, as it would be good for other types of products.""When it comes to mobile testing, we have a small bottleneck there. You have to buy third-party separate licenses if you want to test on a mobile. Business wise we see room for improvement there, although it's that really critical for us.""I would like BPP to have more filtering options during the report creation. This would make our customers happy.""For Execution Manager, I would like it to be more robust interface and be able to view the remote machines full screen instead of a little window.""The primary area for improvement is the support service."

More Worksoft Certify Cons →

Pricing and Cost Advice
  • "Free"
  • "I switched to Apache because it is free. Other tools are much too expensive and can cost up to $50,000 a year if you are looking at commercial options."
  • "This is an open-source solution, and there are no fees."
  • "This is an open-source product."
  • "I was using the free version of the software."
  • "In terms of open-source adoption, it is completely free."
  • "We are using the free version, and if required, we can easily switch to the other version."
  • "When comparing the price with Load Runner, and if the cost is an issue then JMeter is a better choice"
  • More Apache JMeter Pricing and Cost Advice →

  • "The tool is not really good at all because you need to purchase some additional tools."
  • "We would purchase more licenses right now if they were cheaper. Pricing is a little bit of a hindrance."
  • "It is expensive compared to some of the other automation tools in the market. However, the benefits and ROI has proved that it has been a good investment."
  • "The initial upfront cost in terms of licenses, plus all the money that we spent developing tests, has proven it's worth. Now, we can do a regression test suite in ten days as opposed to sixteen weeks."
  • "Our ROI is primarily a reduction in testing time. The testing, when we were doing it manually, was 30 to 40 percent of the project's cost."
  • "We ended up buying too many licenses. They were very good at selling it to us, and probably oversold it a little. We bought 45 licenses and have never used more than twenty. However, they gave us a pretty significant discount on the bigger license, so it made sense for us to buy enough that we wouldn't have to go back and ask for more."
  • "We could use Certify to do robotic process automation, which is basically running a process on your correction system instead of your test system. Therefore, we may do that in the future."
  • "By using automation, it reduced about 75 percent of the time when compared to any other tool."
  • More Worksoft Certify Pricing and Cost Advice →

    report
    Use our free recommendation engine to learn which API Testing Tools solutions are best for your needs.
    768,924 professionals have used our research since 2012.
    Questions from the Community
    Top Answer:Postman lets you easily define variables, which then get updated automatically. This is a huge time-saver and makes processes very efficient. We can also export the test cases we create and share them… more »
    Top Answer:Blazemeter is a continuous testing platform that provides scriptless test automation. It unifies functional and performance testing, enabling users to monitor and test public and private APIs We… more »
    Top Answer: I appreciate JMeter's simplicity and power for performance testing.
    Top Answer:Tosca fulfills our business needs better because it is an end-to-end solution across technologies. We like that it is scriptless, so even non-experienced staff can use it. To put it simply, with… more »
    Top Answer:A specific feature that I found to be the most valuable in the solution for our company's work processes stems from the fact that it is useful as a low-code automation tool.
    Top Answer:Worksoft Certify is priced higher than most tools. I rate Worksoft Certify an eight out of ten for pricing.
    Ranking
    3rd
    out of 13 in API Testing Tools
    Views
    8,414
    Comparisons
    6,767
    Reviews
    45
    Average Words per Review
    487
    Rating
    7.6
    6th
    out of 13 in API Testing Tools
    Views
    4,859
    Comparisons
    2,371
    Reviews
    12
    Average Words per Review
    552
    Rating
    8.1
    Comparisons
    Also Known As
    JMeter
    Learn More
    Overview

    Apache JMeter is an open-source Java application that tests load and functional behavior and performance in applications. Created initially to test web applications, it has expanded its functionality to test other functions. For instance, you can test a server to see how efficiently it works and how many user requests can be handled simultaneously.

    You can use JMeter to test functional performance and regression tests on different technologies. This Java desktop application has an easy-to-use graphical interface which uses the Swing graphical API. You can run JMeter on any environment that accepts a Java virtual machine, such as Windows, Linux, and Mac.

    What protocols does JMeter support?

    • Web - HTTP, HTTPS
    • Web services - SOAP/XML-RPC
    • Email service - POP3, IMAP, SMTP
    • FTP service
    • Database via JDBC drivers
    • LDAP
    • Native commands or shell scripts
    • TCP
    • Java objects

    How does JMeter work?

    JMeter sends requests to a target server by simulating a group of user requests. Then it collects and calculates statistics on the performance of the target. This target can be a server or an application.

    You can test the performance of static resources, such as JavaScript or HTML, and dynamic resources, such as JSP, Servlets, and AJAX. It is also helpful to determine how many concurrent users your website can handle.

    There are two main tests you can carry out with JMeter: load test and stress test. The load test models expected usage of a server by simulating multiple users accessing the web server simultaneously. The stress testing aims to find the maximum load capacity of the server or application.

    Apache JMeter Key Features

    • JMeter enables fast test plan recording, building, and debugging via a featured test IDE (integrated development environment).
    • Command-line mode allows carrying out load tests from any OS compatible with Java.
    • JMeter can extract data from most popular response formats, such as HTML, JSON, XML.
    • JMeter is entirely portable.
    • A multithreading framework allows you to simultaneously test multiple samplings and separate thread groups.
    • Thanks to the caching feature, you can conduct offline analysis or replay test results.

    Apache JMeter Benefits

    • As open-source software, it is freely available and continuously improved.
    • The setup is user-friendly, and no installation is needed.
    • The GUI (graphic user interface) is intuitive and easy to use.
    • You can write your own tests and use the visualization plugins to extend the testing.
    • It is a platform-agnostic tool. For example, JMeter can work with Linux by clicking on the JMeter shell script. On Windows, you can call up JMeter by starting the jmeter.bat file.
    • Since the test plans are stored in XML format, you can generate a test plan using any text editor.
    • You can simulate a heavy load on a server, a group of servers, a network, or an object. Use JMeter to test an application or server's strength and performance under different load types.

    The JMeter extensible core has numerous benefits:

    • Unlimited testing capabilities via pluggable samplers.
    • You can choose multiple load statistics with pluggable timers.
    • Visualization plugins and data analysis enable customization.
    • Continuous integration via third-party open-source libraries (Maven, Gradle, and Jenkins).

    Reviews from Real Users

    Stephen B., I.T. Architect, Analyst, and Developer at an educational organization, says, "The scripting ability is most valuable. It is easy to use. There is a UI, and you can go in there and figure those things out. After you've got a good set of tests, you basically have a scripted document that you can grab and execute in a pipeline. It is pretty quick to set up, and you can scale it and version control it."

    "I like the fact that JMeter integrates well with other tools," adds the Founder and Principal Consultant at a tech services company.

    A Quality Engineering Delivery Leader at a financial services firm says, “The performance of the solution is excellent. They have designed the product so that it is very easy to configure. You can basically do anything you like with the product. It's not very restrictive. We like the fact that the technology is open-source.”

    Worksoft Certify is the industry's first codeless automated testing system, created for non-technical people to test end-to-end business processes at an enterprise scale.

    It was designed to test complicated processes spanning numerous apps and integrating into contemporary DevOps tool chains. Worksoft Certify manages dynamic input, process flows, and frequent variances in business processes with ease.

    Worksoft Certify automates the testing of your exact business processes across all of your enterprise applications. This solution makes it simple for customers and suppliers to package a process with all of its related dependencies, sub-processes, record sets, record filters, layouts, and variables.

    Worksoft Certify automates tests as effortlessly and quickly as the underlying applications permit, allowing you to evaluate business processes in record time with flawless dependability and consistency. Worksoft Certify speeds up test automation by utilizing a patented Object Action Framework, which effectively models the application under test as a set of pages containing GUI objects and test steps that perform actions on those objects.

    Worksoft Certify Features

    Worksoft Certify has many valuable key features. Some of the most useful ones include:

    • LiveTouch: Without coding, graphically edit and update tests.
    • No "fail" tests: See fail validations flagged when the end-to-end test continues.
    • Process comparison: Visually compare tests side by side and eliminate unnecessary tests to reduce maintenance
    • Magic search: AI-driven process search can find duplicate processes and keep automation libraries clean.
    • Exploratory testing: Real-time automated exploratory tests.
    • API testing: Utilize the virtual services and current SoapUI tests.
    • Test data generator: Obtain data from SAP for testing.
    • Create content: Make use of the more than 300 prebuilt SAP end-to-end testing scenarios.
    • Visual capture: Support agile testing by using automation artifacts from process discovery.
    • Full compatibility: Web, Java, .Net, client/server applications, SAP GUI, FIORI, web portal Workday, Salesforce, ServiceNow, Ariba, SuccessFactors, Hybris, AJAX, and more.

    Worksoft Certify Benefits

    There are many benefits to implementing Worksoft Certify. Some of the biggest advantages the solution offers include:

    • Speed: Automate at least 80% of testing to accelerate innovation.
    • Savings: Reduce overall testing and maintenance expenditures by 60% to 80%.
    • Confidence: Identify defects faster and reduce production defects by 60%.
    • DevOps-ready: Run tests as part of continuous integration, testing, or delivery cycle.
    • Support for RPA: Convert test scripts into robotic process automation.

    Reviews from Real Users

    Jens N., Enterprise Architect SAP Solutions at a computer software company, writes, “As compared to other tools for test automation, what is very good in this tool is the ability to implement logic into the scripts without coding and learning a complex script language. It is comparable to defining formulas in Excel. It is pretty easy to learn how to make your scripts more intelligent and more flexible as per the situation.”

    Aditya C., Sr Test Automation Architect at a tech services company, notes, “The most valuable features of Worksoft Certify are the way we can maintain the processes and sub-processes inside. We can immediately identify and replicate multiple objects in the application without having a major issue with it.”

    Sample Customers
    AOL, Orbitz, Innopath Software, PrepMe, Sapient, Corporate Express Australia, CSIRO, Ephibian, Talis, DATACOM, ALALOOP, eFusion, Panter, Sourcepole, University of Western Cape
    Kraft, Reliant Energy, Richemont, Applied Materials, Siemens PLM, Mosaic, Dow Corning, ebay, IBM, Accenture, Fortis BC, US Government, Southwest Airlines
    Top Industries
    REVIEWERS
    Computer Software Company38%
    Financial Services Firm30%
    Energy/Utilities Company4%
    Renewables & Environment Company4%
    VISITORS READING REVIEWS
    Financial Services Firm18%
    Computer Software Company17%
    Manufacturing Company7%
    Government6%
    REVIEWERS
    Manufacturing Company36%
    Energy/Utilities Company11%
    Computer Software Company9%
    Pharma/Biotech Company7%
    VISITORS READING REVIEWS
    Manufacturing Company17%
    Computer Software Company12%
    Retailer8%
    Financial Services Firm8%
    Company Size
    REVIEWERS
    Small Business25%
    Midsize Enterprise24%
    Large Enterprise52%
    VISITORS READING REVIEWS
    Small Business16%
    Midsize Enterprise13%
    Large Enterprise70%
    REVIEWERS
    Small Business7%
    Midsize Enterprise9%
    Large Enterprise84%
    VISITORS READING REVIEWS
    Small Business15%
    Midsize Enterprise13%
    Large Enterprise73%
    Buyer's Guide
    Apache JMeter vs. Worksoft Certify
    March 2024
    Find out what your peers are saying about Apache JMeter vs. Worksoft Certify and other solutions. Updated: March 2024.
    768,924 professionals have used our research since 2012.

    Apache JMeter is ranked 3rd in API Testing Tools with 82 reviews while Worksoft Certify is ranked 6th in API Testing Tools with 64 reviews. Apache JMeter is rated 7.8, while Worksoft Certify is rated 8.4. The top reviewer of Apache JMeter writes "It's a free tool with a vast knowledge base, but the reporting is lackluster, and it has a steep learning curve". On the other hand, the top reviewer of Worksoft Certify writes "Enables us to automate end-to-end testing of our integration between S/4HANA and Salesforce.com". Apache JMeter is most compared with BlazeMeter, Postman, Tricentis NeoLoad, OpenText LoadRunner Professional and Katalon Studio, whereas Worksoft Certify is most compared with Tricentis Tosca, Selenium HQ, OpenText UFT One, Katalon Studio and LEAPWORK. See our Apache JMeter vs. Worksoft Certify report.

    See our list of best API Testing Tools vendors.

    We monitor all API Testing Tools reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.