Apache JMeter vs Worksoft Certify comparison

Cancel
You must select at least 2 products to compare!
Apache Logo
7,505 views|6,025 comparisons
87% willing to recommend
Worksoft Logo
4,717 views|2,311 comparisons
95% willing to recommend
Comparison Buyer's Guide
Executive Summary

We performed a comparison between Apache JMeter and Worksoft Certify based on real PeerSpot user reviews.

Find out in this report how the two API Testing Tools solutions compare in terms of features, pricing, service and support, easy of deployment, and ROI.
To learn more, read our detailed Apache JMeter vs. Worksoft Certify Report (Updated: May 2024).
772,649 professionals have used our research since 2012.
Featured Review
Quotes From Members
We asked business professionals to review the solutions they use.
Here are some excerpts of what they said:
Pros
"We appreciate that the solution is free to use, as an open-source tool.""The most valuable features are the ability to capture the entire traffic of particular pages and the proper readability of entire pages and entire APIs.""It is cost-effective and simple to use.""It gives accurate results and recommendations that we can implement to enhance the performance of websites.""Very user-friendly and easy to use.""The solution helps by detecting bottlenecks.""It's a powerful tool that is open source.""We really appreciate that the solution comes with a live community, which continuously provided plugins and support protocols."

More Apache JMeter Pros →

"One of the bigger value-adds that we had was extracting data from our warning systems to be inputted into our new learning system.""What I like about Worksoft Certify is that end-to-end testing becomes faster.""With Worksoft, we have been able to automate six of our smoke tests in four months.""During our yearly upgrades, we have now gotten them down to ten days or less. We have Worksoft run all our integration tests, where it used to take probably six weeks to do that manually.""With autotesting, we have been able to eliminate duplication of test cases across those four areas. This has helped us knock down our number of test cases. Our test cases are also running more optimally. Therefore, it has very much helped in that sense, so we were able to eliminate a lot of test cases and get out of manual silos by running on autotesting, which is more efficient.""People focus on what they actually want to test and define it in a more detailed way. It shines a light on what they are testing, along with the speed and adaptability.""We are now trying to automate all our applications: SAP, web, third-party, and legacy. Instead of multiple tools, we have been able to have Worksoft handle a lot of our applications. This has saved us a lot of time and effort.""We are mainly using it for the SAP application, and for the SAP application, if you don't have any experience with automation tools, after a few training sessions, you can easily automate the scripts. That's because no specific programming language is used. All resources that I have are specifically SAP resources. They are not from the automation background, but after gaining the knowledge, they are able to develop a script, or when there is any issue while doing regression testing, they are at least able to understand the issue, such as whether the issue is in the code or data."

More Worksoft Certify Pros →

Cons
"The tool needs to have a better Graphical User Interface. Many of the solution's features are difficult to understand due to the complex user interface and user experience. The product needs to add plugins. It should also work on the integration with external partners like IDE and API gateways.""Report generation needs to be improved. It is quite difficult to get to.""Until now, JMeter is not supporting most of the protocols.""It has some proxy-based dependencies which require specific proxies to be set up or disabled, which causes problems.""The initial setup is complex and needs to be upgraded.""We're like the solution to be more user-friendly.""The only thing is the learning curve. It's high.""There could be improvements in terms of memory utilization. We are going to migrate away from JMeter in the near future."

More Apache JMeter Cons →

"With one of our applications where we do check-in, Worksoft is not able to identify the Java-based application. We raised the ticket, but we were unable to resolve this using Worksoft.""I would like Worksoft Certify to do automation at any layer (the UI layer, API layer, or database layer) and challenge competitors in the RPA industry, like UiPath and Automation Anywhere.""They have a scheduler in Execution Manager, but it is not customizable. Its UI needs a lot of improvement. The lights-out testing is a bit difficult with that particular tool, and it needs a lot of improvement. Of course, there are so many integration options with Worksoft for execution, but when it comes to Execution Manager, which is their own tool, there is a lot of scope for improvement.""I would like to see the impact analysis integrated with the performance testing tool. We have multiple tools doing multiple items. I would like to have one common tool.""An area that I would like to see improved is how the permissions are applied. If you're applying permissions groups to a user, one of the options is to delete the group entirely and lose the entire permission group, rather than just deleting the permission from the user, which seems a little silly. In my opinion, that whole module of permissions is very confusing and lends itself to common errors.""We're really hopeful for the mobile testing in Worksoft Certify going forward.""The technical support comes on, and says, "Oh, so-and-so link is here, go through that link, and make the modifications." I'm not comfortable in making those changes. I want to schedule a call, share my screen, and have them fix it for me.""In the past, when we've tried to automate some of our web apps, it has not been as robust. If there were one thing that could be improved, it's interaction with web applications. The issue we were running into is that it was harder to identify the objects than it is with some of the other architectured applications."

More Worksoft Certify Cons →

Pricing and Cost Advice
  • "Free"
  • "I switched to Apache because it is free. Other tools are much too expensive and can cost up to $50,000 a year if you are looking at commercial options."
  • "This is an open-source solution, and there are no fees."
  • "This is an open-source product."
  • "I was using the free version of the software."
  • "In terms of open-source adoption, it is completely free."
  • "We are using the free version, and if required, we can easily switch to the other version."
  • "When comparing the price with Load Runner, and if the cost is an issue then JMeter is a better choice"
  • More Apache JMeter Pricing and Cost Advice →

  • "The tool is not really good at all because you need to purchase some additional tools."
  • "We would purchase more licenses right now if they were cheaper. Pricing is a little bit of a hindrance."
  • "It is expensive compared to some of the other automation tools in the market. However, the benefits and ROI has proved that it has been a good investment."
  • "The initial upfront cost in terms of licenses, plus all the money that we spent developing tests, has proven it's worth. Now, we can do a regression test suite in ten days as opposed to sixteen weeks."
  • "Our ROI is primarily a reduction in testing time. The testing, when we were doing it manually, was 30 to 40 percent of the project's cost."
  • "We ended up buying too many licenses. They were very good at selling it to us, and probably oversold it a little. We bought 45 licenses and have never used more than twenty. However, they gave us a pretty significant discount on the bigger license, so it made sense for us to buy enough that we wouldn't have to go back and ask for more."
  • "We could use Certify to do robotic process automation, which is basically running a process on your correction system instead of your test system. Therefore, we may do that in the future."
  • "By using automation, it reduced about 75 percent of the time when compared to any other tool."
  • More Worksoft Certify Pricing and Cost Advice →

    report
    Use our free recommendation engine to learn which API Testing Tools solutions are best for your needs.
    772,649 professionals have used our research since 2012.
    Questions from the Community
    Top Answer:Postman lets you easily define variables, which then get updated automatically. This is a huge time-saver and makes processes very efficient. We can also export the test cases we create and share them… more »
    Top Answer:Blazemeter is a continuous testing platform that provides scriptless test automation. It unifies functional and performance testing, enabling users to monitor and test public and private APIs We… more »
    Top Answer: I appreciate JMeter's simplicity and power for performance testing.
    Top Answer:Tosca fulfills our business needs better because it is an end-to-end solution across technologies. We like that it is scriptless, so even non-experienced staff can use it. To put it simply, with… more »
    Top Answer:A specific feature that I found to be the most valuable in the solution for our company's work processes stems from the fact that it is useful as a low-code automation tool.
    Top Answer:Worksoft Certify is priced higher than most tools. I rate Worksoft Certify an eight out of ten for pricing.
    Ranking
    3rd
    out of 17 in API Testing Tools
    Views
    7,505
    Comparisons
    6,025
    Reviews
    38
    Average Words per Review
    487
    Rating
    7.8
    7th
    out of 17 in API Testing Tools
    Views
    4,717
    Comparisons
    2,311
    Reviews
    7
    Average Words per Review
    461
    Rating
    8.3
    Comparisons
    Also Known As
    JMeter
    Learn More
    Overview

    Apache JMeter is an open-source Java application that tests load and functional behavior and performance in applications. Created initially to test web applications, it has expanded its functionality to test other functions. For instance, you can test a server to see how efficiently it works and how many user requests can be handled simultaneously.

    You can use JMeter to test functional performance and regression tests on different technologies. This Java desktop application has an easy-to-use graphical interface which uses the Swing graphical API. You can run JMeter on any environment that accepts a Java virtual machine, such as Windows, Linux, and Mac.

    What protocols does JMeter support?

    • Web - HTTP, HTTPS
    • Web services - SOAP/XML-RPC
    • Email service - POP3, IMAP, SMTP
    • FTP service
    • Database via JDBC drivers
    • LDAP
    • Native commands or shell scripts
    • TCP
    • Java objects

    How does JMeter work?

    JMeter sends requests to a target server by simulating a group of user requests. Then it collects and calculates statistics on the performance of the target. This target can be a server or an application.

    You can test the performance of static resources, such as JavaScript or HTML, and dynamic resources, such as JSP, Servlets, and AJAX. It is also helpful to determine how many concurrent users your website can handle.

    There are two main tests you can carry out with JMeter: load test and stress test. The load test models expected usage of a server by simulating multiple users accessing the web server simultaneously. The stress testing aims to find the maximum load capacity of the server or application.

    Apache JMeter Key Features

    • JMeter enables fast test plan recording, building, and debugging via a featured test IDE (integrated development environment).
    • Command-line mode allows carrying out load tests from any OS compatible with Java.
    • JMeter can extract data from most popular response formats, such as HTML, JSON, XML.
    • JMeter is entirely portable.
    • A multithreading framework allows you to simultaneously test multiple samplings and separate thread groups.
    • Thanks to the caching feature, you can conduct offline analysis or replay test results.

    Apache JMeter Benefits

    • As open-source software, it is freely available and continuously improved.
    • The setup is user-friendly, and no installation is needed.
    • The GUI (graphic user interface) is intuitive and easy to use.
    • You can write your own tests and use the visualization plugins to extend the testing.
    • It is a platform-agnostic tool. For example, JMeter can work with Linux by clicking on the JMeter shell script. On Windows, you can call up JMeter by starting the jmeter.bat file.
    • Since the test plans are stored in XML format, you can generate a test plan using any text editor.
    • You can simulate a heavy load on a server, a group of servers, a network, or an object. Use JMeter to test an application or server's strength and performance under different load types.

    The JMeter extensible core has numerous benefits:

    • Unlimited testing capabilities via pluggable samplers.
    • You can choose multiple load statistics with pluggable timers.
    • Visualization plugins and data analysis enable customization.
    • Continuous integration via third-party open-source libraries (Maven, Gradle, and Jenkins).

    Reviews from Real Users

    Stephen B., I.T. Architect, Analyst, and Developer at an educational organization, says, "The scripting ability is most valuable. It is easy to use. There is a UI, and you can go in there and figure those things out. After you've got a good set of tests, you basically have a scripted document that you can grab and execute in a pipeline. It is pretty quick to set up, and you can scale it and version control it."

    "I like the fact that JMeter integrates well with other tools," adds the Founder and Principal Consultant at a tech services company.

    A Quality Engineering Delivery Leader at a financial services firm says, “The performance of the solution is excellent. They have designed the product so that it is very easy to configure. You can basically do anything you like with the product. It's not very restrictive. We like the fact that the technology is open-source.”

    Worksoft Certify is the industry's first codeless automated testing system, created for non-technical people to test end-to-end business processes at an enterprise scale.

    It was designed to test complicated processes spanning numerous apps and integrating into contemporary DevOps tool chains. Worksoft Certify manages dynamic input, process flows, and frequent variances in business processes with ease.

    Worksoft Certify automates the testing of your exact business processes across all of your enterprise applications. This solution makes it simple for customers and suppliers to package a process with all of its related dependencies, sub-processes, record sets, record filters, layouts, and variables.

    Worksoft Certify automates tests as effortlessly and quickly as the underlying applications permit, allowing you to evaluate business processes in record time with flawless dependability and consistency. Worksoft Certify speeds up test automation by utilizing a patented Object Action Framework, which effectively models the application under test as a set of pages containing GUI objects and test steps that perform actions on those objects.

    Worksoft Certify Features

    Worksoft Certify has many valuable key features. Some of the most useful ones include:

    • LiveTouch: Without coding, graphically edit and update tests.
    • No "fail" tests: See fail validations flagged when the end-to-end test continues.
    • Process comparison: Visually compare tests side by side and eliminate unnecessary tests to reduce maintenance
    • Magic search: AI-driven process search can find duplicate processes and keep automation libraries clean.
    • Exploratory testing: Real-time automated exploratory tests.
    • API testing: Utilize the virtual services and current SoapUI tests.
    • Test data generator: Obtain data from SAP for testing.
    • Create content: Make use of the more than 300 prebuilt SAP end-to-end testing scenarios.
    • Visual capture: Support agile testing by using automation artifacts from process discovery.
    • Full compatibility: Web, Java, .Net, client/server applications, SAP GUI, FIORI, web portal Workday, Salesforce, ServiceNow, Ariba, SuccessFactors, Hybris, AJAX, and more.

    Worksoft Certify Benefits

    There are many benefits to implementing Worksoft Certify. Some of the biggest advantages the solution offers include:

    • Speed: Automate at least 80% of testing to accelerate innovation.
    • Savings: Reduce overall testing and maintenance expenditures by 60% to 80%.
    • Confidence: Identify defects faster and reduce production defects by 60%.
    • DevOps-ready: Run tests as part of continuous integration, testing, or delivery cycle.
    • Support for RPA: Convert test scripts into robotic process automation.

    Reviews from Real Users

    Jens N., Enterprise Architect SAP Solutions at a computer software company, writes, “As compared to other tools for test automation, what is very good in this tool is the ability to implement logic into the scripts without coding and learning a complex script language. It is comparable to defining formulas in Excel. It is pretty easy to learn how to make your scripts more intelligent and more flexible as per the situation.”

    Aditya C., Sr Test Automation Architect at a tech services company, notes, “The most valuable features of Worksoft Certify are the way we can maintain the processes and sub-processes inside. We can immediately identify and replicate multiple objects in the application without having a major issue with it.”

    Sample Customers
    AOL, Orbitz, Innopath Software, PrepMe, Sapient, Corporate Express Australia, CSIRO, Ephibian, Talis, DATACOM, ALALOOP, eFusion, Panter, Sourcepole, University of Western Cape
    Kraft, Reliant Energy, Richemont, Applied Materials, Siemens PLM, Mosaic, Dow Corning, ebay, IBM, Accenture, Fortis BC, US Government, Southwest Airlines
    Top Industries
    REVIEWERS
    Computer Software Company38%
    Financial Services Firm30%
    Energy/Utilities Company4%
    Renewables & Environment Company4%
    VISITORS READING REVIEWS
    Financial Services Firm18%
    Computer Software Company17%
    Manufacturing Company8%
    Government6%
    REVIEWERS
    Manufacturing Company36%
    Energy/Utilities Company11%
    Computer Software Company9%
    Pharma/Biotech Company7%
    VISITORS READING REVIEWS
    Manufacturing Company17%
    Computer Software Company12%
    Retailer8%
    Energy/Utilities Company7%
    Company Size
    REVIEWERS
    Small Business25%
    Midsize Enterprise24%
    Large Enterprise52%
    VISITORS READING REVIEWS
    Small Business16%
    Midsize Enterprise13%
    Large Enterprise70%
    REVIEWERS
    Small Business9%
    Midsize Enterprise9%
    Large Enterprise83%
    VISITORS READING REVIEWS
    Small Business15%
    Midsize Enterprise12%
    Large Enterprise72%
    Buyer's Guide
    Apache JMeter vs. Worksoft Certify
    May 2024
    Find out what your peers are saying about Apache JMeter vs. Worksoft Certify and other solutions. Updated: May 2024.
    772,649 professionals have used our research since 2012.

    Apache JMeter is ranked 3rd in API Testing Tools with 82 reviews while Worksoft Certify is ranked 7th in API Testing Tools with 64 reviews. Apache JMeter is rated 7.8, while Worksoft Certify is rated 8.4. The top reviewer of Apache JMeter writes "It's a free tool with a vast knowledge base, but the reporting is lackluster, and it has a steep learning curve". On the other hand, the top reviewer of Worksoft Certify writes "Enables us to automate end-to-end testing of our integration between S/4HANA and Salesforce.com". Apache JMeter is most compared with BlazeMeter, Postman, Tricentis NeoLoad, OpenText LoadRunner Professional and Katalon Studio, whereas Worksoft Certify is most compared with Tricentis Tosca, Selenium HQ, OpenText UFT One, Katalon Studio and OpenText LoadRunner Professional. See our Apache JMeter vs. Worksoft Certify report.

    See our list of best API Testing Tools vendors.

    We monitor all API Testing Tools reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.