Apache JMeter vs Worksoft Certify comparison

Cancel
You must select at least 2 products to compare!
Apache Logo
7,505 views|6,025 comparisons
87% willing to recommend
Worksoft Logo
4,717 views|2,311 comparisons
95% willing to recommend
Comparison Buyer's Guide
Executive Summary

We performed a comparison between Apache JMeter and Worksoft Certify based on real PeerSpot user reviews.

Find out in this report how the two API Testing Tools solutions compare in terms of features, pricing, service and support, easy of deployment, and ROI.
To learn more, read our detailed Apache JMeter vs. Worksoft Certify Report (Updated: May 2024).
772,679 professionals have used our research since 2012.
Featured Review
Quotes From Members
We asked business professionals to review the solutions they use.
Here are some excerpts of what they said:
Pros
"The product helps me get the expected performance from applications or servers and reduces costs. It also enhances the performance of the services and helped them reach their ultimate capacity.""Apache JMeter is stable.""The solution is scalable.""When someone in our organization wants to test web applications, they use Apache JMeter since they face no hurdles while using the solution.""The scripting ability is most valuable. It is easy to use. There is a UI, and you can go in there and figure those things out. After you've got a good set of tests, you basically have a scripted document that you can grab and execute in a pipeline. It is pretty quick to set up, and you can scale it and version control it.""The most valuable feature in JMeter is the Thread Group, which helps us to see whether the performance is good.""What I like best about Apache JMeter is its user-friendly GUI because even if you don't have very good coding knowledge or understanding, or even if you don't come from a development background, you can still use the solution with just a few clicks. This is what's unique about Apache JMeter, in comparison with other tools in the market. As Apache JMeter is open source, when there's a missing feature, you can search in several community blogs for plugins that you can use to modify Apache JMeter to meet your requirements, and this is another advantage.""It is open source as well as relatively extendable. It allows us to extend and add additional functionality and features. Its deployment is also very easy."

More Apache JMeter Pros →

"What I found most valuable in Worksoft Certify is its identification feature. I also found its automation feature valuable.""The tool is easy to use. It is a drag and drop Microsoft type of solution.""The tool itself is highly effective, especially when it comes to comprehensibility for newcomers.""People focus on what they actually want to test and define it in a more detailed way. It shines a light on what they are testing, along with the speed and adaptability.""The ability to work with the data, with recordsets, and plug those into the scripts is very easy and very powerful. We use it extensively.""The Worksoft Capture feature is most valuable. For example, if you are creating a sales order in SAP, you do not need to go to each field and do everything. You do not need to write code for each and every line. You can just turn on the Worksoft Capture feature and manually perform your actions. It will capture all manual actions, and it will give you the steps. It will write the steps for you.""It's module based and it's giving functionality.""Improvement means for us that we have to be better in quality. Due to automation, you can run every automated test case twice a week. If you do it manually, you do it once per release. This is a quality improvement."

More Worksoft Certify Pros →

Cons
"JMeter should be more stable. Every time there is a new release coming up, a lot of its older functionalities or the new functionalities that are brought in are not very well-documented. It should be documented properly, and there should be proper use cases.""The plug-ins make the reports heavy and they have to be run in non-GUI mode.""In terms of platform support, they need to extend the support for backend platforms and more of the legacy types of platforms.""They can improve it a little bit in terms of distribution load testing. We struggled with it during the distribution. In terms of reporting, runtime monitoring is not currently included, and it should be included. They can also improve it on the reporting side in terms of the comparison of the reports. They can also focus more on integration with CI/CD. Currently, people are using their own customized tools. It would be nice if Apache can provide some standard tools and procedures for integration with CI/CD tools like DPR. There are some tools, but it would be nice if official standard tools and procedures are available.""The solution could use some sort of educational features to offer tips and hints to help users navigate it better. They should improve the manuals and help files.""Currently, the integration pipeline is implemented by using Jenkins or a similar tool platform. These are continuous integration tools. As far as I know, integration is done by using custom scripts. It would be good if the integration with a continuous integration pipeline, like Jenkins or Hudson, can be done out of the box without using a script.""JMeter's reporting is extremely rudimentary. The fundamental reporting mechanisms need to be drastically improved. It doesn't utilize an automatic session management mechanism or methods other tools use like parsing cookies and variables. Everything needs to be done manually. There's no automation.""The UI could be better."

More Apache JMeter Cons →

"Certify is integrated with Solution Manager, but this integration could be easier.""The technical support has been good, but sometimes there are little delays. A lot of times when we need support, it's an emergency situation.""One feature that could be added to Capture 2.0 is generating a PDF file from your capture, so you can see your screenshots and steps.""The primary area for improvement is the support service.""I would like to see the impact analysis integrated with the performance testing tool. We have multiple tools doing multiple items. I would like to have one common tool.""The problem with Worksoft Certify is that it's not always stable. It runs on a live platform that's constantly changing, so the test script needs to be adjusted every time, which is very painful.""There are some other more complete tools than Worksoft Certify, such as Tricentis Tosca. It has a quicker way of taking in a customer's feedback with more efficiency. I do not see Worksoft Certify having a lot of progress over the years that we have used the tool in this area.""Capture 2.0 is not as useful when you get into more mature automation."

More Worksoft Certify Cons →

Pricing and Cost Advice
  • "Free"
  • "I switched to Apache because it is free. Other tools are much too expensive and can cost up to $50,000 a year if you are looking at commercial options."
  • "This is an open-source solution, and there are no fees."
  • "This is an open-source product."
  • "I was using the free version of the software."
  • "In terms of open-source adoption, it is completely free."
  • "We are using the free version, and if required, we can easily switch to the other version."
  • "When comparing the price with Load Runner, and if the cost is an issue then JMeter is a better choice"
  • More Apache JMeter Pricing and Cost Advice →

  • "The tool is not really good at all because you need to purchase some additional tools."
  • "We would purchase more licenses right now if they were cheaper. Pricing is a little bit of a hindrance."
  • "It is expensive compared to some of the other automation tools in the market. However, the benefits and ROI has proved that it has been a good investment."
  • "The initial upfront cost in terms of licenses, plus all the money that we spent developing tests, has proven it's worth. Now, we can do a regression test suite in ten days as opposed to sixteen weeks."
  • "Our ROI is primarily a reduction in testing time. The testing, when we were doing it manually, was 30 to 40 percent of the project's cost."
  • "We ended up buying too many licenses. They were very good at selling it to us, and probably oversold it a little. We bought 45 licenses and have never used more than twenty. However, they gave us a pretty significant discount on the bigger license, so it made sense for us to buy enough that we wouldn't have to go back and ask for more."
  • "We could use Certify to do robotic process automation, which is basically running a process on your correction system instead of your test system. Therefore, we may do that in the future."
  • "By using automation, it reduced about 75 percent of the time when compared to any other tool."
  • More Worksoft Certify Pricing and Cost Advice →

    report
    Use our free recommendation engine to learn which API Testing Tools solutions are best for your needs.
    772,679 professionals have used our research since 2012.
    Questions from the Community
    Top Answer:Postman lets you easily define variables, which then get updated automatically. This is a huge time-saver and makes processes very efficient. We can also export the test cases we create and share them… more »
    Top Answer:Blazemeter is a continuous testing platform that provides scriptless test automation. It unifies functional and performance testing, enabling users to monitor and test public and private APIs We… more »
    Top Answer: I appreciate JMeter's simplicity and power for performance testing.
    Top Answer:Tosca fulfills our business needs better because it is an end-to-end solution across technologies. We like that it is scriptless, so even non-experienced staff can use it. To put it simply, with… more »
    Top Answer:A specific feature that I found to be the most valuable in the solution for our company's work processes stems from the fact that it is useful as a low-code automation tool.
    Top Answer:Worksoft Certify is priced higher than most tools. I rate Worksoft Certify an eight out of ten for pricing.
    Ranking
    3rd
    out of 17 in API Testing Tools
    Views
    7,505
    Comparisons
    6,025
    Reviews
    38
    Average Words per Review
    487
    Rating
    7.8
    7th
    out of 17 in API Testing Tools
    Views
    4,717
    Comparisons
    2,311
    Reviews
    7
    Average Words per Review
    461
    Rating
    8.3
    Comparisons
    Also Known As
    JMeter
    Learn More
    Overview

    Apache JMeter is an open-source Java application that tests load and functional behavior and performance in applications. Created initially to test web applications, it has expanded its functionality to test other functions. For instance, you can test a server to see how efficiently it works and how many user requests can be handled simultaneously.

    You can use JMeter to test functional performance and regression tests on different technologies. This Java desktop application has an easy-to-use graphical interface which uses the Swing graphical API. You can run JMeter on any environment that accepts a Java virtual machine, such as Windows, Linux, and Mac.

    What protocols does JMeter support?

    • Web - HTTP, HTTPS
    • Web services - SOAP/XML-RPC
    • Email service - POP3, IMAP, SMTP
    • FTP service
    • Database via JDBC drivers
    • LDAP
    • Native commands or shell scripts
    • TCP
    • Java objects

    How does JMeter work?

    JMeter sends requests to a target server by simulating a group of user requests. Then it collects and calculates statistics on the performance of the target. This target can be a server or an application.

    You can test the performance of static resources, such as JavaScript or HTML, and dynamic resources, such as JSP, Servlets, and AJAX. It is also helpful to determine how many concurrent users your website can handle.

    There are two main tests you can carry out with JMeter: load test and stress test. The load test models expected usage of a server by simulating multiple users accessing the web server simultaneously. The stress testing aims to find the maximum load capacity of the server or application.

    Apache JMeter Key Features

    • JMeter enables fast test plan recording, building, and debugging via a featured test IDE (integrated development environment).
    • Command-line mode allows carrying out load tests from any OS compatible with Java.
    • JMeter can extract data from most popular response formats, such as HTML, JSON, XML.
    • JMeter is entirely portable.
    • A multithreading framework allows you to simultaneously test multiple samplings and separate thread groups.
    • Thanks to the caching feature, you can conduct offline analysis or replay test results.

    Apache JMeter Benefits

    • As open-source software, it is freely available and continuously improved.
    • The setup is user-friendly, and no installation is needed.
    • The GUI (graphic user interface) is intuitive and easy to use.
    • You can write your own tests and use the visualization plugins to extend the testing.
    • It is a platform-agnostic tool. For example, JMeter can work with Linux by clicking on the JMeter shell script. On Windows, you can call up JMeter by starting the jmeter.bat file.
    • Since the test plans are stored in XML format, you can generate a test plan using any text editor.
    • You can simulate a heavy load on a server, a group of servers, a network, or an object. Use JMeter to test an application or server's strength and performance under different load types.

    The JMeter extensible core has numerous benefits:

    • Unlimited testing capabilities via pluggable samplers.
    • You can choose multiple load statistics with pluggable timers.
    • Visualization plugins and data analysis enable customization.
    • Continuous integration via third-party open-source libraries (Maven, Gradle, and Jenkins).

    Reviews from Real Users

    Stephen B., I.T. Architect, Analyst, and Developer at an educational organization, says, "The scripting ability is most valuable. It is easy to use. There is a UI, and you can go in there and figure those things out. After you've got a good set of tests, you basically have a scripted document that you can grab and execute in a pipeline. It is pretty quick to set up, and you can scale it and version control it."

    "I like the fact that JMeter integrates well with other tools," adds the Founder and Principal Consultant at a tech services company.

    A Quality Engineering Delivery Leader at a financial services firm says, “The performance of the solution is excellent. They have designed the product so that it is very easy to configure. You can basically do anything you like with the product. It's not very restrictive. We like the fact that the technology is open-source.”

    Worksoft Certify is the industry's first codeless automated testing system, created for non-technical people to test end-to-end business processes at an enterprise scale.

    It was designed to test complicated processes spanning numerous apps and integrating into contemporary DevOps tool chains. Worksoft Certify manages dynamic input, process flows, and frequent variances in business processes with ease.

    Worksoft Certify automates the testing of your exact business processes across all of your enterprise applications. This solution makes it simple for customers and suppliers to package a process with all of its related dependencies, sub-processes, record sets, record filters, layouts, and variables.

    Worksoft Certify automates tests as effortlessly and quickly as the underlying applications permit, allowing you to evaluate business processes in record time with flawless dependability and consistency. Worksoft Certify speeds up test automation by utilizing a patented Object Action Framework, which effectively models the application under test as a set of pages containing GUI objects and test steps that perform actions on those objects.

    Worksoft Certify Features

    Worksoft Certify has many valuable key features. Some of the most useful ones include:

    • LiveTouch: Without coding, graphically edit and update tests.
    • No "fail" tests: See fail validations flagged when the end-to-end test continues.
    • Process comparison: Visually compare tests side by side and eliminate unnecessary tests to reduce maintenance
    • Magic search: AI-driven process search can find duplicate processes and keep automation libraries clean.
    • Exploratory testing: Real-time automated exploratory tests.
    • API testing: Utilize the virtual services and current SoapUI tests.
    • Test data generator: Obtain data from SAP for testing.
    • Create content: Make use of the more than 300 prebuilt SAP end-to-end testing scenarios.
    • Visual capture: Support agile testing by using automation artifacts from process discovery.
    • Full compatibility: Web, Java, .Net, client/server applications, SAP GUI, FIORI, web portal Workday, Salesforce, ServiceNow, Ariba, SuccessFactors, Hybris, AJAX, and more.

    Worksoft Certify Benefits

    There are many benefits to implementing Worksoft Certify. Some of the biggest advantages the solution offers include:

    • Speed: Automate at least 80% of testing to accelerate innovation.
    • Savings: Reduce overall testing and maintenance expenditures by 60% to 80%.
    • Confidence: Identify defects faster and reduce production defects by 60%.
    • DevOps-ready: Run tests as part of continuous integration, testing, or delivery cycle.
    • Support for RPA: Convert test scripts into robotic process automation.

    Reviews from Real Users

    Jens N., Enterprise Architect SAP Solutions at a computer software company, writes, “As compared to other tools for test automation, what is very good in this tool is the ability to implement logic into the scripts without coding and learning a complex script language. It is comparable to defining formulas in Excel. It is pretty easy to learn how to make your scripts more intelligent and more flexible as per the situation.”

    Aditya C., Sr Test Automation Architect at a tech services company, notes, “The most valuable features of Worksoft Certify are the way we can maintain the processes and sub-processes inside. We can immediately identify and replicate multiple objects in the application without having a major issue with it.”

    Sample Customers
    AOL, Orbitz, Innopath Software, PrepMe, Sapient, Corporate Express Australia, CSIRO, Ephibian, Talis, DATACOM, ALALOOP, eFusion, Panter, Sourcepole, University of Western Cape
    Kraft, Reliant Energy, Richemont, Applied Materials, Siemens PLM, Mosaic, Dow Corning, ebay, IBM, Accenture, Fortis BC, US Government, Southwest Airlines
    Top Industries
    REVIEWERS
    Computer Software Company38%
    Financial Services Firm30%
    Energy/Utilities Company4%
    Renewables & Environment Company4%
    VISITORS READING REVIEWS
    Financial Services Firm18%
    Computer Software Company17%
    Manufacturing Company8%
    Government6%
    REVIEWERS
    Manufacturing Company36%
    Energy/Utilities Company11%
    Computer Software Company9%
    Pharma/Biotech Company7%
    VISITORS READING REVIEWS
    Manufacturing Company17%
    Computer Software Company12%
    Retailer8%
    Energy/Utilities Company7%
    Company Size
    REVIEWERS
    Small Business25%
    Midsize Enterprise24%
    Large Enterprise52%
    VISITORS READING REVIEWS
    Small Business17%
    Midsize Enterprise13%
    Large Enterprise70%
    REVIEWERS
    Small Business9%
    Midsize Enterprise9%
    Large Enterprise83%
    VISITORS READING REVIEWS
    Small Business15%
    Midsize Enterprise12%
    Large Enterprise72%
    Buyer's Guide
    Apache JMeter vs. Worksoft Certify
    May 2024
    Find out what your peers are saying about Apache JMeter vs. Worksoft Certify and other solutions. Updated: May 2024.
    772,679 professionals have used our research since 2012.

    Apache JMeter is ranked 3rd in API Testing Tools with 82 reviews while Worksoft Certify is ranked 7th in API Testing Tools with 64 reviews. Apache JMeter is rated 7.8, while Worksoft Certify is rated 8.4. The top reviewer of Apache JMeter writes "It's a free tool with a vast knowledge base, but the reporting is lackluster, and it has a steep learning curve". On the other hand, the top reviewer of Worksoft Certify writes "Enables us to automate end-to-end testing of our integration between S/4HANA and Salesforce.com". Apache JMeter is most compared with BlazeMeter, Postman, Tricentis NeoLoad, OpenText LoadRunner Professional and Katalon Studio, whereas Worksoft Certify is most compared with Tricentis Tosca, Selenium HQ, OpenText UFT One, Katalon Studio and OpenText LoadRunner Professional. See our Apache JMeter vs. Worksoft Certify report.

    See our list of best API Testing Tools vendors.

    We monitor all API Testing Tools reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.