Apache JMeter vs Worksoft Certify comparison

Cancel
You must select at least 2 products to compare!
Apache Logo
8,414 views|6,767 comparisons
87% willing to recommend
Worksoft Logo
4,859 views|2,371 comparisons
95% willing to recommend
Comparison Buyer's Guide
Executive Summary

We performed a comparison between Apache JMeter and Worksoft Certify based on real PeerSpot user reviews.

Find out in this report how the two API Testing Tools solutions compare in terms of features, pricing, service and support, easy of deployment, and ROI.
To learn more, read our detailed Apache JMeter vs. Worksoft Certify Report (Updated: March 2024).
767,667 professionals have used our research since 2012.
Featured Review
Quotes From Members
We asked business professionals to review the solutions they use.
Here are some excerpts of what they said:
Pros
"We like that Apache JMeter has different features and different plugins and that they are free of charge.""The solution helps by detecting bottlenecks.""This solution is easier to use than any other tool in the market; there is not even a requirement to learn a lot of scripting in order to use it.""It is an open-source tool that is easy to use. It can be easily integrated with multiple tools, including Selenium.""The features that I appreciate are quite basic. It is easy to ramp up the threads and start calling the application. A lot of connectors can already be found within Apache JMeter, but we are not using the entire set because the integration between the customers and platform is based on HTTP. We are just going to produce lots of HTTP sequences.""When there's a high number of TPS I can achieve more transactions per seconds given the hyper-limitations.""JMeter's most valuable feature is the RegEx Extractor.""It's easy to set up."

More Apache JMeter Pros →

"The most valuable feature is its time saving. Once development is complete, the short time that it takes to execute a test is invaluable. It saves a number of dollars and man-hours.""It is highly scalable and reusable. It is easy for team members to maintain and use with confidence. There is great versatility.""It does allow for good reusability. When it's designed properly and utilized properly, we can put things in a way that allows for reusability, meaning a lot of reuse of VA01, if they're very similar flows, to keep it simple.""The most valuable features of Worksoft Certify are the way we can maintain the processes and sub-processes inside. We can immediately identify and replicate multiple objects in the application without having a major issue with it. We are able to do a lot of operations even with the solution being completely scriptless. That is a large advantage compared with other automation tools.""Worksoft Certify Mostly is an easy-to-learn tool and does not require any extensive training.""We found that Worksoft is easier to use because our business experts can do the tests. We didn't have to have IT experts.""It is a lot easier to maintain test scripts on Worksoft Certify than on other testing tools that we have had in the past.""For this SAP upgrade or implementation, the business users are creating building blocks in their areas, then they're changing the building blocks into long end-to-end scripts to do a complete end-to-end testing to speed up the UAT. It definitely has a bigger coverage of UAT testing."

More Worksoft Certify Pros →

Cons
"We would like more documentation to be provided for the advanced level features that are available in this solution, in order to improve development.""It will be much easier, and beneficial for the individual to run it on their own machines rather than having a high-end infrastructure, more CPUs, or more memory that has been consumed by Apache JMeter.""Currently, the integration pipeline is implemented by using Jenkins or a similar tool platform. These are continuous integration tools. As far as I know, integration is done by using custom scripts. It would be good if the integration with a continuous integration pipeline, like Jenkins or Hudson, can be done out of the box without using a script.""Apache JMeter may have difficulty recognizing dynamic objects in some critical cases, which can lead to challenges in terms of object identification.""In terms of setup, it could be nicer, to be honest. Sometimes, I get a little bit lost.""The user interface is a little bit tricky.""Improving JMeter's sync time would be beneficial.""At times when we overload the application, it gets stuck...After the solution gets stuck due to overloading, we have to restart our computers. In short, the solution keeps crashing."

More Apache JMeter Cons →

"For the couple of the issues that we were really scratching our heads over, we were in communication with the technical support several times, but they never got back to us.""We can't get the process intelligence module to work properly. We can't get the impact comment that analyzes the incoming development code to run, either. We've also had bugs in the CTM and execution manager in the past year. It took technical support a long time to resolve this issue. We escalated it so that the vice president of the company was included as well.""When it is unstable, there will be times when a test that we are running in Certify will just stop, and it will say, "Aborted." There will be errors. There will be no explanation as to why it happens. It has now happened maybe one out of 20 times. When it happens, I just tell our QA team to stop Certify and restart it, hoping we don't see it again.""We would like this to be able to be used outside of SAP applications, as it would be good for other types of products.""The technical support has been good, but sometimes there are little delays. A lot of times when we need support, it's an emergency situation.""The definitions for the objects need to be automated. They need to be recognized automatically by Worksoft Certify instead of changing them back and forth manually. This is also something that Worksoft is currently working on.""For Execution Manager, I would like it to be more robust interface and be able to view the remote machines full screen instead of a little window.""The product had some UI issues."

More Worksoft Certify Cons →

Pricing and Cost Advice
  • "Free"
  • "I switched to Apache because it is free. Other tools are much too expensive and can cost up to $50,000 a year if you are looking at commercial options."
  • "This is an open-source solution, and there are no fees."
  • "This is an open-source product."
  • "I was using the free version of the software."
  • "In terms of open-source adoption, it is completely free."
  • "We are using the free version, and if required, we can easily switch to the other version."
  • "When comparing the price with Load Runner, and if the cost is an issue then JMeter is a better choice"
  • More Apache JMeter Pricing and Cost Advice →

  • "The tool is not really good at all because you need to purchase some additional tools."
  • "We would purchase more licenses right now if they were cheaper. Pricing is a little bit of a hindrance."
  • "It is expensive compared to some of the other automation tools in the market. However, the benefits and ROI has proved that it has been a good investment."
  • "The initial upfront cost in terms of licenses, plus all the money that we spent developing tests, has proven it's worth. Now, we can do a regression test suite in ten days as opposed to sixteen weeks."
  • "Our ROI is primarily a reduction in testing time. The testing, when we were doing it manually, was 30 to 40 percent of the project's cost."
  • "We ended up buying too many licenses. They were very good at selling it to us, and probably oversold it a little. We bought 45 licenses and have never used more than twenty. However, they gave us a pretty significant discount on the bigger license, so it made sense for us to buy enough that we wouldn't have to go back and ask for more."
  • "We could use Certify to do robotic process automation, which is basically running a process on your correction system instead of your test system. Therefore, we may do that in the future."
  • "By using automation, it reduced about 75 percent of the time when compared to any other tool."
  • More Worksoft Certify Pricing and Cost Advice →

    report
    Use our free recommendation engine to learn which API Testing Tools solutions are best for your needs.
    767,667 professionals have used our research since 2012.
    Questions from the Community
    Top Answer:Postman lets you easily define variables, which then get updated automatically. This is a huge time-saver and makes processes very efficient. We can also export the test cases we create and share them… more »
    Top Answer:Blazemeter is a continuous testing platform that provides scriptless test automation. It unifies functional and performance testing, enabling users to monitor and test public and private APIs We… more »
    Top Answer:JMeter is basically the art of the entire performance testing process.
    Top Answer:Tosca fulfills our business needs better because it is an end-to-end solution across technologies. We like that it is scriptless, so even non-experienced staff can use it. To put it simply, with… more »
    Top Answer:A specific feature that I found to be the most valuable in the solution for our company's work processes stems from the fact that it is useful as a low-code automation tool.
    Top Answer:Worksoft Certify is priced higher than most tools. I rate Worksoft Certify an eight out of ten for pricing.
    Ranking
    3rd
    out of 13 in API Testing Tools
    Views
    8,414
    Comparisons
    6,767
    Reviews
    45
    Average Words per Review
    487
    Rating
    7.6
    6th
    out of 13 in API Testing Tools
    Views
    4,859
    Comparisons
    2,371
    Reviews
    12
    Average Words per Review
    552
    Rating
    8.1
    Comparisons
    Also Known As
    JMeter
    Learn More
    Overview

    Apache JMeter is an open-source Java application that tests load and functional behavior and performance in applications. Created initially to test web applications, it has expanded its functionality to test other functions. For instance, you can test a server to see how efficiently it works and how many user requests can be handled simultaneously.

    You can use JMeter to test functional performance and regression tests on different technologies. This Java desktop application has an easy-to-use graphical interface which uses the Swing graphical API. You can run JMeter on any environment that accepts a Java virtual machine, such as Windows, Linux, and Mac.

    What protocols does JMeter support?

    • Web - HTTP, HTTPS
    • Web services - SOAP/XML-RPC
    • Email service - POP3, IMAP, SMTP
    • FTP service
    • Database via JDBC drivers
    • LDAP
    • Native commands or shell scripts
    • TCP
    • Java objects

    How does JMeter work?

    JMeter sends requests to a target server by simulating a group of user requests. Then it collects and calculates statistics on the performance of the target. This target can be a server or an application.

    You can test the performance of static resources, such as JavaScript or HTML, and dynamic resources, such as JSP, Servlets, and AJAX. It is also helpful to determine how many concurrent users your website can handle.

    There are two main tests you can carry out with JMeter: load test and stress test. The load test models expected usage of a server by simulating multiple users accessing the web server simultaneously. The stress testing aims to find the maximum load capacity of the server or application.

    Apache JMeter Key Features

    • JMeter enables fast test plan recording, building, and debugging via a featured test IDE (integrated development environment).
    • Command-line mode allows carrying out load tests from any OS compatible with Java.
    • JMeter can extract data from most popular response formats, such as HTML, JSON, XML.
    • JMeter is entirely portable.
    • A multithreading framework allows you to simultaneously test multiple samplings and separate thread groups.
    • Thanks to the caching feature, you can conduct offline analysis or replay test results.

    Apache JMeter Benefits

    • As open-source software, it is freely available and continuously improved.
    • The setup is user-friendly, and no installation is needed.
    • The GUI (graphic user interface) is intuitive and easy to use.
    • You can write your own tests and use the visualization plugins to extend the testing.
    • It is a platform-agnostic tool. For example, JMeter can work with Linux by clicking on the JMeter shell script. On Windows, you can call up JMeter by starting the jmeter.bat file.
    • Since the test plans are stored in XML format, you can generate a test plan using any text editor.
    • You can simulate a heavy load on a server, a group of servers, a network, or an object. Use JMeter to test an application or server's strength and performance under different load types.

    The JMeter extensible core has numerous benefits:

    • Unlimited testing capabilities via pluggable samplers.
    • You can choose multiple load statistics with pluggable timers.
    • Visualization plugins and data analysis enable customization.
    • Continuous integration via third-party open-source libraries (Maven, Gradle, and Jenkins).

    Reviews from Real Users

    Stephen B., I.T. Architect, Analyst, and Developer at an educational organization, says, "The scripting ability is most valuable. It is easy to use. There is a UI, and you can go in there and figure those things out. After you've got a good set of tests, you basically have a scripted document that you can grab and execute in a pipeline. It is pretty quick to set up, and you can scale it and version control it."

    "I like the fact that JMeter integrates well with other tools," adds the Founder and Principal Consultant at a tech services company.

    A Quality Engineering Delivery Leader at a financial services firm says, “The performance of the solution is excellent. They have designed the product so that it is very easy to configure. You can basically do anything you like with the product. It's not very restrictive. We like the fact that the technology is open-source.”

    Worksoft Certify is the industry's first codeless automated testing system, created for non-technical people to test end-to-end business processes at an enterprise scale.

    It was designed to test complicated processes spanning numerous apps and integrating into contemporary DevOps tool chains. Worksoft Certify manages dynamic input, process flows, and frequent variances in business processes with ease.

    Worksoft Certify automates the testing of your exact business processes across all of your enterprise applications. This solution makes it simple for customers and suppliers to package a process with all of its related dependencies, sub-processes, record sets, record filters, layouts, and variables.

    Worksoft Certify automates tests as effortlessly and quickly as the underlying applications permit, allowing you to evaluate business processes in record time with flawless dependability and consistency. Worksoft Certify speeds up test automation by utilizing a patented Object Action Framework, which effectively models the application under test as a set of pages containing GUI objects and test steps that perform actions on those objects.

    Worksoft Certify Features

    Worksoft Certify has many valuable key features. Some of the most useful ones include:

    • LiveTouch: Without coding, graphically edit and update tests.
    • No "fail" tests: See fail validations flagged when the end-to-end test continues.
    • Process comparison: Visually compare tests side by side and eliminate unnecessary tests to reduce maintenance
    • Magic search: AI-driven process search can find duplicate processes and keep automation libraries clean.
    • Exploratory testing: Real-time automated exploratory tests.
    • API testing: Utilize the virtual services and current SoapUI tests.
    • Test data generator: Obtain data from SAP for testing.
    • Create content: Make use of the more than 300 prebuilt SAP end-to-end testing scenarios.
    • Visual capture: Support agile testing by using automation artifacts from process discovery.
    • Full compatibility: Web, Java, .Net, client/server applications, SAP GUI, FIORI, web portal Workday, Salesforce, ServiceNow, Ariba, SuccessFactors, Hybris, AJAX, and more.

    Worksoft Certify Benefits

    There are many benefits to implementing Worksoft Certify. Some of the biggest advantages the solution offers include:

    • Speed: Automate at least 80% of testing to accelerate innovation.
    • Savings: Reduce overall testing and maintenance expenditures by 60% to 80%.
    • Confidence: Identify defects faster and reduce production defects by 60%.
    • DevOps-ready: Run tests as part of continuous integration, testing, or delivery cycle.
    • Support for RPA: Convert test scripts into robotic process automation.

    Reviews from Real Users

    Jens N., Enterprise Architect SAP Solutions at a computer software company, writes, “As compared to other tools for test automation, what is very good in this tool is the ability to implement logic into the scripts without coding and learning a complex script language. It is comparable to defining formulas in Excel. It is pretty easy to learn how to make your scripts more intelligent and more flexible as per the situation.”

    Aditya C., Sr Test Automation Architect at a tech services company, notes, “The most valuable features of Worksoft Certify are the way we can maintain the processes and sub-processes inside. We can immediately identify and replicate multiple objects in the application without having a major issue with it.”

    Sample Customers
    AOL, Orbitz, Innopath Software, PrepMe, Sapient, Corporate Express Australia, CSIRO, Ephibian, Talis, DATACOM, ALALOOP, eFusion, Panter, Sourcepole, University of Western Cape
    Kraft, Reliant Energy, Richemont, Applied Materials, Siemens PLM, Mosaic, Dow Corning, ebay, IBM, Accenture, Fortis BC, US Government, Southwest Airlines
    Top Industries
    REVIEWERS
    Computer Software Company38%
    Financial Services Firm30%
    Energy/Utilities Company4%
    Renewables & Environment Company4%
    VISITORS READING REVIEWS
    Financial Services Firm18%
    Computer Software Company17%
    Manufacturing Company8%
    Government6%
    REVIEWERS
    Manufacturing Company36%
    Energy/Utilities Company11%
    Computer Software Company9%
    Pharma/Biotech Company7%
    VISITORS READING REVIEWS
    Manufacturing Company17%
    Computer Software Company12%
    Retailer8%
    Financial Services Firm7%
    Company Size
    REVIEWERS
    Small Business25%
    Midsize Enterprise24%
    Large Enterprise52%
    VISITORS READING REVIEWS
    Small Business16%
    Midsize Enterprise13%
    Large Enterprise70%
    REVIEWERS
    Small Business7%
    Midsize Enterprise9%
    Large Enterprise84%
    VISITORS READING REVIEWS
    Small Business14%
    Midsize Enterprise13%
    Large Enterprise73%
    Buyer's Guide
    Apache JMeter vs. Worksoft Certify
    March 2024
    Find out what your peers are saying about Apache JMeter vs. Worksoft Certify and other solutions. Updated: March 2024.
    767,667 professionals have used our research since 2012.

    Apache JMeter is ranked 3rd in API Testing Tools with 82 reviews while Worksoft Certify is ranked 6th in API Testing Tools with 64 reviews. Apache JMeter is rated 7.8, while Worksoft Certify is rated 8.4. The top reviewer of Apache JMeter writes "It's a free tool with a vast knowledge base, but the reporting is lackluster, and it has a steep learning curve". On the other hand, the top reviewer of Worksoft Certify writes "Enables us to automate end-to-end testing of our integration between S/4HANA and Salesforce.com". Apache JMeter is most compared with BlazeMeter, Postman, Tricentis NeoLoad, OpenText LoadRunner Professional and Katalon Studio, whereas Worksoft Certify is most compared with Tricentis Tosca, Selenium HQ, OpenText UFT One, Katalon Studio and LEAPWORK. See our Apache JMeter vs. Worksoft Certify report.

    See our list of best API Testing Tools vendors.

    We monitor all API Testing Tools reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.