We performed a comparison between Apache JMeter and Worksoft Certify based on real PeerSpot user reviews.
Find out in this report how the two API Testing Tools solutions compare in terms of features, pricing, service and support, easy of deployment, and ROI."It's open source, so I like that about the product. And there's a lot of community support for it."
"The product helps me get the expected performance from applications or servers and reduces costs. It also enhances the performance of the services and helped them reach their ultimate capacity."
"The new version of the solution is stable."
"The thread groups, samplers, and listeners, which are all determined by the script's requirements, are the most valuable features of this solution."
"The most valuable feature for us is the available information on the forums and to be able to discuss and get answers from the people that are involved in using this tool."
"Very user-friendly and easy to use."
"This solution is easier to use than any other tool in the market; there is not even a requirement to learn a lot of scripting in order to use it."
"We like that Apache JMeter has different features and different plugins and that they are free of charge."
"The solution has cut our clients' test maintenance time for changes, like patches or system upgrades. They used to take a lot of time until the production validation completed. Now, it is just seconds until it is ready, so they can do executions within couple of minutes."
"The decoupling of the test scripts from the data and the application is a nice feature. When you are creating test scripts, for example, for a web application, you have to learn about Worksoft and how the controls of a screen can be interpreted by Worksoft. For that purpose, you create so-called maps. These maps are loosely coupled to your scripts, which means if the application is changed, the control will be changed from an identifier. You don't need to rework the entire script. You only need to do these adjustments in the map, and then you can automatically reuse the scripts. So, it is really a smart move to have the decoupling of scripts, maps, and data."
"With autotesting, we have been able to eliminate duplication of test cases across those four areas. This has helped us knock down our number of test cases. Our test cases are also running more optimally. Therefore, it has very much helped in that sense, so we were able to eliminate a lot of test cases and get out of manual silos by running on autotesting, which is more efficient."
"Worksoft Certify Mostly is an easy-to-learn tool and does not require any extensive training."
"It's pretty seamless with SAP and Salesforce because they've built in the field definitions and all the things that you need. You literally turn it on and execute your script and it records it. It's very simple. Then you can go back and put in some of the other functions. For example, instead of hard-coding field selections, you put in a data table so you can run it multiple times or with multiple data. It was actually written to work very well with SAP."
"The tool itself is highly effective, especially when it comes to comprehensibility for newcomers."
"It is very user-friendly with an appealing UI, unlike a lot of other automation tools that we have evaluated. The fact that it can be used to across SAP and non-SAP applications (including web-based apps) is a big advantage. Using Certify Process Capture functionality has helped in hassle free test design creation, without the need to spend any extra effort to capture test steps and screenshots. The integration elements across HPE ALM and Solution Manager also work well."
"We love the Capture 2.0 feature. It seems to work very well."
"Apache JMeter could use improvement in reporting. Currently, it isn't easy to generate reports in PDF format. While receiving reports in PDF format is possible, it requires a lot of customization. Additionally, when comparing the load test to others solutions it could improve."
"Because so much is being done these days with authentication processes, a better system for either getting bearer tokens or some kind of token-based authentication prior to executing APIs would benefit the product. It is there, and you can do things. It is just not real clean at this point. There should be a better authentication process for JMeter or some automation or better guidelines for gaining and utilizing tokens on the fly."
"In terms of platform support, they need to extend the support for backend platforms and more of the legacy types of platforms."
"What needs improvement in Apache JMeter is the very high load requirements when you want to scale it beyond certain thresholds. For example, small to mid-range testing is very easily done with Apache JMeter, but if you scale and increase the load, then it would be a problem because the tool consumes a lot of resources, probably because Apache JMeter provides an enriched UI experience, so it consumes a lot of memory and requires high CPU usage. This means you have to manage your infrastructure, or else you'll have high overhead expenses. As Apache JMeter is a heavyweight tool, that is an area for improvement, though I'm unsure if Apache can do something about it because it could be a result of the way it's architected. What I'd like to see from Apache JMeter in the future is for it to transition to the cloud, as a lot of cloud technologies emerge around the globe, and a lot of people prefer cloud-based solutions or cloud-native tools. Even if a company has a legacy system, it's still possible to transition to the cloud. I've worked with a company that was an on-premise company that moved to the cloud and became cloud-native. If Apache JMeter could transition to the cloud, similar to k6, then it could help lessen the intense resource consumption that's currently happening in Apache JMeter."
"Self-healing and page rendering for the end-users are not available in Apache JMeter."
"In Micro Focus LoadRunner we can go from the UI and we can configure it. There is no such feature in Apache JMeter. There should be UI-based recording history or logs."
"If JMeter could integrate with the EPM solution, it would be great. It could also be improved by offering more integrations for security. For example, most applications are secure with OpenID Connect protocols."
"It should start supporting the presentation layer. It currently provides performance testing specifically at the application and API level. It can be extended to the presentation layer, which includes mainly Angular and React frameworks. It should also be easy to use and easy to train people."
"For the couple of the issues that we were really scratching our heads over, we were in communication with the technical support several times, but they never got back to us."
"Our interactions with technical support has not been the best always and there is room for improvement especially with respect to the time taken to respond to cases. However, with the right contacts and reasonable escalations we have always managed to get quick attention on our cases."
"Certify is integrated with Solution Manager, but this integration could be easier."
"It is very easy to use, but there are some places where they need to improve their security. E.g., the BPP tool is just a URL, which does not ask you for a username and password. Anyone can login and can see it."
"It is poor for a web based application."
"The stability needs help. This is main thing that needs help, and if it's not the stability, then it's Worksoft's ability to respond to issues."
"Worksoft Certify's support team should respond more promptly when we are stuck with certain issues and looking for a solution."
"The overall speed and performance of this solution could be improved. In a future release, it would be useful to be able to do API testing."
Apache JMeter is ranked 3rd in API Testing Tools with 82 reviews while Worksoft Certify is ranked 7th in API Testing Tools with 64 reviews. Apache JMeter is rated 7.8, while Worksoft Certify is rated 8.4. The top reviewer of Apache JMeter writes "It's a free tool with a vast knowledge base, but the reporting is lackluster, and it has a steep learning curve". On the other hand, the top reviewer of Worksoft Certify writes "Enables us to automate end-to-end testing of our integration between S/4HANA and Salesforce.com". Apache JMeter is most compared with BlazeMeter, Postman, Tricentis NeoLoad, Katalon Studio and OpenText LoadRunner Professional, whereas Worksoft Certify is most compared with Tricentis Tosca, Selenium HQ, OpenText UFT One, Katalon Studio and IBM Rational Functional Tester. See our Apache JMeter vs. Worksoft Certify report.
See our list of best API Testing Tools vendors.
We monitor all API Testing Tools reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.
