We performed a comparison between Apache JMeter and Tricentis Tosca based on real PeerSpot user reviews.
Find out in this report how the two API Testing Tools solutions compare in terms of features, pricing, service and support, easy of deployment, and ROI."The features that I appreciate are quite basic. It is easy to ramp up the threads and start calling the application. A lot of connectors can already be found within Apache JMeter, but we are not using the entire set because the integration between the customers and platform is based on HTTP. We are just going to produce lots of HTTP sequences."
"We really appreciate that the solution comes with a live community, which continuously provided plugins and support protocols."
"JMeter is a free tool with a large user population, which comes in handy because we have a vast knowledge base to tap into when needed. It's also easier to hire consultants who know JMeter."
"The most valuable features are the ability to capture the entire traffic of particular pages and the proper readability of entire pages and entire APIs."
"It's very easy to install, and it's very easy to code and develop the script."
"It is an open-source tool that is easy to use. It can be easily integrated with multiple tools, including Selenium."
"The solution offers a lot of plug-ins and a huge continuously developing community that is regularly offering new features and plug-ins."
"What I like best about Apache JMeter is its user-friendly GUI because even if you don't have very good coding knowledge or understanding, or even if you don't come from a development background, you can still use the solution with just a few clicks. This is what's unique about Apache JMeter, in comparison with other tools in the market. As Apache JMeter is open source, when there's a missing feature, you can search in several community blogs for plugins that you can use to modify Apache JMeter to meet your requirements, and this is another advantage."
"It can provide all levels of testing from design to execution to reporting."
"The low code is the best feature."
"The most valuable features of Tricentis Tosca are the ease of use, you do not need to program if you do not want to."
"This solution is easy to use for everybody, including those who are not IT-educated."
"This tool has test data management capability along with test management."
"This solution is very easy to learn and any non-programmer or manual tester, with little experience in automation, can pick it up quite easily."
"The most valuable feature is being able to create a test case by recording some scenarios and then leasing that task case to other scenarios."
"One notable feature is its ability to handle negative XPath healing processes. If one XPath fails, Tosca can utilize backup XPaths to ensure test cases do not fail due to locator issues, thereby focusing on identifying application-side issues, which is the ultimate goal."
"We would like more documentation to be provided for the advanced level features that are available in this solution, in order to improve development."
"They can improve it a little bit in terms of distribution load testing. We struggled with it during the distribution. In terms of reporting, runtime monitoring is not currently included, and it should be included. They can also improve it on the reporting side in terms of the comparison of the reports. They can also focus more on integration with CI/CD. Currently, people are using their own customized tools. It would be nice if Apache can provide some standard tools and procedures for integration with CI/CD tools like DPR. There are some tools, but it would be nice if official standard tools and procedures are available."
"The tool needs to have a better Graphical User Interface. Many of the solution's features are difficult to understand due to the complex user interface and user experience. The product needs to add plugins. It should also work on the integration with external partners like IDE and API gateways."
"There are certain things like we can't merge custom metrics into the JMeter reports. We're limited to JMeter metrics, and other server metrics can't be integrated with JMeter dashboard. This forces us to rely on another tool."
"Currently, the integration pipeline is implemented by using Jenkins or a similar tool platform. These are continuous integration tools. As far as I know, integration is done by using custom scripts. It would be good if the integration with a continuous integration pipeline, like Jenkins or Hudson, can be done out of the box without using a script."
"JMeter should be more stable. Every time there is a new release coming up, a lot of its older functionalities or the new functionalities that are brought in are not very well-documented. It should be documented properly, and there should be proper use cases."
"The UI needs some work. The first time I used JMeter, I couldn't record the full scenario to mimic the user experience. Since then, they have introduced some plugins and a third-party tool called BlazeMeter."
"JMeter's reporting is extremely rudimentary. The fundamental reporting mechanisms need to be drastically improved. It doesn't utilize an automatic session management mechanism or methods other tools use like parsing cookies and variables. Everything needs to be done manually. There's no automation."
"First, Tricentis could improve Tosca's Linux scripting. We can automate Linux scripting, but there are a few commands that Tosca doesn't support. DVS support and the object identification mechanism could also be better."
"I have found that some of the functions could be missed in the solution for new users. They are not obviously present."
"Parallel execution is not yet implemented for Tosca. This means you can't execute the same test case on multiple machines remotely."
"Primarily I'm dealing with customers looking for a cheap solution, and they are willing to try open-source automation solutions. So from this perspective, the price of Tosca is not as competitive."
"The user management could improve in Tricentis Tosca because it is confusing. It would be better to have it in one place. Having to add it to the cloud and to a specific project can be a mess."
"The reporting function was lacking in usability and detail."
"The integration with mobile testing could be useful."
"They can make it more stable. I have used this tool for SAP applications. They have an alliance with SAP, and it mostly worked fine, but there were a few glitches. However, we got the required support from the Tricentis team. They are coming up with their new versions and upgrades with respect to how the Tricentis systems as cloud applications are updated, and it would be good if they have a robust accelerator pack."
Apache JMeter is ranked 3rd in API Testing Tools with 82 reviews while Tricentis Tosca is ranked 2nd in API Testing Tools with 96 reviews. Apache JMeter is rated 7.8, while Tricentis Tosca is rated 8.2. The top reviewer of Apache JMeter writes "It's a free tool with a vast knowledge base, but the reporting is lackluster, and it has a steep learning curve". On the other hand, the top reviewer of Tricentis Tosca writes "Does not require coding experience to use and comes with productivity and time-saving features ". Apache JMeter is most compared with BlazeMeter, Postman, Tricentis NeoLoad, OpenText LoadRunner Professional and SmartBear LoadNinja, whereas Tricentis Tosca is most compared with OpenText UFT One, Katalon Studio, Worksoft Certify, Postman and SmartBear TestComplete. See our Apache JMeter vs. Tricentis Tosca report.
See our list of best API Testing Tools vendors and best Regression Testing Tools vendors.
We monitor all API Testing Tools reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.
