BlazeMeter vs OpenText LoadRunner Professional vs Tricentis NeoLoad comparison

Cancel
You must select at least 2 products to compare!
Perforce Logo
6,307 views|3,730 comparisons
93% willing to recommend
OpenText Logo
7,114 views|4,657 comparisons
95% willing to recommend
Tricentis Logo
8,349 views|4,218 comparisons
94% willing to recommend
Comparison Buyer's Guide
Executive Summary

We performed a comparison between BlazeMeter, OpenText LoadRunner Professional, and Tricentis NeoLoad based on real PeerSpot user reviews.

Find out what your peers are saying about Apache, OpenText, Tricentis and others in Performance Testing Tools.
To learn more, read our detailed Performance Testing Tools Report (Updated: April 2024).
768,740 professionals have used our research since 2012.
Featured Review
Quotes From Members
We asked business professionals to review the solutions they use.
Here are some excerpts of what they said:
Pros
"The most valuable features of the solution stem from the fact that BlazeMeter provides easy access to its users while also ensuring that its reporting functionalities are good.""The feature that stands out the most is their action groups. They act like functions or methods and code, allowing us to reuse portions of our tests. That also means we have a single point for maintenance when updates are required. Instead of updating a hundred different test cases, we update one action group, and the test cases using that action group will update.""It has helped us simulate heavy load situations so we can fix performance issues ahead of time.""It has a unique programming dashboard that is very user-friendly.""The extensibility that the tool offers across environments and teams is valuable.""The on-the-fly test data improved our testing productivity a lot. The new test data features changed how we test the applications because there are different things we can do. We can use mock data or real data. We can also build data based on different formats.""The baseline comparison in BlazeMeter is very easy, especially considering the different tests that users can easily compare.""BlazeMeter's most valuable feature is its cloud-based platform for performance testing."

More BlazeMeter Pros →

"The most valuable features of Micro Focus LoadRunner Professional are the separate module for scripting, execution analysis, and integration with a lot of new things pipeline areas. They keep updating their releases. Recently, they have released different versions, such as the professional and enterprise. They're coming up with new features which are good.""Very useful for finding out how the system responds to load, stress, and normal situations, as well as benchmarking with other industry competitors. It also improved our response time, memory delegation, and CPU delegation. In addition, we used LoadRunner to optimize our database and website.""The initial setup and installation of the software were very easy and straightforward.""It provides clients with an understanding of application and system performance.""The most valuable feature is the ability to create performance test cases quickly and then execute them. It provides a lot of powerful features to do that very efficiently and effectively.""The capabilities and flexibility of the Controller, the ability to monitor the systems under test, and the comprehensive results Analysis which saves a great deal of time.""The tool's most valuable features are scripting and automation.""I like LoadRunner's ability to use multiple protocols. That's one of the greatest features along with the ability to test service calls between the app and server."

More OpenText LoadRunner Professional Pros →

"The most valuable feature is the ability to execute parallel requests, unlike JMeter and LoadRunner which can only be run sequentially.""Very easy to use the front end and the UI is very good.""The most useful aspect of Tricentis NeoLoad was for the web.""The scripting is really user-friendly and the reporting is very good.""I like the solution’s performance and integration. Also, the tool’s help center is very responsive and helpful. They have always helped me within a short duration of time.""There are several key features, including Jenkins integration, infrastructure monitoring, and results analysis.""From a functional perspective, the range of tools provided with Tricentis NeoLoad is perhaps the widest.""The Frameworks feature is valuable. NeoLoad Web and the API are also valuable. It provides API support."

More Tricentis NeoLoad Pros →

Cons
"The performance could be better. When reviewing finished cases, it sometimes takes a while for BlazeMeter to load. That has improved recently, but it's still a problem with unusually large test cases. The same goes for editing test cases. When editing test cases, it starts to take a long time to open those action groups and stuff.""BlazeMeter needs more granular access control. Currently, BlazeMeter controls everything at a workspace level, so a user can view or modify anything inside that workspace depending on their role. It would be nice if there was a more granular control where you could say, "This person can only do A, B, and C," or, "This user only has access to functional testing. This user only has access to mock services." That feature set doesn't currently exist.""BlazeMeter has room for improvement in terms of its integration with GitLab, particularly in the context of CI/CD processes. While it has multiple integrations available, the level of integration with GitLab may need further enhancements. It is known to work well with Git and Jenkins, although the extent of compatibility with GitLab is uncertain.""The scanning capability needs improvement.""The seamless integration with mobiles could be improved.""The only downside of BlazeMeter is that it is a bit expensive.""For a new user of BlazeMeter, it might be difficult to understand it from a programming perspective.""Having more options for customization would be helpful."

More BlazeMeter Cons →

"I would like to have better support for adding more users per load generator.""Improvement wise, the pipeline should be enabled. It should be embedded as part of the tool itself rather than going with third-party tools. Monitoring should be more effective as well.""Micro Focus LoadRunner Professional can improve the implementation of digital areas, such as digital testing, UI and native application, and native mobile applications.""In terms of resource management, you need a lot of high capacity boxes if you need to generate a load of 1,000 or 2,000 users.""The solution must be more user-friendly.""We'd like the solution to be a bit more user-friendly.""The initial start-up of Micro Focus LoadRunner could be improved. When we add 20 or 30 scripts, the refresh is completed one by one. I would like to be able to select all the script at one time, so it can be completed in a single click, reducing the time required.""In terms of improvement, it lacks mobile testing features present in some competitors, like GitMatters, which I find valuable."

More OpenText LoadRunner Professional Cons →

"NeoLoad can improve the correlation templates, which are specific to frameworks. There's room for improvement in that area.""I would like to see support for auto-correlations.""We would like NeoLoad to be able to support more protocols. Testing can also be a little tricky at times.""There were some features that were lacking in Tricentis NeoLoad, e.g. those were more into Citrix and other complicated protocols, which were supported easily by a competitor: Micro Focus LoadRunner. We also need to look into how it integrates with other Tricentis products, because Tricentis did not have a good performance testing tool until now.""Support wasn't able to solve a technical issue.""It needs improvements in the UI. It's currently not as friendly as it should be.""Tricentis NeoLoad crashes if an application contains more than 1,000 scripts.""There is room for improvement with the support and community documentation as it can be difficult to find answers to questions quickly."

More Tricentis NeoLoad Cons →

Pricing and Cost Advice
  • "The licensing fees are billed on a monthly basis and they cost approximately $100 for the basic plan."
  • "The solution is free and open source."
  • "The product isn't cheap, but it isn't the most expensive on the market. During our proof of concept, we discovered that you get what you pay for; we found a cheaper solution we tested to be full of bugs. Therefore, we are willing to pay the higher price tag for the quality BlazeMeter offers."
  • "The overall product is less costly than our past solutions, so we've absolutely saved money."
  • "It's consumption-based pricing but with a ceiling. They're called CVUs, or consumption variable units. We can use API testing, GUI testing, and test data, but everything gets converted into CVUs, so we are free to use the platform in its entirety without getting bogged down by a license for certain testing areas. We know for sure how much we are going to spend."
  • "My company has opted for a pay-as-you-go model, so we don't make use of the free version of the product."
  • "I rate the product's price two on a scale of one to ten, where one is very cheap, and ten is very expensive. The solution is not expensive."
  • "When compared with the cost of the licenses of other tools, BlazeMeter's license price is good."
  • More BlazeMeter Pricing and Cost Advice →

  • "The cost depends greatly on the needs of the testing engagement."
  • "I would still consider LoadRunner as an expensive tool and you get a LoadRunner and the Performance Center."
  • "I don't know the licensing cost, but I think that you would get a discount for normal usage. I think there are different yearly options for different types of usage. It is not only how many users, but also whether it is shareable or not and other criteria involved in each feature. There are additional fees for the users and hardware linked to the processing."
  • "The licensing fees are based on the number of users."
  • "It is competing with other products that may cost significantly less or may be available as open-source. Because of that it is relatively expensive."
  • "LoadRunner Professional is an expensive product."
  • "This is not a cheap product."
  • "There is a licensing cost that is expensive."
  • More OpenText LoadRunner Professional Pricing and Cost Advice →

  • "Licence cost is very attractive compared to other vendor tools and also there are many license alternatives."
  • "The pricing is fair for high-volume licensing."
  • "It is cheaper than other solutions."
  • "The licensing cost is less compared to other licensing performance testing tools."
  • "Licensing for NeoLoad is subscription-based."
  • "Its licensing cost is very less."
  • "NeoLoad is cheaper compared to other solutions. There are no additional licensing fees."
  • "Pricing is always cheaper with Tricentis NeoLoad versus the very expensive Micro Focus LoadRunner."
  • More Tricentis NeoLoad Pricing and Cost Advice →

    report
    Use our free recommendation engine to learn which Performance Testing Tools solutions are best for your needs.
    768,740 professionals have used our research since 2012.
    Comparison Review
    Anonymous User
    The six phases of an IT project Enthusiasm Disillusionment Panic Search for the guilty Punishment of the innocent (the performance tester) Praise and rewards for the incompetent non-participants This article has been put together as part of an evaluation of the performance test tools NeoLoad and LoadRunner. I consulted a variety of sources, including user groups, discussions with colleagues, telephone chats with HP (the vendors of LoadRunner) and Neotys (the vendors of NeoLoad), and of course the Oracle – Google. The opinions in this article are my own and do not represent the views of any particular company, the software vendors or any organisation (and I’ve assumed that readers have some knowledge of web application performance testing). The versions discussed in this article as of April 2014 are: LoadRunner 11.52 NeoLoad 4.2.2 I hope this evaluation and comparison will assist you with your own evaluation of LoadRunner and NeoLoad. Introduction LoadRunner and NeoLoad are considered the top two best performance testing tools on the market. Comparing the two tools is just like comparing a Mercedes Benz and a BMW: both are high performance, perfectly engineered machines that also have an associated prestige. Performance testing is a critical component of the software testing process. It determines the actual operational boundaries that will simulate the real world use of an application. Performance testing is load testing, stress testing and scalability testing. Why… Read more →
    Questions from the Community
    Top Answer:Blazemeter is a continuous testing platform that provides scriptless test automation. It unifies functional and… more »
    Top Answer:In our company, various teams use BlazeMeter, particularly appreciating its cloud license software, which supports up to… more »
    Top Answer:The pricing is manageable. It is not that big. Big companies won't mind the licensing costs. However, Neustar has more… more »
    Top Answer:My favorite feature in LoadRunner Professional is its ability to group scripts under separate IDs.
    Top Answer:The pricing model, especially when involving partners, could use some improvement.
    Top Answer:In terms of improvement, it lacks mobile testing features present in some competitors, like GitMatters, which I find… more »
    Top Answer:I highly recommend Tricentis NeoLoad for companies that are in need of a versatile load and performance testing tool… more »
    Top Answer:What I found best in Tricentis NeoLoad is that it's better with scripting and load test execution in the load testing… more »
    Top Answer:I don't have information on the licensing cost of Tricentis NeoLoad because my manager handles that. From a testing… more »
    Ranking
    Views
    6,307
    Comparisons
    3,730
    Reviews
    19
    Average Words per Review
    1,051
    Rating
    8.3
    Views
    7,114
    Comparisons
    4,657
    Reviews
    26
    Average Words per Review
    577
    Rating
    8.6
    Views
    8,349
    Comparisons
    4,218
    Reviews
    17
    Average Words per Review
    527
    Rating
    7.9
    Comparisons
    Also Known As
    JMeter Cloud
    Micro Focus LoadRunner Professional, Micro Focus LoadRunner, HPE LoadRunner, LoadRunner
    NeoLoad, Neotys NeoLoad
    Learn More
    Overview

    BlazeMeter ensures delivery of high-performance software by enabling DevOps teams to quickly and easily run open-source-based performance tests against any mobile app, website or API at massive scale to validate performance at every stage of software delivery.

    The rapidly growing BlazeMeter community has more than 100,000 developers and includes prominent global brands such as Adobe, Atlassian, Gap, NBC Universal, Pfizer and Walmart as customers. Founded in 2011, the company is headquartered in Palo Alto, Calif., with its research and development in Tel Aviv.

    OpenText LoadRunner Professional is a performance testing tool used for various software applications, including web-related use cases, API testing, and enterprise performance modeling. Its valuable features include quick test case creation and execution, graph monitoring, multiple protocols, scripting and executing tests, scalability, easy setup, auto-correlation, analysis and reporting capabilities, stability, reliability, and compatibility with various programming languages. 

    LoadRunner has helped organizations load test potential new payroll solutions and choose the best option, record network traffic of mobile applications, and handle different protocols. It is the ultimate tool for performance testing.

    OpenText LoadRunner Professional Will Enable You To:

    • Drive quality across your enterprise.
    • Alleviate the challenges of managing many application types, testing tools, licenses, repositories, and systems while working toward unified results.

    With OpenText LoadRunner Professional You Can:

    • Increase organizational efficiency through standardization of tools and resources.
    • Balance your priorities and improve the results delivered by your testing team.
    • Increase testing productivity.
    • Improve collaboration across application teams.
    • Gain the ability to outsource some or all the tactical work of load testing.

    OpenText LoadRunner Professional Features:

    • Intuitive and Easy to Use: OpenText LoadRunner Professional is intuitive, versatile, and easy to use, which makes it easy for testers to quickly learn the basics and apply them to their testing tasks, while engineers who are more experienced can utilize all the features for the most complex of scenarios.
    • Comprehensive Enterprise Coverage: OpenText LoadRunner Professional provides support for multiple protocols such as HTML, WebSocket, AJAX, RDP, Database, Remote Terminal Emulators, Citrix, Java, .NET, Oracle and SAP.
    • Scripting Technologies: Reduce scripting time by 50% or more via OpenText LoadRunner Professional’s TruClient protocol, and automatic correlation, and correlate both front end (user experience) and back end (load) issues.
    • Extensive and Flexible Test Scenarios: The LoadRunner solution provides several valuable features that let you validate, enhance, and modify your tests. It gives you the ability to integrate external measurements to assess the impact on every application component, extend tests with success-failure checks, and emulate peak loads. You can also apply load on the go and change parameters for better flexibility in order to yield the most representative testing possible.
    • Realistic Network Conditions: Network virtualization capabilities help accurately simulate realistic conditions for an accurate analysis of both throughput and user response time. Realistic network conditions are predicted using location-aware analytics, transaction analysis and optimization.
    • Accurate Workloads with Low Overhead: OpenText LoadRunner Professional allows you to run high-scale tests with minimal hardware so that you can apply accurate workloads to any application.
    • Ongoing Testing Support: The OpenText LoadRunner Professional solution provides continuous testing support via built-in integrations across IDE, CI/CD, open source test automation, monitoring, and source code management tools.

    OpenText LoadRunner Professional Benefits:

    • Quickly deliver enterprise engineering capabilities and facilitate sharing of assets and collaboration.
    • Reduce complexity and increase utilization of infrastructure and human resources.
    • Get the big picture with cross-project reporting and individual project drill downs.
    • Increase collaboration and consistency with unified storage and access to all relevant assets.
    • Reduce costs with centralized management and built-in support of cloud-based load generation.
    • Analyze end-to-end performance, including topology, infrastructure-level, and advanced insights.
    • Incorporate application monitoring and user sentiment data to take a centralized approach to data collection and connect the dots.
    • Using powerful analytics and insights, gain visibility into the test status across the entire enterprise and performance trending information across multiple tests.

    Reviews from Real Users:

    "The most useful aspect of the solution is that it provides agents in different geographic locations.” - Head, Testing Centre of Excellence at NIIT Technologies Limited

    "The most important feature for us is that it supports a lot of protocols because we support all of them, including HTTP, FTP, mainframe, and others.” - Test Automation, DevOps & Performance Engineering at a financial services firm

    "The solution can handle a huge amount of workloads, it's quite scalable.” - Regional Head Customer Experience at a financial services firm

    "The reporting mechanism is a valuable feature that generates good reports.” - Senior Architect at a computer software company

    Tricentis NeoLoad is a performance testing tool that provides developers and testers with automatic test design, test maintenance, realistic simulation of user behavior, fast root cause analysis, and built-in integrations with the entire SDLC toolchain. With NeoLoad’s plugins, teams can reuse and share test assets and results from functional testing tools, analytics, metrics, and APM tools in order to catch performance issues early. With NeoLoad’s full tech stack support, users can test the range of mobile, web, and desktop apps.

    Tricentis NeoLoad Features

    Tricentis NeoLoad has many valuable key features. Some of the most useful ones include:

    • Supports API technologies 

      • Support for SOAP/REST.
      • Assisted design with Swagger/Open API import and highly efficient extractors for quick test design and fewer errors in scripting.
      • Ability to test as code or GUI-based productivity.

    • Automated testing of API performance

      • CI/CD automated API testing, dynamic load generation infrastructure, and auto pass/fail based on SLAs.
      • Real-time test results for fast dev feedback loop if bottleneck is found.
      • Non-regression API performance trends.
    • API-based applications 

      • Ability to test stand-alone APIs or APIs within end-to-end tests. Same platform, same skills.
      • Dev, PO, QA, Ops share a common view of API performance.
      • Confidence in API and application speed and reliability.

    • Design tests faster and update automatically

      • Assisted design using wizards and automatic parameter handling.
      • Reuse functional scripts and/or convert LoadRunner scripts to NeoLoad performance tests.
      • Update system-level scripts quicker with automatic user path updates.
      • Easy to reuse and maintain.

    • Realistic user simulation

      • Simulate any business case.
      • Scale load tests with up to millions of virtual users.

    • Bottleneck identification

      • Real-time test analysis.
      • Pass/fail based on SLA.
      • Root cause analysis.

    Tricentis NeoLoad Benefits

    There are many benefits to implementing Tricentis NeoLoad. Some of the biggest advantages the solution offers include:

    • Automate API testing within CI pipelines: Design, maintain, and run performance tests. Analyze results within continuous integration pipelines.
    • Accelerate end-to-end app testing: Create test scripts fast for complex applications using a graphical user interface without the complexity of scripting new and updated tests.
    • Find performance bottlenecks fast: Compare SLAs to server-level statistics to measure how an application is performing. See overall analysis of behavior or an analysis of the data flow to a particular user path.
    • Manage across the enterprise: Collaborate across QA, operations, dev, and business teams to define SLAs and review results. Share test results and manage test infrastructure. Schedule and share resources across teams and apps.

    Reviews from Real Users

    Tricentis NeoLoad stands out among its competitors for a number of reasons. Some of these include its price, its user-friendly UX, its API support, and its scalability. PeerSpot users take note of the advantages of these features in their reviews:

    Patrik B., Technical Lead at a tech services company, writes, “The licensing cost is very less for NeoLoad. It is user-friendly and easy to understand because they have created so many useful functionalities. When I started working with this tool, we just had to do the initial assessment about whether this tool will be able to support our daily work or not. I could easily understand it.”

    A Global Delivery Head at a consultancy firm notes, “The API support is much better with this solution, compared with the competition. Pricing for it is also more affordable than its competitor. We have used Tricentis NeoLoad and we find it scalable.”

    Sample Customers
    DIRECTV, GAP, MIT, NBCUniversal, Pfizer, StubHub
    JetBlue, GOME, Australian Red Cross Blood Service, RMIT University, Virgin Media
    Dell, H&R Block, Best Buy, Orange, Verizon Wireless, ING, Mazda, Siemens, University of Oxford
    Top Industries
    REVIEWERS
    Financial Services Firm30%
    Computer Software Company22%
    Non Profit13%
    Comms Service Provider9%
    VISITORS READING REVIEWS
    Financial Services Firm20%
    Computer Software Company18%
    Retailer7%
    Manufacturing Company6%
    REVIEWERS
    Computer Software Company30%
    Financial Services Firm20%
    Comms Service Provider9%
    Government7%
    VISITORS READING REVIEWS
    Financial Services Firm16%
    Computer Software Company15%
    Manufacturing Company11%
    Government7%
    REVIEWERS
    Computer Software Company19%
    Retailer15%
    Government11%
    Financial Services Firm11%
    VISITORS READING REVIEWS
    Educational Organization43%
    Financial Services Firm10%
    Computer Software Company9%
    Manufacturing Company5%
    Company Size
    REVIEWERS
    Small Business37%
    Midsize Enterprise20%
    Large Enterprise44%
    VISITORS READING REVIEWS
    Small Business17%
    Midsize Enterprise15%
    Large Enterprise67%
    REVIEWERS
    Small Business18%
    Midsize Enterprise13%
    Large Enterprise68%
    VISITORS READING REVIEWS
    Small Business16%
    Midsize Enterprise11%
    Large Enterprise73%
    REVIEWERS
    Small Business7%
    Midsize Enterprise18%
    Large Enterprise75%
    VISITORS READING REVIEWS
    Small Business10%
    Midsize Enterprise49%
    Large Enterprise42%
    Buyer's Guide
    Performance Testing Tools
    April 2024
    Find out what your peers are saying about Apache, OpenText, Tricentis and others in Performance Testing Tools. Updated: April 2024.
    768,740 professionals have used our research since 2012.