BlazeMeter vs SmartBear TestComplete comparison

Cancel
You must select at least 2 products to compare!
Perforce Logo
586 views|332 comparisons
93% willing to recommend
SmartBear Logo
6,622 views|4,632 comparisons
86% willing to recommend
Comparison Buyer's Guide
Executive Summary

We performed a comparison between BlazeMeter and SmartBear TestComplete based on real PeerSpot user reviews.

Find out in this report how the two Test Automation Tools solutions compare in terms of features, pricing, service and support, easy of deployment, and ROI.
To learn more, read our detailed BlazeMeter vs. SmartBear TestComplete Report (Updated: May 2024).
787,033 professionals have used our research since 2012.
Featured Review
Quotes From Members
We asked business professionals to review the solutions they use.
Here are some excerpts of what they said:
Pros
"The stability is good.""They have good support documentation and when we have contacted them, they helped to guide us.""With the help of the Mock Services, we are overcoming everything. Wherever we are facing issues, whether they will be long term or temporary, by implementing the Mock Services we can bypass the faulty components that are not needed for our particular testing.""The most valuable features of the solution stem from the fact that BlazeMeter provides easy access to its users while also ensuring that its reporting functionalities are good.""It supports any number of features and has a lot of tutorials.""Using cloud-based load generators is highly valuable to us, as we can test from outside our network and increase load generation without having to upscale our hardware as much. The cloud load generator is there when we need it and is the feature we leverage the most.""In our company, various teams use BlazeMeter, particularly appreciating its cloud license software, which supports up to 5,000 users. BlazeMeter's cloud capabilities allow us to load test or simulate traffic from any location worldwide, such as Europe, North America, South America, Australia, and even specific cities like Delhi. So, with one cloud license, we can simulate user load from various locations globally.""It is a stable solution. When we compare BlazeMeter with other tools in the market, I can say that the solution's overall performance has also been very good in our company."

More BlazeMeter Pros →

"When compared to other tools, it is very simple.""The product has many features.""The most valuable features are the desktop and mobile modules.""Customer service and technical support responsiveness are high. Everyone is very professional.""The product is stable for what we are currently using it for, and it is sufficient for us.""Runs in different remote machines. We have multiple versions of the software being tested.""TestComplete fits almost perfectly with a large amount of stacks, such as Delphi, C#, Java and web applications.""The most valuable feature of this solution is regression testing tools."

More SmartBear TestComplete Pros →

Cons
"The performance could be better. When reviewing finished cases, it sometimes takes a while for BlazeMeter to load. That has improved recently, but it's still a problem with unusually large test cases. The same goes for editing test cases. When editing test cases, it starts to take a long time to open those action groups and stuff.""The tool fails to offer better parameterization to allow it to run the same script across different environments, making it a feature that needs a little improvement.""The should be some visibility into load testing. I'd like to capture items via snapshots.""The Timeline Report panel has no customization options. One feature that I missed was not having a time filter, which I had in ELK. For example, there are only filter requests for a time of less than 5 seconds.""One problem, while we are executing a test, is that it will take some time to download data. Let's say I'm performance testing with a high-end load configuration. It takes a minimum of three minutes or so to start the test itself. That's the bad part of the performance testing... every time I rerun the same test, it is downloaded again... That means I have to wait for three to four minutes again.""The only downside of BlazeMeter is that it is a bit expensive.""BlazeMeter needs more granular access control. Currently, BlazeMeter controls everything at a workspace level, so a user can view or modify anything inside that workspace depending on their role. It would be nice if there was a more granular control where you could say, "This person can only do A, B, and C," or, "This user only has access to functional testing. This user only has access to mock services." That feature set doesn't currently exist.""BlazeMeter has room for improvement in terms of its integration with GitLab, particularly in the context of CI/CD processes. While it has multiple integrations available, the level of integration with GitLab may need further enhancements. It is known to work well with Git and Jenkins, although the extent of compatibility with GitLab is uncertain."

More BlazeMeter Cons →

"The code editor, though following eclipse-style, is still a work in progress and gives a very poorly formatted code once viewed via other editing tools.""It is very hard to read the test log generated by TestComplete Executor if the log file is very big. TestComplete Executor is a small tool for just running the TestComplete test framework (not for developing).""This solution could be improved by making it easier to visualize where there is a failure without having to look at it in detail.""In SmartBear TestComplete the integration with Jenkins could be easier. Additionally, some of the controls could have better customization options. For example, if a grid is used and it contains multiple controls within it, it can be a checkbox, radio button, or any kind of control, the way the Object Spy is operating currently there is a lot of room for improvement.""TestComplete gives support to do requests to a SOAP web service but has no support to do HTTP requests on Restful services.""The integration tools could be better.""There could be API interfaces with this tool.""The solution needs more training manuals or some form of online forum for learning. It needs more documentation."

More SmartBear TestComplete Cons →

Pricing and Cost Advice
  • "The licensing fees are billed on a monthly basis and they cost approximately $100 for the basic plan."
  • "The solution is free and open source."
  • "The product isn't cheap, but it isn't the most expensive on the market. During our proof of concept, we discovered that you get what you pay for; we found a cheaper solution we tested to be full of bugs. Therefore, we are willing to pay the higher price tag for the quality BlazeMeter offers."
  • "The overall product is less costly than our past solutions, so we've absolutely saved money."
  • "It's consumption-based pricing but with a ceiling. They're called CVUs, or consumption variable units. We can use API testing, GUI testing, and test data, but everything gets converted into CVUs, so we are free to use the platform in its entirety without getting bogged down by a license for certain testing areas. We know for sure how much we are going to spend."
  • "My company has opted for a pay-as-you-go model, so we don't make use of the free version of the product."
  • "I rate the product's price two on a scale of one to ten, where one is very cheap, and ten is very expensive. The solution is not expensive."
  • "When compared with the cost of the licenses of other tools, BlazeMeter's license price is good."
  • More BlazeMeter Pricing and Cost Advice →

  • "The product is becoming more and more expensive."
  • "My advice so far, is that while it’s not quite as powerful and easy to use as UFT, its price tag more than makes up for it."
  • "The price is less, compared to other products, such as QTP."
  • "Buy modules on demand. If you have a four-person team and they will each automate tests only 25% of the time, it's better to buy a floating licence and share the tool during the work day."
  • "TestComplete now have come up with three modules (Web, Desktop & Mobile), so based on the type of product for automation, it is adequate to purchase the required module."
  • "This is a pay-per-use service that is not expensive, and cost-efficient if you have a small team."
  • "The option we chose was around $2,000 USD."
  • "The licensing costs are in the range of $1,000 to $3,000."
  • More SmartBear TestComplete Pricing and Cost Advice →

    report
    Use our free recommendation engine to learn which Test Automation Tools solutions are best for your needs.
    787,033 professionals have used our research since 2012.
    Questions from the Community
    Top Answer:Blazemeter is a continuous testing platform that provides scriptless test automation. It unifies functional and performance testing, enabling users to monitor and test public and private APIs We… more »
    Top Answer:It has a unique programming dashboard that is very user-friendly.
    Top Answer:The pricing is manageable. It is not that big. Big companies won't mind the licensing costs. However, Neustar has more reasonable pricing. Most people don't prefer Neustar, but it is a good solution.
    Top Answer:TestComplete has strong reporting capabilities. The reports they generate are really good.
    Top Answer:It's comparable to other similar tools, perhaps a bit less expensive than some of its competitors. So, the pricing is pretty reasonable.
    Top Answer:Headless testing would be a big improvement. For example, when we run our regression suite, we need to start a virtual machine and run the tests interactively. There isn't a way to run the tests… more »
    Ranking
    5th
    Views
    586
    Comparisons
    332
    Reviews
    20
    Average Words per Review
    1,006
    Rating
    8.2
    7th
    Views
    6,622
    Comparisons
    4,632
    Reviews
    9
    Average Words per Review
    548
    Rating
    7.4
    Comparisons
    Also Known As
    JMeter Cloud
    Learn More
    Overview

    BlazeMeter ensures delivery of high-performance software by enabling DevOps teams to quickly and easily run open-source-based performance tests against any mobile app, website or API at massive scale to validate performance at every stage of software delivery.

    The rapidly growing BlazeMeter community has more than 100,000 developers and includes prominent global brands such as Adobe, Atlassian, Gap, NBC Universal, Pfizer and Walmart as customers. Founded in 2011, the company is headquartered in Palo Alto, Calif., with its research and development in Tel Aviv.

    What is SmartBear TestComplete?

    TestComplete is a reliable, sturdy automated testing platform created by SmartBear Software. SmartBear Software is a worldwide technological leader known for developing quality enterprise-class development and testing solutions.

    TestComplete simplifies the process of creating tests for numerous applications, including, but not limited to; Desktop, Android, IOS, Web browsers, and Windows. Application tests can be manual, scripted, and even recorded by using keyword-driven or data-driven functionality. There are even additional options for error reporting and automated playback. The object repository is extremely accurate and is fully customizable. TestComplete can easily be used by experienced developers and even by manual novice testers to develop quality automated UI tests quickly.

    TestComplete offers three different testing scenarios:

    • Desktop: Users can easily and quickly automate UI tests using today’s most popular desktop applications, such as; Windows, Java, Python,.Net, VBScript, and more.

    • Web: Users can effortlessly create renewable tests for all of today’s popular web applications, including JavaScript frameworks on 2000+ trusted browser and platform integrations.

    • Mobile: Users can safely build and automate serviceable UI tests on actual or virtual android or IOS devices, locally or in the cloud. Users can create code or codeless tests. TestComplete seamlessly integrates with many of today’s popular frameworks.

    Key Features

    • Easily create automated UI tests: TestComplete offers scriptless Record and Replay or simple keyword-driven tests to quickly develop any type of UI test users may require. Tests can be recorded once, then replayed when needed across various applications on mobile, web, or desktop environments. TestComplete integrates with many different languages, such as Java, Python, C+, and more.

    • Keyword driven tests: Users can easily divide testing steps, actions, objects, and data with an integrated keyword-driven test structure. This makes it easy for every user to participate in the test automation process; there is no programming experience needed. Everything is made simple with easy-to-use point-and-click options.

    • Data driven tests: Easily distinguish data from test commands to keep administrative efforts simple. Users can improve overall coverage by running various automated mobile, desktop, or web UI tests.

    • Record and Replay: Users can reuse created automated tests across every environment as often as desired. This helps to expand overall test coverage and represents a huge cost and time savings.

    Reviews from Real Users

    Sandhiya T S., Sr Solutions Engineer at Lexington Soft, relates, “The record and replay aspects of the solution are quite useful for people. With them, you don't have to write any scripts. Basically, you can record your actions and play them back later. The initial setup is also very easy.”

    Sai S R., Staff Test Architect at a tech services company, says, "The most valuable features of the SmartBear TestComplete are self-healing, they reduce the maintenance required. The different languages SmartBear TestComplete supports are good because some of our libraries are written in Python, JavaScript, and C#. It's very easy to put them all under one project and use them."

    Sample Customers
    DIRECTV, GAP, MIT, NBCUniversal, Pfizer, StubHub
    Cisco, J.P. Morgan, Boeing, McAfee, EMC, Intuit, and Thomson Reuters.
    Top Industries
    REVIEWERS
    Financial Services Firm30%
    Computer Software Company22%
    Non Profit13%
    Comms Service Provider9%
    VISITORS READING REVIEWS
    Financial Services Firm21%
    Computer Software Company18%
    Retailer7%
    Manufacturing Company7%
    REVIEWERS
    Computer Software Company33%
    Manufacturing Company12%
    Financial Services Firm9%
    Comms Service Provider6%
    VISITORS READING REVIEWS
    Computer Software Company19%
    Manufacturing Company12%
    Financial Services Firm12%
    Government7%
    Company Size
    REVIEWERS
    Small Business36%
    Midsize Enterprise19%
    Large Enterprise45%
    VISITORS READING REVIEWS
    Small Business17%
    Midsize Enterprise16%
    Large Enterprise67%
    REVIEWERS
    Small Business29%
    Midsize Enterprise27%
    Large Enterprise44%
    VISITORS READING REVIEWS
    Small Business24%
    Midsize Enterprise15%
    Large Enterprise61%
    Buyer's Guide
    BlazeMeter vs. SmartBear TestComplete
    May 2024
    Find out what your peers are saying about BlazeMeter vs. SmartBear TestComplete and other solutions. Updated: May 2024.
    787,033 professionals have used our research since 2012.

    BlazeMeter is ranked 5th in Test Automation Tools with 41 reviews while SmartBear TestComplete is ranked 7th in Test Automation Tools with 72 reviews. BlazeMeter is rated 8.2, while SmartBear TestComplete is rated 7.6. The top reviewer of BlazeMeter writes "Reduced our test operating costs, provides quick feedback, and helps us understand how to build better test cases". On the other hand, the top reviewer of SmartBear TestComplete writes "A stable product that needs to improve its integration capabilities with other test management tools". BlazeMeter is most compared with Apache JMeter, Tricentis NeoLoad, OpenText LoadRunner Cloud, OpenText LoadRunner Professional and BrowserStack, whereas SmartBear TestComplete is most compared with Tricentis Tosca, Katalon Studio, Ranorex Studio, OpenText UFT One and froglogic Squish. See our BlazeMeter vs. SmartBear TestComplete report.

    See our list of best Test Automation Tools vendors and best Functional Testing Tools vendors.

    We monitor all Test Automation Tools reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.