SmartBear TestComplete vs TFS vs Zeenyx AscentialTest comparison

Cancel
You must select at least 2 products to compare!
SmartBear Logo
7,138 views|5,012 comparisons
85% willing to recommend
Microsoft Logo
Read 93 TFS reviews
2,198 views|1,300 comparisons
87% willing to recommend
Zeenyx Logo
364 views|169 comparisons
100% willing to recommend
Comparison Buyer's Guide
Executive Summary

We performed a comparison between SmartBear TestComplete, TFS, and Zeenyx AscentialTest based on real PeerSpot user reviews.

Find out what your peers are saying about Tricentis, OpenText, Katalon Studio and others in Test Automation Tools.
To learn more, read our detailed Test Automation Tools Report (Updated: April 2024).
768,246 professionals have used our research since 2012.
Featured Review
Quotes From Members
We asked business professionals to review the solutions they use.
Here are some excerpts of what they said:
Pros
"Customer service and technical support responsiveness are high. Everyone is very professional.""It works very fine. It is fast on almost any machine, and it is also very well organized. I like its object mapping and its capability to find and interact with almost everything that exists on Windows.""The product is stable for what we are currently using it for, and it is sufficient for us.""The ability to run a whole suite of tests automatically (which we did overnight).""It is very easy to maintain tests with this tool. It covers all necessary items in the test plan. The most painful item in testing is maintenance. When changes occur, the tests should be maintained.""Selenium integration.""The solution is mainly stable.""I like the cross browser compatibility. It saves a lot of time re-writing scripts to accommodate different browsers."

More SmartBear TestComplete Pros →

"The interface is easy to navigate.""Complete integration with VS IDE and Office tools: This give us a possibility of high-level automation, thus minimizing human error.""I feel that the test plan and test tools are more manageable in TFS.""I have found almost all of the features valuable because it integrates well with your Microsoft products. If a client is using the entire Microsoft platform, then TFS would be definitely preferable. It integrates with the digital studio development environment as well.""User alerts are very helpful for knowing when work is required.""The solution's iteration board is good because you can track all your work with it.""It's user friendly. We haven't had any issues so far. It's flexible. If we need something, we can always contact the owner in our headquarters to make a configuration.""The most valuable feature from my point of view is project management, which includes user stories as well as task management."

More TFS Pros →

"The most valuable feature of AscentialTest for us is that it fully supports PowerBuilder.""AscentialTest's object recognition in snapshots is a robust feature that goes beyond standard elements, even accurately identifying objects within Datawindows.""It’s been really easy to automate the same application TestComplete struggled with. I have been able to automate two of our key applications in just a few months. I haven’t even taken their training.""If you use the PowerBuilder application, do choose AscentialTest without thinking twice."

More Zeenyx AscentialTest Pros →

Cons
"In the cross-browser domain, it has a few snags with Microsoft Edge and Chrome; although, these problems are not critical.""Stability issues occurred only when connecting to the SourceSafe. Sometimes, after getting the latest version, the tool hangs and it should be reopened in order to recover.""The code editor, though following eclipse-style, is still a work in progress and gives a very poorly formatted code once viewed via other editing tools.""Right now, when you buy the solution, you need to pay for one solution. You receive one set up and you install it and it's just in that one machine. It would be ideal if they could offer one subscription where you can connect to different machines with a group subscription.""If that engine could better identify more XPaths automatically and make the process more flexible, that would be better.""What is currently missing from this solution is better support for mobile testing.""In SmartBear TestComplete the integration with Jenkins could be easier. Additionally, some of the controls could have better customization options. For example, if a grid is used and it contains multiple controls within it, it can be a checkbox, radio button, or any kind of control, the way the Object Spy is operating currently there is a lot of room for improvement.""To bring it up to a 10, I would be looking for the addition of some key functional API testing."

More SmartBear TestComplete Cons →

"There are many things that I cannot do, and I have a lot of bugs.""TFS should allow more integration with different platforms.""Currently, we are looking for a solution with which we can incorporate third-party development sites or third-party project teams into the system. Because it is on-premise, it is a bit problematic because we need to have a VPN or something else in the system. A cloud-based solution would be better for us, and that's what we are looking for. Our biggest problem is the external connection, which, of course, is limited by our own IT. It would be good to have some kind of publishing service for this external connection. It might be there, and it might be that our IT is making it impossible for us. Its template editor could be easier to use. Currently, customizing the project templates according to your needs requires some work.""Merging branches is definitely one of the more challenging aspects for people new to TFS.""TFS needs to be stable.""I understand Microsoft is phasing out TFS in favor of Git, so I would steer anyone interested in TFS to look into Git.""I would also like a true command prompt like Git.""TFS's CI/CD, project pipelines, and management development could be improved."

More TFS Cons →

"Classes are not as object-oriented as I would like, but I am a programmer and not QA so I expect a lot.""The only thing I can't wait for is for Zeenyx to add automating Mobile apps.""Streamlining the retrieval of results from individual test set runs would be beneficial.""I would like to see an improvement in the User Interface."

More Zeenyx AscentialTest Cons →

Pricing and Cost Advice
  • "The product is becoming more and more expensive."
  • "My advice so far, is that while it’s not quite as powerful and easy to use as UFT, its price tag more than makes up for it."
  • "The price is less, compared to other products, such as QTP."
  • "Buy modules on demand. If you have a four-person team and they will each automate tests only 25% of the time, it's better to buy a floating licence and share the tool during the work day."
  • "TestComplete now have come up with three modules (Web, Desktop & Mobile), so based on the type of product for automation, it is adequate to purchase the required module."
  • "This is a pay-per-use service that is not expensive, and cost-efficient if you have a small team."
  • "The option we chose was around $2,000 USD."
  • "The licensing costs are in the range of $1,000 to $3,000."
  • More SmartBear TestComplete Pricing and Cost Advice →

  • "It's just as expensive as HPE ALM, without many of the features, best used for development tool only to avoid higher costs."
  • "TFS is on the higher side, but if you intend to use the tool as a complete ALM tool, it will reduce your costs in the long run."
  • "Use the Microsoft recommended “seat-based” licensing model. This allows a single developer with multiple machines to consume only one client license."
  • "If running TFS on-premise is expensive, maybe you could consider moving to the Cloud and use the Visual Studio Team Services."
  • "It is pretty expensive compared to other project management tools."
  • "The pricing is reasonable at this time."
  • "TFS is more competitively priced than some other solutions."
  • "We pay subscription fees on a yearly basis and the price is reasonable."
  • More TFS Pricing and Cost Advice →

  • "Once it starts generating ROI, which for us took between three and six months, one will not even think about the investment."
  • More Zeenyx AscentialTest Pricing and Cost Advice →

    report
    Use our free recommendation engine to learn which Test Automation Tools solutions are best for your needs.
    768,246 professionals have used our research since 2012.
    Questions from the Community
    Top Answer:This company offers end-to-end capabilities for test suite creation and execution. One feature that I particularly… more »
    Top Answer:There are certain challenges related to the license management system in place. It comes with a high cost. An annual… more »
    Top Answer:At times, identifying or locating an element can be somewhat challenging. However, in a recent test update, they… more »
    Top Answer:TFS and Azure DevOps are different in many ways. TFS was designed for admins, and only offers incremental improvements… more »
    Top Answer:Microsoft's technical team is supportive.
    Top Answer:There is a yearly licensing fee that needs to be paid.
    Ask a question

    Earn 20 points

    Ranking
    8th
    Views
    7,138
    Comparisons
    5,012
    Reviews
    7
    Average Words per Review
    503
    Rating
    7.1
    2nd
    Views
    2,198
    Comparisons
    1,300
    Reviews
    27
    Average Words per Review
    391
    Rating
    8.0
    34th
    Views
    364
    Comparisons
    169
    Reviews
    0
    Average Words per Review
    0
    Rating
    N/A
    Comparisons
    Also Known As
    Team Foundation Server
    AscentialTest
    Learn More
    Zeenyx
    Video Not Available
    Overview

    What is SmartBear TestComplete?

    TestComplete is a reliable, sturdy automated testing platform created by SmartBear Software. SmartBear Software is a worldwide technological leader known for developing quality enterprise-class development and testing solutions.

    TestComplete simplifies the process of creating tests for numerous applications, including, but not limited to; Desktop, Android, IOS, Web browsers, and Windows. Application tests can be manual, scripted, and even recorded by using keyword-driven or data-driven functionality. There are even additional options for error reporting and automated playback. The object repository is extremely accurate and is fully customizable. TestComplete can easily be used by experienced developers and even by manual novice testers to develop quality automated UI tests quickly.

    TestComplete offers three different testing scenarios:

    • Desktop: Users can easily and quickly automate UI tests using today’s most popular desktop applications, such as; Windows, Java, Python,.Net, VBScript, and more.

    • Web: Users can effortlessly create renewable tests for all of today’s popular web applications, including JavaScript frameworks on 2000+ trusted browser and platform integrations.

    • Mobile: Users can safely build and automate serviceable UI tests on actual or virtual android or IOS devices, locally or in the cloud. Users can create code or codeless tests. TestComplete seamlessly integrates with many of today’s popular frameworks.

    Key Features

    • Easily create automated UI tests: TestComplete offers scriptless Record and Replay or simple keyword-driven tests to quickly develop any type of UI test users may require. Tests can be recorded once, then replayed when needed across various applications on mobile, web, or desktop environments. TestComplete integrates with many different languages, such as Java, Python, C+, and more.

    • Keyword driven tests: Users can easily divide testing steps, actions, objects, and data with an integrated keyword-driven test structure. This makes it easy for every user to participate in the test automation process; there is no programming experience needed. Everything is made simple with easy-to-use point-and-click options.

    • Data driven tests: Easily distinguish data from test commands to keep administrative efforts simple. Users can improve overall coverage by running various automated mobile, desktop, or web UI tests.

    • Record and Replay: Users can reuse created automated tests across every environment as often as desired. This helps to expand overall test coverage and represents a huge cost and time savings.

    Reviews from Real Users

    Sandhiya T S., Sr Solutions Engineer at Lexington Soft, relates, “The record and replay aspects of the solution are quite useful for people. With them, you don't have to write any scripts. Basically, you can record your actions and play them back later. The initial setup is also very easy.”

    Sai S R., Staff Test Architect at a tech services company, says, "The most valuable features of the SmartBear TestComplete are self-healing, they reduce the maintenance required. The different languages SmartBear TestComplete supports are good because some of our libraries are written in Python, JavaScript, and C#. It's very easy to put them all under one project and use them."

    Visual Studio’s Team Foundation Server (TFS) is a powerful application development lifecycle management solution. It aids developers in managing every aspect of their DevOps and application creation. TFS combines many different types of solutions into a single powerful platform.

    Visual Studio TFS Benefits

    Some of the ways that organizations can benefit by choosing to deploy TFS include:

    • Build automation. TFS enables users to create definitions that can easily automate any and all tasks that are critical to the development of their applications. Businesses can utilize features that are built into TFS to accomplish preset tasks that can help them create the application of their choice. This can include enabling them to run automated tests when the need arises. Additionally, users can create custom tasks that will run automatically and allow users to focus their attention on the areas that most demand their focus.
    • Security. TFS is designed with the security of a user’s DevOps in mind. It enables an organization to restrict user permissions so that only developers that are meant to have access to particular parts of the development process can perform tasks related to those sections. It segments the development process to reduce the possibility of sensitive data being stolen.
    • Enables product rollbacks. TFS keeps copies of past versions of the organization’s application. Users can sift through the different versions that are available and can redeploy the version that best fits their needs should it ever become necessary to do so.

    Visual Studio TFS Features

    • Source code management. TFS comes with all of the tools that developers need to completely manage their source code. They can share their code so that multiple developers can work on the same project. Additionally, TFS enables them to do things like review the history of a particular piece of source code.

    • Project management. Organizations can leverage the wealth of project management features that TFS offers and ensure that their projects run as smoothly as possible. Project managers are able to use TFS to control every aspect of their project, from the planning stage until the application’s development has reached its conclusion.
    • Reporting. TFS enables users to generate reports that leverage critical metrics and provide them with important insights into the applications that they are creating. These comprehensive reports can be secured so that only users with the proper level of clearance can access them.

    Reviews from Real Users

    TFS is a highly effective solution that stands out when compared to many of its competitors. Two major advantages it offers are its source code management capabilities and its powerful integration suite.

    Carl B., the vice president of engineering at Vertex Downhole Ltd, writes, “The most valuable features are related to source code management. Using TFS for source code management and being able to branch and have multiple developers work on the same projects is valuable. We can also branch and merge code back together.”

    Ashish K., the principal consultant at Wipro, says, “I have found almost all of the features valuable because it integrates well with your Microsoft products. If a client is using the entire Microsoft platform, then TFS would be definitely preferable. It integrates with the digital studio development environment as well.”

    AscentialTest™ by Zeenyx Software is an enterprise level Test Management System that encompasses Test Planning, Development, Data Management, Execution and Defect Tracking for applications running on Windows, the web, java, dotNet, terminals and PowerBuilder. This “next generation” testing solution allows users to build robust automated and manual tests from reusable components created by its powerful object recognition engine without recording or scripting. Our patented ‘snapshot’ technology generates graphical representations of the application under test which allows users to build ‘Steps’ by dragging and dropping objects in a visual test editor. Reusable Steps are combined to form a multitude of automated and manual tests that are easy to create and maintain. With AscentialTest, companies realize a dramatic reduction in test creation and maintenance times, resulting in increased productivity and lower costs.
    Sample Customers
    Cisco, J.P. Morgan, Boeing, McAfee, EMC, Intuit, and Thomson Reuters.
    Vendex KBB IT Services, Info Support, Fujitsu Consulting, TCSC, Airways New Zealand, HP
    TJX Companies, Nuance Communications, Ericsson Inc., Transatlantic Reinsurance Company, Accenture, Nutrition Coordinating Center, Univ. of MN, iConectiv, Fortress Software, and LMP Corp.
    Top Industries
    REVIEWERS
    Computer Software Company31%
    Manufacturing Company13%
    Financial Services Firm9%
    Comms Service Provider6%
    VISITORS READING REVIEWS
    Computer Software Company18%
    Manufacturing Company11%
    Financial Services Firm11%
    Government7%
    REVIEWERS
    Financial Services Firm26%
    Computer Software Company18%
    Manufacturing Company16%
    Energy/Utilities Company11%
    VISITORS READING REVIEWS
    Educational Organization52%
    Computer Software Company7%
    Manufacturing Company5%
    Financial Services Firm5%
    VISITORS READING REVIEWS
    Financial Services Firm24%
    Government16%
    Energy/Utilities Company10%
    Computer Software Company9%
    Company Size
    REVIEWERS
    Small Business28%
    Midsize Enterprise28%
    Large Enterprise45%
    VISITORS READING REVIEWS
    Small Business23%
    Midsize Enterprise14%
    Large Enterprise62%
    REVIEWERS
    Small Business16%
    Midsize Enterprise25%
    Large Enterprise59%
    VISITORS READING REVIEWS
    Small Business9%
    Midsize Enterprise58%
    Large Enterprise33%
    REVIEWERS
    Small Business50%
    Midsize Enterprise21%
    Large Enterprise29%
    VISITORS READING REVIEWS
    Small Business14%
    Midsize Enterprise15%
    Large Enterprise70%
    Buyer's Guide
    Test Automation Tools
    April 2024
    Find out what your peers are saying about Tricentis, OpenText, Katalon Studio and others in Test Automation Tools. Updated: April 2024.
    768,246 professionals have used our research since 2012.