IBM Rational Quality Manager vs SmartBear TestComplete vs TFS comparison

Cancel
You must select at least 2 products to compare!
IBM Logo
614 views|313 comparisons
81% willing to recommend
SmartBear Logo
7,138 views|5,012 comparisons
85% willing to recommend
Microsoft Logo
Read 93 TFS reviews
2,198 views|1,300 comparisons
87% willing to recommend
Comparison Buyer's Guide
Executive Summary

We performed a comparison between IBM Rational Quality Manager, SmartBear TestComplete, and TFS based on real PeerSpot user reviews.

Find out what your peers are saying about OpenText, Microsoft, IDERA and others in Test Management Tools.
To learn more, read our detailed Test Management Tools Report (Updated: April 2024).
768,578 professionals have used our research since 2012.
Featured Review
Quotes From Members
We asked business professionals to review the solutions they use.
Here are some excerpts of what they said:
Pros
"The most valuable feature is the RFT because it allows us to automate manual test cases.""It allows user to add whichever widget (predefined) based on the need. It has integration with CCM and RM to achieve traceability.""Reusability and integration capabilities which make it a great choice for organizations that use a variety of development tools and platforms.""Integration with the other professional tools is a very strong advantage, so that we can have a traceability between the requirements and defects in Rational Team Concert. That's the most important aspect.""It's very reliable as a solution.""The one feature that has not allowed us to switch to any other solution is the integration with functional testing.""RQM's best features are integration with test automation and performance testing.""RQM is something that we use everyday, so it has to be up and running, otherwise we would lose everything."

More IBM Rational Quality Manager Pros →

"Runs in different remote machines. We have multiple versions of the software being tested.""Selenium integration.""The initial setup is pretty easy and it's quick to deploy.""This company offers end-to-end capabilities for test suite creation and execution. One feature that I particularly appreciate is the tagging system. Tags are highly valuable, as they allow you to assign tags to your test cases. When there's an impact in a specific area, you can search for and run all test cases associated with that tag. I find this functionality very useful.""The most valuable features of the SmartBear TestComplete are self-healing, they reduce the maintenance required. The different languages SmartBear TestComplete supports are good because some of our libraries are written in Python, JavaScript, and C#. It's very easy to put them all under one project and use them. The are other features that SmartBear TestComplete has but the competition widely has them as well.""It's cross platform automation capabilities specially ranging across web, UNIX (via putty), and other systems.""The ease-of-use and quality of the overall product are above average.""The solution is great as a record and playback tool. It also has valuable regression testing."

More SmartBear TestComplete Pros →

"The most valuable feature of TFS is the central repository, and you can see what changes other developers did from which branch.""TFS’s test management capability without the expensive licensing has large gaps. Users will be unable to access performance testing and coded UI testing capabilities.""TFS' most valuable feature is the triage process. It is a robust solution that is easy to use.""The tool's installation is straightforward.""It is easy to push our changes from quality to pre-prod and prod.""Version Control: TFS offers both the centralized “TFVC” version control technology as well as the distributed “Git” version control technology.""Team Foundation Server (TFS) is easy to use, and we have a complete trail and traceability. We also like the access control part.""From the project management perspective, the tool is efficiently managing teams by giving management information, such as reports, graphs, velocity, capacity, etc."

More TFS Pros →

Cons
"Integration capabilities with other vendors' tools should improve.""Adding support for uploading a collection of test cases would be a helpful addition.""While RQM allows for running tests and viewing results, it could be further enhanced in terms of performance and speed.""RQM could be improved by adding a feature that allows test requirements to be selected when creating a task plan.""It would be helpful if we could assign a hierarchy to a group of test cases.""Organizing the test cases is tedious. There is no mechanism to keep and maintain the test cases as hierarchy. This should be seriously addressed.""Mainly Quality Assurance and DevOps, but of course the whole company and management areas with more knowledge of quality and client success approach.""I think it's fine from a performance perspective but usability is something that needs improvement."

More IBM Rational Quality Manager Cons →

"In SmartBear TestComplete the integration with Jenkins could be easier. Additionally, some of the controls could have better customization options. For example, if a grid is used and it contains multiple controls within it, it can be a checkbox, radio button, or any kind of control, the way the Object Spy is operating currently there is a lot of room for improvement.""Increased performance with less memory and CPU usage.""What is currently missing from this solution is better support for mobile testing.""SmartBear products generally have a weak link when it comes to integration with other test management tools like Inflectra.""Right now, the product only supports Windows.""Product is not stable enough and it crashes often.""The artificial intelligence needs to be improved.""The pricing is the constraint."

More SmartBear TestComplete Cons →

"We encounter issues with backups.""TFS and MTM have their own style of working and they are different from other tools like Jira or TestRail, which are simpler and easy to use.""One of the areas that could be improved is to have an effective full lifecycle management.""It would be better if we could bring it out on the cloud.""Microsoft should discontinue the use of SharePoint as I don’t really see any value add to TFS, document management features can be included in TFS web portal itself, if required!""This solution is quite old and it is already being bundled as Azure DevOps Server.""The execution of test cases could stand improvement.""The tool needs improvement in stability."

More TFS Cons →

Pricing and Cost Advice
  • "The licenses of these tools (the whole CLM package) is very costly as compared to other vendors' tools."
  • "Each license includes 12 months of customer support. A free 90-day trial of the software is also available."
  • More IBM Rational Quality Manager Pricing and Cost Advice →

  • "The product is becoming more and more expensive."
  • "My advice so far, is that while it’s not quite as powerful and easy to use as UFT, its price tag more than makes up for it."
  • "The price is less, compared to other products, such as QTP."
  • "Buy modules on demand. If you have a four-person team and they will each automate tests only 25% of the time, it's better to buy a floating licence and share the tool during the work day."
  • "TestComplete now have come up with three modules (Web, Desktop & Mobile), so based on the type of product for automation, it is adequate to purchase the required module."
  • "This is a pay-per-use service that is not expensive, and cost-efficient if you have a small team."
  • "The option we chose was around $2,000 USD."
  • "The licensing costs are in the range of $1,000 to $3,000."
  • More SmartBear TestComplete Pricing and Cost Advice →

  • "It's just as expensive as HPE ALM, without many of the features, best used for development tool only to avoid higher costs."
  • "TFS is on the higher side, but if you intend to use the tool as a complete ALM tool, it will reduce your costs in the long run."
  • "Use the Microsoft recommended “seat-based” licensing model. This allows a single developer with multiple machines to consume only one client license."
  • "If running TFS on-premise is expensive, maybe you could consider moving to the Cloud and use the Visual Studio Team Services."
  • "It is pretty expensive compared to other project management tools."
  • "The pricing is reasonable at this time."
  • "TFS is more competitively priced than some other solutions."
  • "We pay subscription fees on a yearly basis and the price is reasonable."
  • More TFS Pricing and Cost Advice →

    report
    Use our free recommendation engine to learn which Test Management Tools solutions are best for your needs.
    768,578 professionals have used our research since 2012.
    Questions from the Community
    Top Answer:The one feature that has not allowed us to switch to any other solution is the integration with functional testing.
    Top Answer:IBM Rational has the RFT, which is rational functional testing. We do test automation with rational functional testing… more »
    Top Answer:We create test cases, and then we need to plan a new task plan feature from the existing task case file and execute the… more »
    Top Answer:This company offers end-to-end capabilities for test suite creation and execution. One feature that I particularly… more »
    Top Answer:There are certain challenges related to the license management system in place. It comes with a high cost. An annual… more »
    Top Answer:At times, identifying or locating an element can be somewhat challenging. However, in a recent test update, they… more »
    Top Answer:TFS and Azure DevOps are different in many ways. TFS was designed for admins, and only offers incremental improvements… more »
    Top Answer:Microsoft's technical team is supportive.
    Top Answer:There is a yearly licensing fee that needs to be paid.
    Ranking
    7th
    Views
    614
    Comparisons
    313
    Reviews
    3
    Average Words per Review
    383
    Rating
    8.3
    8th
    Views
    7,138
    Comparisons
    5,012
    Reviews
    7
    Average Words per Review
    503
    Rating
    7.1
    2nd
    Views
    2,198
    Comparisons
    1,300
    Reviews
    27
    Average Words per Review
    391
    Rating
    8.0
    Comparisons
    Also Known As
    Rational Quality Manager
    Team Foundation Server
    Learn More
    Overview

    IBM Rational Quality Manager is a next-generation web-based collaboration tool that provides test artifact management, construction, and planning throughout the entire development process. IBM Rational Quality Manager is based on IBM’s successful Jazz™ platform and derives many of its popular intuitive features from Jazz™.

    IBM Rational Manager was developed for every type of test team in the marketplace today. Every role is included, such as test manager, test architect, lab manager, tester, and test lead. The solution is also able to include various roles outside the established test organization.

    IBM Rational Quality Manager Features and Benefits:

    • Customizable design and construction: Users can easily define the overall design for each and every test case. Every test case contains a robust text editor, which can include background data concerning the test case. Test cases can include links to developmental requirements and items. They can also include test artifacts, such as test scripts, test case execution processes, and test plans. Test cases can also be integrated with test suites.

    • Intuitive reporting: IBM Rational Quality Manager provides an intuitive set of predefined reports to ensure users get comprehensive status on all projects. Additional customized reports can be made available by using the Development Intelligence or Rational Insight features for more precise reporting. Users can view live test execution status and are also able to discover the relationship between test artifacts, development artifacts, and requirements in the traceability view.

    • Exhaustive test planning processes: Users define and customize test plans that will drive all activity for the organization's teams through every component of the project’s lifecycle. Everything is developed around the concept of: “ Is this ready for release?” The test plan defines the project scope and test effort, and contains the key indicators so all team members will understand the desired outcomes.

      Top test plan tasks include (but are not limited to):

      • Definition of test and business objectives.
      • Evaluate the size of the test effort.
      • Define different environments to test and develop test configurations.
      • Develop entrance criteria, exit criteria, and overall quality goals.
      • Create a review and approval process for the test plan and/or individual test cases.
      • View Real-time Test Progress

    • Collaboration made easy: Users can easily share data with other members of the team with the Collaboration Lifecycle Management (CLM). Team members can also assign tasks and view each other's progress. They can also distribute work for review and track the input and status of each reviewer. There is also the ability to lock artifacts to prevent others from editing a completed piece.

    • Security: IBM Rational Quality Manager can protect against attack threats and data breaches with the IBM AppScan Tester. This can help achieve higher quality and more secure applications with greater positive outcomes at a very reasonable competitive cost.

    • Governance: The solution will ensure that an organization’s business processes are in compliance with department, corporate, industry, regional, and government regulations and standards. IBM Rational Quality Manager will correlate test processes and create suitable records of testing results and project history to comply with any auditing process.

    What is SmartBear TestComplete?

    TestComplete is a reliable, sturdy automated testing platform created by SmartBear Software. SmartBear Software is a worldwide technological leader known for developing quality enterprise-class development and testing solutions.

    TestComplete simplifies the process of creating tests for numerous applications, including, but not limited to; Desktop, Android, IOS, Web browsers, and Windows. Application tests can be manual, scripted, and even recorded by using keyword-driven or data-driven functionality. There are even additional options for error reporting and automated playback. The object repository is extremely accurate and is fully customizable. TestComplete can easily be used by experienced developers and even by manual novice testers to develop quality automated UI tests quickly.

    TestComplete offers three different testing scenarios:

    • Desktop: Users can easily and quickly automate UI tests using today’s most popular desktop applications, such as; Windows, Java, Python,.Net, VBScript, and more.

    • Web: Users can effortlessly create renewable tests for all of today’s popular web applications, including JavaScript frameworks on 2000+ trusted browser and platform integrations.

    • Mobile: Users can safely build and automate serviceable UI tests on actual or virtual android or IOS devices, locally or in the cloud. Users can create code or codeless tests. TestComplete seamlessly integrates with many of today’s popular frameworks.

    Key Features

    • Easily create automated UI tests: TestComplete offers scriptless Record and Replay or simple keyword-driven tests to quickly develop any type of UI test users may require. Tests can be recorded once, then replayed when needed across various applications on mobile, web, or desktop environments. TestComplete integrates with many different languages, such as Java, Python, C+, and more.

    • Keyword driven tests: Users can easily divide testing steps, actions, objects, and data with an integrated keyword-driven test structure. This makes it easy for every user to participate in the test automation process; there is no programming experience needed. Everything is made simple with easy-to-use point-and-click options.

    • Data driven tests: Easily distinguish data from test commands to keep administrative efforts simple. Users can improve overall coverage by running various automated mobile, desktop, or web UI tests.

    • Record and Replay: Users can reuse created automated tests across every environment as often as desired. This helps to expand overall test coverage and represents a huge cost and time savings.

    Reviews from Real Users

    Sandhiya T S., Sr Solutions Engineer at Lexington Soft, relates, “The record and replay aspects of the solution are quite useful for people. With them, you don't have to write any scripts. Basically, you can record your actions and play them back later. The initial setup is also very easy.”

    Sai S R., Staff Test Architect at a tech services company, says, "The most valuable features of the SmartBear TestComplete are self-healing, they reduce the maintenance required. The different languages SmartBear TestComplete supports are good because some of our libraries are written in Python, JavaScript, and C#. It's very easy to put them all under one project and use them."

    Visual Studio’s Team Foundation Server (TFS) is a powerful application development lifecycle management solution. It aids developers in managing every aspect of their DevOps and application creation. TFS combines many different types of solutions into a single powerful platform.

    Visual Studio TFS Benefits

    Some of the ways that organizations can benefit by choosing to deploy TFS include:

    • Build automation. TFS enables users to create definitions that can easily automate any and all tasks that are critical to the development of their applications. Businesses can utilize features that are built into TFS to accomplish preset tasks that can help them create the application of their choice. This can include enabling them to run automated tests when the need arises. Additionally, users can create custom tasks that will run automatically and allow users to focus their attention on the areas that most demand their focus.
    • Security. TFS is designed with the security of a user’s DevOps in mind. It enables an organization to restrict user permissions so that only developers that are meant to have access to particular parts of the development process can perform tasks related to those sections. It segments the development process to reduce the possibility of sensitive data being stolen.
    • Enables product rollbacks. TFS keeps copies of past versions of the organization’s application. Users can sift through the different versions that are available and can redeploy the version that best fits their needs should it ever become necessary to do so.

    Visual Studio TFS Features

    • Source code management. TFS comes with all of the tools that developers need to completely manage their source code. They can share their code so that multiple developers can work on the same project. Additionally, TFS enables them to do things like review the history of a particular piece of source code.

    • Project management. Organizations can leverage the wealth of project management features that TFS offers and ensure that their projects run as smoothly as possible. Project managers are able to use TFS to control every aspect of their project, from the planning stage until the application’s development has reached its conclusion.
    • Reporting. TFS enables users to generate reports that leverage critical metrics and provide them with important insights into the applications that they are creating. These comprehensive reports can be secured so that only users with the proper level of clearance can access them.

    Reviews from Real Users

    TFS is a highly effective solution that stands out when compared to many of its competitors. Two major advantages it offers are its source code management capabilities and its powerful integration suite.

    Carl B., the vice president of engineering at Vertex Downhole Ltd, writes, “The most valuable features are related to source code management. Using TFS for source code management and being able to branch and have multiple developers work on the same projects is valuable. We can also branch and merge code back together.”

    Ashish K., the principal consultant at Wipro, says, “I have found almost all of the features valuable because it integrates well with your Microsoft products. If a client is using the entire Microsoft platform, then TFS would be definitely preferable. It integrates with the digital studio development environment as well.”

    Sample Customers
    Ehrhardt, Cisco Systems, Anadolu Hayat Emeklilik, CareCore National, ItaÒ BBA, Barr
    Cisco, J.P. Morgan, Boeing, McAfee, EMC, Intuit, and Thomson Reuters.
    Vendex KBB IT Services, Info Support, Fujitsu Consulting, TCSC, Airways New Zealand, HP
    Top Industries
    REVIEWERS
    Government43%
    Computer Software Company29%
    Healthcare Company14%
    Transportation Company14%
    VISITORS READING REVIEWS
    Manufacturing Company18%
    Computer Software Company13%
    Financial Services Firm10%
    Retailer8%
    REVIEWERS
    Computer Software Company31%
    Manufacturing Company13%
    Financial Services Firm9%
    Comms Service Provider6%
    VISITORS READING REVIEWS
    Computer Software Company18%
    Manufacturing Company11%
    Financial Services Firm11%
    Government7%
    REVIEWERS
    Financial Services Firm26%
    Computer Software Company18%
    Manufacturing Company16%
    Energy/Utilities Company11%
    VISITORS READING REVIEWS
    Educational Organization52%
    Computer Software Company7%
    Manufacturing Company5%
    Financial Services Firm5%
    Company Size
    REVIEWERS
    Small Business9%
    Midsize Enterprise27%
    Large Enterprise64%
    VISITORS READING REVIEWS
    Small Business29%
    Midsize Enterprise4%
    Large Enterprise67%
    REVIEWERS
    Small Business28%
    Midsize Enterprise28%
    Large Enterprise45%
    VISITORS READING REVIEWS
    Small Business23%
    Midsize Enterprise14%
    Large Enterprise62%
    REVIEWERS
    Small Business16%
    Midsize Enterprise25%
    Large Enterprise59%
    VISITORS READING REVIEWS
    Small Business9%
    Midsize Enterprise58%
    Large Enterprise33%
    Buyer's Guide
    Test Management Tools
    April 2024
    Find out what your peers are saying about OpenText, Microsoft, IDERA and others in Test Management Tools. Updated: April 2024.
    768,578 professionals have used our research since 2012.