The most valuable features of UFT to me are:
- UFT best supports automation of desktop based applications like AS400 apps, Java apps, SAP application, etc.
- UFT comes with built-in test frameworks like BPT. Using these frameworks test development can be started within no time.
- Lean FT provides the flexibility to the users to code in Java.
- UFT provides the flexibility to run the same tests against a variety of browsers like Chrome, Firefox and IE.
Improvements to My Organization
Manual execution of tests is always time consuming. With the help of UFT, the test execution time cycle was reduced from weeks to hours. This is essentially a giant leap. UFT framework enables to do easy and quick fixes to tests so that automation suite can still be run in case of changes in application. This feature is essentially very important for agile projects.
Room for Improvement
- Ability to run multiple Lean FT or UFT tests in parallel on the same machine.
- Lean FT to support desktop based applications as well.
Use of Solution
I have been using HP UFT/QTP for the last 10 years.
There were no issues with the deployment.
UFT or Lean FT tests can only execute only one test on one machine. When the number of automation tests are very high, say 5000 to 10000, even with eight to 10 licenses, UFT can take over 24 hours for execution. This is unacceptable in agile projects. The regression test execution time is expected to be less than one hour for any agile project.
Customer Service and Technical Support
The customer service is prompt. Technical Support
The technical support do not answer the questions to the point.
The initial set-up of UFT is quick and easy. The set-up instructions are straightforward and easy to understand. However, for a few applications such as AS400 and POS, the set-up requires a few installation steps to be followed in a specific sequence. If this is missed, then UFT may not recognize application objects at all.
I will always recommend setting up an in-house team with one test automation lead, one test automation architect and rest automation developers. However, if a vendor team offers a more cost effective solution, then the same team structure is to be implemented at their site.
For the QTP/UFT projects I have worked on ROI is always over 300% in the long term.
Pricing, Setup Cost and Licensing
UFT offers a variety of licenses like seat licenses and concurrent licenses. If the automation team is small, say two to four, and fixed, node locked seat licenses would be preferable. Else, it is always advisable to go with concurrent licenses.
Other Solutions Considered
I have evaluated multiple paid and open source tools. I have evaluated paid tools like IBM Rational Functional Tester, TestComplete, Ranorex, Microsoft UI Automation, etc. Among these, HP UFT always tend to have better support for enterprise wide applications. However, if the requirement is to automate only a few applications, other tools can be considered. For web based application automation, Selenium WebDriver (open source) is the best automation tool.
It is always advisable to set the expectations right before starting any automation activity. Automation ROI is always negative for the first few months. The actual dividends of implementing automation will be reaped in the long term only. Also, automation is a continuous development/maintenance project same as application development. Without test maintenance, automated tests will not be useful in future.