What is most valuable?
The most valuable feature is that we have a test automation solution that is really developer friendly. So, you have Java as a programming language. You have Eclipse or the Intel HAS IDE and you can really use the development tools. That's the best part out of it. You can also have this with Selenium or any other developer friendly solution, but UFT Pro also supports different technologies. So, you can test web applications, you can test Java applications, you can test Windows applications. And, most other tools, at least the free-ware solutions, only cope with one specific technology.
Another big feature is the integration with ALM. It's quite easy to start the test cases from ALM and to have the results in ALM. And it's also possible to make business process tests with Lean FT or UFT Pro. And I think all these parts together make it the best possible solution.
How has it helped my organization?
For example, we had just recently had the new release of our web page, and there we had a lot of test cases for small tools like a calculator for tax savings when you invest in different products, or whatever. There were a lot of little pieces on the website which needed testing. And we had an agile methodology to develop the new website and from time to time a new tool got released on the test system. And then we needed little effort to automate it and do the tests. And also, we could redo all the tests when a new version was released. So, we always had the security that nothing important changed or nothing which already worked was destroyed with the new release.
What needs improvement?
There are still some stability issues. Also, the integration with ALM is not perfect. There issues with parameter parsing.
We don't have ALM Octane now and I've never used it, so I don't know whether it would beneficial. But I think we're too big to easily switch to another test management solution.
What do I think about the stability of the solution?
Now stability is quite good. At the beginning, we had a bit of trouble with our company environment because the browser or the Java version is specifically configured and we had to fight a little bit to make it work correctly. Right now, we are very happy. Also, with the integration into ALM, it works quite good. We had some issues with special characters from ALM, to bring them to UFT Pro and backwards, but this is the biggest pain point right now, so it's not really a big deal.
What do I think about the scalability of the solution?
We have around three and half thousand employees. It is quite scalable. It depends how you do it. You can make automated scripts which do not scale at all. But since it's a developer friendly tool, you have the ability to cut it in the right way to make modules, and then it is very nice to handle it with multiple applications with a lot of test cases.
How is customer service and technical support?
Right now, we have a good experience with support because we quickly get to developers with issues. When we contact the support, if it is a bigger problem, we have a call or a session with the developers themselves and that's quite nice. They have also been at PostFinance twice. And this gives you a good feeling about being important and you think they care about you and they want you to have a product that works.
How was the initial setup?
Since I used to use a lot of other automation tools, it was very straightforward. It is quite simple if you know Selenium or if you know IBM Rational Functional Tester.
Which other solutions did I evaluate?
Compared to IBM Selenium, LeanFT or UFT Pro is more stable. They have better object recognition functionalities and more support technologies. Maybe they have a bit less browser support than Selenium, but that's okay.
Compared to any of the competitors that I’ve looked at, the HPE tool is a bit smaller. So, it makes it more fun to use it because you don't have such a large application as the Rational test suite or the Functional Tester. And I think it was more stable. So, even at the beginning, we had fewer problems than with Functional Tester and object recognition. But, I think both tools are not bad.
The major advantage of LeanFT or UFT Pro is that it is easier to integrate it into ALM. So, with Functional Test we always had these space scripts in ALM, and then we had to call Functional Tester somehow and bring the results back to ALM. It's easier with LeanFT.
What other advice do I have?
Try to build a test automation framework so that part of it could be managed by the development teams. And at least the page objects should be released together with the software to test. This makes everything easier for the test automation team. And makes the test automation solution faster.
Disclosure: IT Central Station contacted the reviewer to collect the review and to validate authenticity. The reviewer was referred by the vendor, but the review is not subject to editing or approval by the vendor.
Jun 04 2017