What is our primary use case?
We are responsible for automation of the regression test cases. We have a standard set of regression test cases, which are comprised of SAP solutions, web-based applications, as well as some Windows-based applications. We have test cases which cater to each of these solutions individually.
In addition, we have test cases to test things from end-to-end. That means the data has to flow from one application to another and it has to be validated. We write reusable pieces of code, which are stitched together to create the end-to-ends.
In SAP, transaction codes are available and they are automated. They are stitched together to form a test case. For example, if a customer places an order on the website, we will get an order number in SAP. We will process that order in SAP to create the delivery with a particular T-code. Once we process that delivery, we will mark it as "good session," which means the order itself will flow out of our warehouse via the transportation. Once the customer receives it, we have the invoicing process. We automate these individual T-codes, and then stitch them together.
How has it helped my organization?
In our organization, a developer will develop a piece of code and give it to us. We will test it and tell them about any issues or defects. The way we do that is we automate some piece of their code, whatever the core functionality is, and get ready for the next iteration. That means that when the sprint goes from Sprint 1 to Sprint 2, we make sure that Sprint 1 is not impacted because of new code deployment. The way we have benefited from UFT is that we are not using manual regression testing. Whatever code we have developed will be enhanced in Sprint 2 , and we keep that piece ready for Sprint 3 regression. Therefore, over a period of time, we will have the flow ready, and we don't have to do manual testing from scratch for every release.
Previously, we were doing manual testing for each sprint, and when we got to an advanced sprint, like Sprint 4 or 5, we would have to stop and test that entire functionality again. UFT has helped us a lot in reducing the manual effort and in passing the savings along to our client. Regression efforts have been reduced by at least 20 percent, if not more.
Initially, we were using UFT 12 or 12.53 and then we started slowly increasing by installing the patches and moving to the next versions. When compared with UFT and manual execution, we have definitely saved a lot of effort, somewhere in the range of 60 to 70 percent when compared with our efforts to manually test. A script which takes around half an hour to execute in automation takes around 3.5 hours for manual execution, along with documentation because we execute things in a way that it creates the documentation as well.
What is most valuable?
It is easy to automate and new personnel can start learning automation using UFT One. You don't have to learn any scripting. There are many people on my team who have started learning automation.
For how long have I used the solution?
I have been using UFT for a couple of years, but I have only been using UFT One for the past two to three months. I am still learning many things about UFT One.
What do I think about the stability of the solution?
We haven't faced many issues with UFT One in terms of stability. If your system meets the requirements they indicate, you should not face problems. In a machine where we had less memory, we did have some trouble. Since we upgraded the memory for that machine, we have not faced any memory issues or stability issues with UFT One.
What do I think about the scalability of the solution?
Scalability, for our needs, has worked spectacularly well. There were some issues that we were facing with some of the patches. They were taken under consideration by Micro Focus and we got proper updates from the team.
When we want to increase the number of people in a team, because our licenses are limited, we sometimes face an issue, but that is not their problem because we have chosen limited licenses. We sometimes find it difficult to get people onboarded when we have a lot of work and that sometimes hinders the work. With an open source tool, you don't have any such problem. If you have a lot of work and you want to onboard more people you get it done.
Because our project was already in UFT, we are trying to utilize UFT One to have proper capabilities in AI and for automation from screenshots. But it is good to see a lot of changes and we are trying to utilize them in our upcoming releases and projects.
How are customer service and technical support?
Support is okay. We have not faced many problems. But if we do face some issue, we can definitely raise a ticket and the ticket is looked into. I don't have any complaints about customer support. I would rate it about an eight out of 10.
It's not a 10 because what happens with some of our issues is that we might not get a patch quickly and we have to hold on to an application until we get a proper solution.
Which other solutions did I evaluate?
I have certification in Tosca and UiPath.
Tosca is basically scriptless automation which is also good. UiPath is not technically for regression testing, it's an RPA tool. You don't have validations, per se; you have to create them. Because I have a longer period of association with UFT, and some of the other tools did not help me in some situations, I go with UFT.
What other advice do I have?
From my experience, UFT One is good in terms of automation of multiple applications. For example, if you have five applications and any one of them is not suitable for automation by UFT One, you may have to re-think using it. But if all the applications are compatible with UFT One and you are able to automate, it's better to go with UFT One.
We don't have much continuous testing in our process because we don't do Agile testing, but we do have some amount of testing for what we call "rapids," for defects or announcements. It is useful when it comes to the second or third sprints where there are use cases in which we can leverage speeding up the testing. But we haven't used UFT One for a continuous delivery, as in from build to deployment.
There are several new features which we can explore and use for continuous testing, but our project, not being Agile right now, has limitations in that regard. Management is looking to convert it into an Agile project soon and I expect we will start using UFT One full-fledged, with all its features.
I'm very comfortable with the UFT One for our project needs.
Which deployment model are you using for this solution?
Which version of this solution are you currently using?