Worksoft Certify Reviews

We are using Worksoft Certify to enable our stakeholders to do test automation on the UI level.

We use it for end-to-end testing of packaged applications. We are part of the internal IT department within our company. Most of the time we are using it on our own products. The products and systems that we get are usually preconfigured and prepackaged and we do additional testing, not just for the functionality for the coding that we add to the product, but also on the prepackaged solutions.

We use it for all kinds of applications. Our focus is the web area, including web-UI testing of modern applications. We have two tools in place: our own internal corporate test automation tool, and Worksoft Certify. The latter is a complementary tool, especially in the web area where there are some white spots for our corporate tool which it cannot cover. That was the main reason why we brought in another tool. And for that, it fits perfectly.

We are able to run our test phases faster. Once the scripts, the test cases, are ready and automated, not only are we able to check our systems or landscapes during the test phases, but we can proactively monitor our development and test systems. Proactive monitoring of our systems is very important for us and was not possible before because manual testing is just too time intensive.

Worksoft Certify helped us to increase time savings. We didn't start test automation in general with Worksoft Certify. We did automation before with our own tool, but it helped us to increase the coverage of test automation and to increase the time savings.

We had a success story with two teams. For the execution of the scripts, we had time savings of 82, 88, 95, and 90 percent. And for the speed, it was between nine and 21 times faster than manual execution.

It's not necessarily saving us money, but it's helping us to free up the capacities of our end users to work on other stuff. Instead of doing testing for two days, they can work on bug fixing, developing new features, etc. That person still gets the same paycheck at the end of the month, so it's not saving us money, but it increases the value of our products. It increases the quality of our products. The reason for that is we are not customer-facing. We are dealing with internal teams and internal products. We are not selling anything to the outside. We are with the internal IT department. For the development teams and the sales team or the consulting team it might be different. But we are not really going out, selling our products and getting the revenue for the company. This is done by other teams.

It's script-free, which is really important for our end users because we are usually dealing with colleagues who are not developers and who do not always have the technical background of developing and scripting. It's very useful that there is a nice UI and the tool is script-free.

It covers all of the technologies we need to cover.

And one big advantage of Worksoft Certify is its integration with SAP Solution Manager, the test suite of Solution Manager, with the certification. That is crucial for us since Solution Manager is our test management tool of choice.

There are a couple of small things, technically, that could be improved.

Features we have asked for include single sign-on. It's a bigger project to make sure that our end users do not have to store passwords, usernames, and the like, for the different tools we have. 

We are also working on an additional integration with another tool that we have in place for lights-out testing. That's ongoing at the moment.

Another idea we brought is that the definitions for the objects need to be automated. They need to be recognized automatically by Worksoft Certify instead of changing them back and forth manually. This is also something that Worksoft is currently working on. 

Updates, in general, is a topic that we are working on with Worksoft on a regular basis. For new products, for new UI technologies when they come out, the test-automation providers need to update their definitions to make sure that the objects are recognized correctly.

It is pretty stable. After upgrades, we usually don't experience any big issues. Of course, it's software, so here and there we find bugs, but nothing crazy, to be honest. The availability of the system is pretty good, almost 100 percent. I don't see an issue here.

At the moment we don't have any issues with scalability. We have about 300 end users working with Worksoft. On infrastructure, it's split. We have a WTS environment, a Citrix environment, for those colleagues who want to use the prepared environment. We have other colleagues who are using the client on their own machines, on their own laptops or desktops. The only thing that we saw at the beginning which we need to change in the future is that, due to the latency, we cannot use clients in the US, for example, while having the server in Germany.

If the latency is over a certain number of milliseconds then it is basically impossible to do automation. That was one of the main reasons why we set up the Citrix environment at the very beginning.

We are still in the phase within our company, or within IT services, of training and spreading the topic of test automation, overall. So our coverage, at the moment, is not the entire organization, it's only the IT department. Once we have done this - and it will take at least another year - we will see if we spread using Worksoft and our internal corporate tool as a combination, or tool ecosystem, further into the organization. But this is not our not our team's responsibility so it's not really in focus at the moment. We are pushing for test automation in our teams and there is still a huge demand for training and new teams coming into the topic of test automation.

In general, technical support is good. They are collaborative and responsive. The only thing I don't like - and this is the only complaint I usually have for Worksoft - is that the first-level support is not always the best for working on topics. We sometimes need to escalate to second-level support and then we know that we are getting a colleague who is aware of the issue and is not just playing for time.

We already reported this to Worksoft and asked them to find another way or to educate the first-level support or to make sure that the tickets go directly to second-level support if they come from us. The guys on our end who are reporting the issues sometimes know more than the first-level support.

When it comes to second-level support, we are happy. There, we know we will get the help that we need. The colleagues are responsive and very helpful and, from a quality perspective, they are very good.

In the beginning, there were some issues with the integration, it didn't work the way we wanted. We spent some time with the Worksoft team, with the support and engineering team, in adding some enhancements to adapt the solution to our three-tier Solution Manager landscape. But that worked very well.

We have a very good collaboration and relationship to Worksoft. For example, every two weeks we have calls with them. We'll provide feedback and they take it seriously. They usually provide us with updates, with enhancements, with new functionalities that we need. That's working pretty well.

We started with manual testing and then we started the test-automation initiative. We started with our internal corporate tool and then, as I mentioned earlier, we figured out that we could not cover everything with that. At the end of 2015, we started to check the market. We did some PoCs and we decided to go forward with Worksoft Certify.

There were a number of reasons we went with Worksoft Certify. The Worksoft team did a great job. They came to our headquarters and did the PoC, showing that the tool is suitable for our needs. They did another PoC with our operations colleagues who were running the regressions testing in Singapore. And then there were the technical requirements that we had. Worksoft Certify was able to cover all of them, some of which I have mentioned already: Being script-free, being fully integrated in Solution Manager, and being able to script in a modular way. And finally, the integration between our own internal tool and Worksoft Certify was also important.

The initial setup was pretty much straightforward. I cannot give you too many details because I did not take care of the implementation. But I know that it took us about two weeks to set up the whole infrastructure. It was not really difficult. And we had very good support from Worksoft, from the support and engineering team. They helped us in setting up the database, setting up the connections. It was not a big deal. In total, within two to four weeks, everything was working fine.

On our side, we had a couple of staff members involved in the implementation because our team is the application owner. We had to involve two more colleagues from the database team because we don't have all the authorization stuff, for the databases area, for the servers etc. In total we had about three staff members involved, but not full-time. It was about one work-week for each of them.

Maintenance is done by myself and one of my colleagues, with the help of our database and server/infrastructure team. We don't have authorizations for everything and we are not database experts. There are three or four staff members taking care of maintenance, as part of our job; it's not a full-time job, obviously.

Whenever we need to do a full upgrade, when we need to plan the downtime for the production system, we try to make it on the weekend. I also already recommended to Worksoft that it would be nice to have something like an offline update where the system can be upgraded or smaller changes and fixes can be included without having full downtime. For an upgrade we usually need two to three hours. Afterward, we do a bit of testing, so upgrading takes about half a day.

It was just one or two people from Worksoft and three guys on our side.

We get feedback from all areas that the return on investment is there. Not just regarding time savings, but also cost-reduction. The return on investment in one case was reached at something between five and six runs, which is pretty fast, especially in an Agile environment.

What is also very important for us here is the avoidance of human error during the execution of tests. Usually, if someone is sitting in front of a laptop and doing testing eight hours a day, he or she will make some mistakes. This does not happen with a tool. Another important factor for us is the availability for testing. Usually, it's pretty hard to plan a test phase to bring all the testers to the table and get the time blocked off for the test phases. For the tools, we just need the systems up and running and then it's a matter of minutes to set up the test plans and to run the tests.

At the moment we are rolling out Execution Manager.

At the time we decided to bring in Worksoft Certify, we looked into two other tools. The key difference was that Worksoft was script-free. That was not the case for other tools. And the full integration to Solution Manager was one of the key differentiators between the tools.

If you have done a market evaluation and have decided to go for Worksoft, my advice is to go for it. I would definitely recommend Worksoft Certify as a test automation tool.

The feedback that I get from our stakeholders is that the tool is pretty simple to use. What we usually do is a two-week training, not full time, where the total is about three to four business days, 20 to 25 work hours. From there, most of our colleagues can start working with the tool. Of course, they have questions later on, some difficulties when it gets into special activities. But overall, the tool is easy to use. It's generally found to be intuitive.

In terms of cutting test maintenance time with respect to the scripts, that has not happened. If you need to adapt your scripts, automated test scripts are much more complex and more effort-intensive than manual test cases. But this is the nature of the beast. It will happen with every tool. If a screen changes, if a system changes, then you have to adapt your script for manual testing. For a manual script, you just adapt a Word document or an Excel sheet or the like. But if the process flow changes, you have new windows, new options, then you have to adjust your script for each and every provider that you're selecting. The maintenance of scripts is something that I always discuss with my end users and should never be underestimated.

We are not using the Capture 2.0 feature at the moment. We are planning to use it in the future. But at the moment, due to the heavy workload on our plate, we haven't had the chance to look into and to roll it out. We are familiar with the concept of Capture and it's a very nice feature because it makes the collaboration between business and IT much easier, and business can be involved in test-automation topics and activities as well.

We have three roles in our environment. We have the key players, who are the project managers, the persons responsible for test automation overall in the respective teams.
Then we have the test automation engineers who are responsible for creating test scripts and to maintain them; sometimes they run them as well. And finally, we have the executors, the ones who are running the scripts, checking the details and, if something is not working fine, going back to the test-automation engineers and asking for support and help.

I rate Worksoft Certify at nine out of ten. I'm happy with the tool, I'm happy with our colleagues at Worksoft. We have a very good relationship, we can bring up everything. There isn't much I can complain about. I'm happy at the moment with Worksoft.

Well, obviously it's the test automation piece of it. Creating our scripts and being able to execute our SAP scripts in order for us to be able to do comprehensive regression testing of our SAP system.

Well, it's definitely reduced the number of defects that we have. Before, when we were manually testing everything, it was unclear to us where changes that we were making, where the impacts were in our system. I mean, we've got very smart people that work here, but they were not 100% on where the impacts were going to occur with their changes.

By automating our scripts, we were able to do more comprehensive testing and therefore eliminate the number of defects that were be introduced into our environment.

There is an impact assessment piece to Worksoft. I think that's one of the pieces that we still struggle to use.

What the tool does is, you can analyze a transport to know where your impacts are. I think that's one of the challenges that we still have -- is just getting a better handle on how to use the Impact Assessment better for us.

In our regression testing, all that, we've got a pretty good handle on that. We identified things. When we run the analyze of a transport, we're not...we've found other ways to do things better.

Four years now.

No. It's been very, very reliable. The only issue, we've virtualized everything. I think the only thing, the only real issue we encountered was with our virtual machines. It was not a Worksoft issue.

It was on our side -- once we worked with our sys-admins to investigate what was going on, they were able to resurrect the issue and we were fine. It was not a Worksoft issue at all. It was something with our virtual environment.

It's been very scalable for us;

Depending on how many licenses, it's all seat licensed. It's not a concurrent license. If you don't have people logged in, more people can't use your licenses from your pool.

You assign those licenses out to people and as you continue to grow, like I was talking about with our virtual machines, we do everything in a virtual environment for all of our Worksoft work.

As we've needed more virtual machines, we've got an image of our Worksoft clients and we just add them into our environment.

3 out of 10 -- You submit an email, so there's not really a hotline that you can call to talk to somebody on the other end.

I had familiarity with several tools out there. Turnkey is probably one that you guys have looked at. I've done a lot with the quality center products in the past...Quicktest Pro.

There's other test automation tools out there. I've got a background with test automation and Worksoft...really it was between Worksoft and Turnkey. Worksoft, we just found ,was going to better meet our needs.

Yeah. That was actually pretty straightforward. When we set up our environment, they gave us a technical support person that really walked through with our system administration team to get everything set up in our environment.

As far as training, they have a very comprehensive training program. I'm sure it's all ... I'm sure it's very good. What we did and what helped us to be very successful is we went through and did live test cases as part of our training.

Instead of spending all the time going through the books and learning the tool in and out, we went through and we got right into creating our test automation with the trainer that they sent out. That hands on experience was, it was priceless. It helped us to be successful and get going with creating all of our test automation.

Make sure...before you start any of your test automation, make sure you have the appropriate support from your business.

What I mean by that is, you have all of your business processes documented. There is a lot of prep work that goes into creating your test automation to make sure you're creating...you're creating your scripts in the most efficient manner. A lot of this testing is done based on your business process. You need to understand your business processes.

It has ability to execute the scripts without any manual intervention. It has ability to run scripts overnight without any human intervention (lights-out testing), which proves to be vital in providing wider coverage in a short time.

We are able to scale up the testing and to address more business-driven projects using Worksoft, which would not be possible with any other tools. The testing organization can cut short its budget, as it is not required to hire more testers for regression testing.

Upgrading Certify takes a lot of time and effort, which is like a small project by itself.

I have used it for two years.

We have not encountered any deployment issues.

We have not encountered any stability issues.

We have not encountered any scalability issues.

Customer service is 4.5 out of 5.

Technical support is 4.5 out of 5.

We used to use QTP, but the ability of Worksoft in the SAP automation space compelled us to make the transition.

We used the Worksoft director access to test automation.

The tool is easy to use. It is a drag and drop Microsoft type of solution.

Worksoft Certify needs improvement on customization of reporting and how you report final outcomes. It needs more customization.

I have been using Worksoft Certify for  years.

The solution is very stable.

Worksoft Certify is scalable. However, if the final output were more customizable, it would be even more scalable.

Worksoft Certify's technical support is a 3 out of 5.

Positive

The initial setup is straightforward. 

The implementation depends on the client's business. Overall, it is not very complex. It is simple and easy to implement. There is no need for a third party integrator.

We have an annual license for this solution. The product is very expensive.

Choosing this solution is entirely dependent on the specific business requirements, the time required and the budget available. If you are looking for an easy to implement scalable solution, Worksoft Certify is recommended if it works within your budget.

I would rate Worksoft Certify an 8 out of 10.

We are in the retail business, so our primary use case is automated regression testing on our supply chain. It helps us oversee our internal economy, including the warehouse, HR, and the stores. 

We prefer Worksoft over other platforms because it's a low-code solution

We can't get the process intelligence module to work properly. We can't get the impact comment that analyzes the incoming development code to run, either. We've also had bugs in the CTM and execution manager in the past year. It took technical support a long time to resolve this issue. We escalated it so that the vice president of the company was included as well. 

I have used Certify for a few years, but the company has been working with it for five years. 

I rate Worksoft support five out of 10. They have some general issues that they're they're not testing, but when we open a ticket, they give us a hot-patch fix. It seems like they're not testing their products enough. On the other hand, Worksoft support has been responsive to our requests. They've addressed the whole list of issues, so we have no more open tickets. Once they escalate something, they're efficient. 

Neutral

The vendor installed it for us, but there were still many issues. We've reported over a hundred bugs and defects. In that time, we could run stuff, but sometimes it has been standing still. 

Worksoft is reasonably priced. 

I rate Worksoft Certify six out of 10. Before implementing the solution, you need to think about how you will use it because it has so many modules. You should consider how you will use those and do a proof of concept. Worksoft hyped up the process intelligence and impact modules for two years, and they still aren't working for us. Before you buy it, make sure it works in your environment. In the future, I hope they have a more stable product with more internal testing and quality control. 

Our primary use case for Worksoft Certify is the automation of test cases. Performance-wise Worksoft Certify is very good. 

The most valuable feature of Worksoft Certify is that it has a codeless environment, so you do not have to be a programmer to use it. 

Worksoft Certify supports multiple interfaces and applications like SAP, Web, or Silverlight Java, and Mainframe. It is easily integrated. 

I have used the tool for a long time and much has improved over the years. Many new features have been added and the tool improves on a daily basis. The UI is much better now and it looks much nicer as well. 

Worksoft Certify's tech support's response time could be improved. 

I have been using Worksoft Certify for nine years. I use the product on a daily basis. 

Worksoft Certify is easy to scale. We have somewhere between 60 and 80 people using it at the moment. 

We do have technical support from Worksoft Certify. When we do run into issues, we first see if we can sort them out in-house. If we are not able to, we reach out to them and they look into the issue and sort it out. 

Positive

I previously used Selenium. Comparing these two products, I can say that you need much more IT knowledge to use Selenium. Worksoft Certify is quite easy to debug. 

The initial setup was easy. On a scale of one to five, with one being very complex and five being very easy, I would give the Worksoft Certify deployment process a five. It also does not need very much maintenance at all. 

We deployed Worksoft Certify in-house. The deployment did not take much time at all. It took just a few hours. 

Worksoft Certify is a bit costly. It is a good product so the cost is a bit high. But I'm not sure about how much we pay for it exactly. 

The advice I would give to someone looking to implement Worksoft Certify is this: contact the provider and request what you need to be installed. Once the solution is installed, you can open up the user manuals and start learning it. It is easy to learn and implement a project in Worksoft Certify.

On a scale from one to ten, with one being the worst and ten the best, I would rate this product a ten overall. 

The primary use case is SAP applications and customized web-based applications. Now, the company is moving into Salesforce, which is something big for us.

I've worked on multiple projects and our customers are very happy using it. The company is also very happy with the tool. 

We have something called automatic processing in SAP. Previously, the company was doing it manually, which used to take hours to days. Now, we have a script that processes 200 to 300 orders per day.

Everything is integrated with SAP and the web, and it works smoothly. However, we are not yet using it for web UI testing.

• The ease of use.
• It is understandable.
• Everything is integrated.

The Capture 2.0 feature is good. Our clients like using it. It does not take long to create documentation. Once the client knows how to use it, they capture the steps, like a recording. They give it to us for putting on the best practices, and we give them back the results. Efficiency-wise, it is pretty good.

I am looking forward to a feature which will be available in the next release, version 11. The search feature, where you can search for any process that you have created. 

I would like BPP to have more filtering options during the report creation. This would make our customers happy.

The product is stable.

The technical support is very good. They are helpful and provide solutions on time and very quickly.

Our customers come up with their requirements, then we come up with a PoC for them. If it works and their happy, they go ahead with it. 

I work with customers for new implementations.

The initial setup is pretty straightforward. There are a few packages that you need to install, then you have the tutorials which guide you on how to do it. It is that easy.

Our customers are saving money.

It saves us time: approximately 50 percent.

We have cut test maintenance time by 70 to 80 percent.

Experience working with the tool and explore the features of it, because I think the Worksoft Certify is the best and can do anything.

All the different kinds of recording features (learn) on the different technology platforms such as Java, SAP, and HTML are its most valuable features.

It facilitates 80% of our regression tests.

We have had problems with an external cloud service (technology is Adobe Flex).

I have used this solution for two years.

There were no stability issues.

There were no scalability issues.

The technical support level is quite high. We are very pleased with its flexibility of services and response time on issues.

Previously, we just had manual testings.

We had quite a slow implementation. The process has given us time to learn and do things in the right way. We have also received good support when we experienced any issues.

The consultant's rate is very high but Worksoft is quite flexible.

We did do a PoC and compared it with other products from SAP and HPE.

Take your time, do a business case and plan from the beginning as to how your organization will work with the test automation.

In the beginning, there will be different technical issues between Worksoft and your business application, which will take some time to fix. You also need good internal support from the people who know the business application. Support from the managers is a must.