2017-07-05T06:05:00Z

What needs improvement with Worksoft Certify?


Please share with the community what you think needs improvement with Worksoft Certify.

What are its weaknesses? What would you like to see changed in a future version?

Guest
3131 Answers

author avatar
Top 5Real User

Looking at it as a product fully packaged, I would like to see more documentation or ease of use of the documentation. Sometimes documentation does exist but we have to search three different sites to find the proper way to do things or track down the technical document that explains certain fields. That, in turn, relates to the ease of use and how objects interact with each other. The application could lend itself to be simpler. Another area that I would like to see improved is how the permissions are applied. If you're applying permissions groups to a user, one of the options is to delete the group entirely and lose the entire permission group, rather than just deleting the permission from the user, which seems a little silly. In my opinion, that whole module of permissions is very confusing and lends itself to common errors. We have to rebuild permissions occasionally. The functionality is all there. I just think the way it's packaged can be confusing. We are successful and we can get things working the way they're intended to in Worksoft. It's just that sometimes finding how to do that, or where it is described, can be difficult.

2020-03-04T08:49:00Z
author avatar
Top 5Real User

Performance on the web UI part, especially with some of the more comprehensive Fiori features, like the complex tables that are being used, could be improved. In those cases we have noticed a lot of execution-time increase with regards to the Certify solution.

2020-03-01T06:37:00Z
author avatar
Real User

For Execution Manager, I would like it to be more robust interface and be able to view the remote machines full screen instead of a little window. This would be a great upgrade for us. I would also like more customized reports without having to print out big reports.

2019-03-10T11:35:00Z
author avatar
Real User

A feature that I am looking forward to in version 11 is a search capability, where you can search within the script themselves for keywords. That will be really helpful.

2019-03-10T11:16:00Z
author avatar
Top 20Real User

I would like more reporting in analytics. There is a lot of manual work for us as program managers and test managers which has to do with supporting our value statements. E.g., if there is some way that we could systematically capture how long it is taking for automation processes to execute, then we could insert some notes as far as here is how long it took for them to do the manual capture. Then, we could calculate time saved and have a formula for savings. If they have some templates that we could all partner, there are a lot of customers who have created their own, but with the new companies coming onboard. Do they create them on their own or do they try to leverage the best practice within our customer community? There is more we can do here.

2019-03-10T11:16:00Z
author avatar
Real User

There is a learn functionality where Worksoft learns applications that would be nice if Worksoft expanded its support for other applications that aren't web-oriented.

2019-03-10T11:16:00Z
author avatar
Real User

We are not using Certify in the development area, only in the functional or end-to-end areas, and there is a lot of activity going on in the development area recently. Right now, the development teams are using open source tools, like Jenkins. This would be a game changer if Worksoft could start in the development area. Going forward, Worksoft will be integrating with Jenkins, which will be great for us. A part of our CI/CD pipeline, we have to deploy through Cloud AWS. So, it is good to hear that they are moving to AWS too.

2019-03-10T11:16:00Z
author avatar
Real User

We have had run ins with some bugs on Business Process Procedure (BPP) and Execution Manager. We also did upgrade Worksoft Certify recently to clear up some issues with server fogging.

2019-03-10T11:16:00Z
author avatar
Real User

For business users, the product needs to be more intuitive and user-friendly. The updates for SAP Fiori have been great, where previously we saw a lot of issues. A year ago, it used to fail miserably. Worksoft teams worked with our product teams to resolve this issue. I would like to see more integration features. It needs to provide the automation across the right set of plugins and integrations, along with cloud solutions, with the ability to quickly adapt. Going forward, I am looking for end-to-end testing in DevOps.

2019-03-10T11:16:00Z
author avatar
Real User

First, product stability needs major improvements. Our projects get delayed and our executions fail because the product is not stable enough. We hear consistent reports of performance issues, Execution Manager crashes, and so on. What is not helping is Worksoft's ability to respond to issues. They do not have clear SLA's on when issues get closed. We have had High criticality issues that were open for months. Second, there are mixed results for non-SAP Automation. We tried to do web UI testing on SAP Fiori and some internal applications, but the results were mixed. In some cases, we are able to automate, but it takes a very long time to do it. There are other cases where we totally couldn't do it or our customers back out somehow, because of the length of time or limitations of the technology. Also, Worksoft testability assessments take quite awhile.

2019-03-10T11:16:00Z
author avatar
Consultant

I would like Worksoft Certify to do automation at any layer (the UI layer, API layer, or database layer) and challenge competitors in the RPA industry, like UiPath and Automation Anywhere. A lot of customers are looking at testing, not just at the UI level, but testing the application or their ecosystem at the API layer. Worksoft could invest on testing on APIs. There are some open source tools available in market which do this, like SoapUI.

2019-03-10T11:16:00Z
author avatar
Real User

The product had some UI issues. In the next release I heard the UI issues will be lifted up (version 11), I am excited about it because the product will have more UI features. We are thinking of upgrading our existing Worksoft Certify from 9 to 11, when it is released, as this will be good for the company and help all our users.

2019-03-10T11:16:00Z
author avatar
Top 20Real User

I would like to learn how to get better logs for their support team.

2019-03-10T11:16:00Z
author avatar
Real User

We had a lot of issues with the optics changing because they're dynamic. We just recently learned they are already worked on fixing it. Another feature that they are also working on is being able to export processes from one project and upload it to another project. Therefore, we can change our both structures within Worksoft. We prefer to run and set it up based on business use for separate projects. It's exciting to know that this is coming. We want to be able to move assets from project to another project without having to be in the same project or the same folder structure. I would like the GUI to be more user-friendly and intuitive. E.g., previously, the buttons were gray. Now, they have color to them and are fun for the user. It also makes them easier to identify.

2019-03-10T11:16:00Z
author avatar
Top 20Real User

One feature that could be added to Capture 2.0 is generating a PDF file from your capture, so you can see your screenshots and steps. This will really help teams leverage the documents generated as part of requirement/training. Right now, when we do regression testing, we manually have to generate all the reports and populate all the results in HP ALM. We really are looking for a solution to have send all the results to HP ALM once Execution Manager completes the execution, then automatically logs them. Our offshore teams experience a lag/delay when using the Worksoft interface. As of now we use VPN and Remote Desktop to help us with this issues, it was be great to see how much Certify 11 has improved in terms to offshore accessibility. Every time there is a new release of Worksoft, they present it in a conference. However, there is no training document nor one point of solution where I one see what new changes/feature have been implemented, like a portal. If I don't know how to use a feature, there is no training nor documentation available. When you reach out for support, it takes time for them to research it and get back to us. I would like more use cases or at least a weekly email update to all the customers saying, "These are new features which have been included in the last week." That would really help.

2019-03-10T11:16:00Z
author avatar
Real User

We are interesting to do better, year-by-year. At the moment, we are doing automated regression tests. The next step would be DevOps or artificial intelligence. Our programs should also develop in this way. We want to have automation everywhere where it is possible. Therefore, we need more options for these next steps. We have used Capture, and it works with Worksoft Analyze. We had some experience last year in August because we started our schedule 1.0 and used Analyze in our tests. We were using the central site for one year with our ERP testing and were quite successful, but this was with Capture 1.0. Then, there was a change to Capture 2.0. In the end, there have been some challenges with the newer version. Therefore, the company testers, the local ones, do not want to use Capture 2.0. 40 percent of the test cases were finalized with automated capture and automated documentation, then the others were done manually. Because we have to create test nodes, we were asked to create a tool that automates documentation, which was Worksoft Analyze. However, with the switch to Capture 2.0, we had some challenges in the beginning. What we did afterwards, together with Worksoft, was we sorted through all the known bugs. So, at the moment, we don't have any known bugs open. We will retry this year in our central test first to find out if it Work Analyze is fine, then if it is okay, we will continue with the local test teams, as well. On the Capture 2.0 topic, we were not satisfied, because we had a version that wasn't really tested from my perspective. Of course, Worksoft said it was tested, but we found a lot of bugs. In the end, our national company and local test teams did not use Worksoft Analyze because it stopped working. We have ten steps, then on the ninth step, it stopped working and we would have to do it again. So, they stopped using Worksoft Analyze and Capture 2.0. However, this is solved. Worksoft directly helped us to find out what the bugs are, and solved them. Then, we retested it. At the moment, we don't have any open bugs. On average, it takes one day for Capture 2.0 users to create document. We expect it is faster, but you have to do it several times sometimes. You have to check the documentation that everything is fine.

2019-03-10T11:16:00Z
author avatar
Real User

We are looking for some enhancements on the Capture 2.0 tool. This would give us the ability to control it directly, like we could with Capture 1.0. Right now, Capture 2.0 doesn't really work for our Business Analysts. Because they don't work with it all the time, it's a little complicated for them to stay up to speed on it. With Capture 1.0, we wrote a wrapper to make it easier for them to use, but we can't use that wrapper with Capture 2.0. So, if Capture 2.0 gets enhanced, we'll start using it. For an enhancement, we want to be able to start and stop recording through an API. Then, we want to see how many steps have been recorded through the API. We do a lot of test maintenance because they are constantly changing the applications. This is one of our biggest problems that are constantly making changes and switching products. For example, we used to use the Supply Relationship Manager. Now, all those tests that we build there will be replaced when we go to Ariba. All the old SAP GUI stuff for HCM, when we got SuccessFactors was thrown out, then had to be redone with SuccessFactors.

2019-03-10T11:16:00Z
author avatar
Top 20Real User

I would expect more opportunities to automate Java. I would like it to analyze what we are not using. I would like to see the impact analysis integrated with the performance testing tool. We have multiple tools doing multiple items. I would like to have one common tool. I'm also interested in load testing automation and whether we can create a script for it, then can we use the same script for my performance testing?

2019-03-10T11:16:00Z
author avatar
Top 20Real User

I would love to see more data mining modules. I want to see more stability in the Execution Manager.

2019-03-10T11:16:00Z
author avatar
Real User

We would like it to support mobile automation going forward.

2019-03-10T11:16:00Z
author avatar
Consultant

It is very easy to use, but there are some places where they need to improve their security. E.g., the BPP tool is just a URL, which does not ask you for a username and password. Anyone can login and can see it. This is a challenge. Regarding the Execution Manager, which is good, since it comes with a username, password, etc. However, once you are logged inside, anyone can execute anything. It shouldn't allow this. Worksoft should create restrictions at the folder level structures, or somewhere they know they can align only few people to do the job, instead of allowing anyone do anything that they like.

2019-03-10T11:16:00Z
author avatar
Real User

I am looking forward to a feature which will be available in the next release, version 11. The search feature, where you can search for any process that you have created. I would like BPP to have more filtering options during the report creation. This would make our customers happy.

2019-03-10T11:16:00Z
author avatar
Real User

We're really hopeful for the mobile testing in Worksoft Certify going forward.

2019-03-10T11:16:00Z
author avatar
Top 20Real User

We went into this with the thought that we wanted to be able to hand this off to a business user, so the business user could develop their own test cases automatically through automation. We are not seeing that. We still have it assigned to an IT professional, someone who is certified in Certify. We constantly have to have that type of person around who can build these test cases for us. At the moment, there is not an automated testing tool out there that will allow a business user to develop their own test cases, and certainly not at the level that we want it to be it. So, this may not have been a realistic goal on our side to expect that one of our business people, who has their real job, could spend a couple hours here and there developing test cases on an automated testing tool, like Worksoft or any other. It's a software package, and you have to know the software to be good at it. You have to have a certification in the tool to be able to be really good at it. It would be great if our business testers could develop their own automated test cases. However, we either have to bring them up to a level of certification on the software or go hire somebody to do it. Worksoft, in essence, is the Mercedes-Benz of testing tools. If you want a Mercedes-Benz, you have to pay a bit more money. With every release you do, you have to go back and touch your old test cases and bring them up to speed, or develop new test cases. In the beginning, that is a challenge because you have to have someone who is certified in the tool to help you develop these test cases. It is a little complex for someone who is not in the autotesting space to learn it. Like any software, you don't show up to use Oracle Database on day one and think you know it. You have to learn it, get certified in it, and understand it. This tool is similar in that sense. You have to have someone who knows the tool and knows how to use it. It's not something that your business users are gonna pick up, especially if they have a day job. It will take a long time for them to pick it up without full dedication and going to get certified.

2019-02-04T08:44:00Z
author avatar
Top 20Real User

One feature that we have been asking for has been to treat tests as code and store the source code for tests in a configuration management tool. Right now, for version control of testing, it's all internally within the tool. If we have a test of a business process and want to revive that test, our methodology now is purely manual work. We go into the tool, create a copy of the existing test, and call the next one: v2. Now, we have two of them and the only way you can tell them apart is by its naming convention. This is not an efficient way in terms of how modern applications do version control. If this was code, we could plug it into a tool like Git or GitHub to manage of our versioning and branching. The reason why we want to do this is that the application which we are testing branches. When we branch the code, we put a bunch of new functionality on the new version while our production version stays unchanged. Then, at the end, we merge the two together. From an automation testing perspective, we have to run tests on both. Then, we have two current versions of our test. So, it's a bit hard to manage in the tool right now because you can only have this manual approach where we are tracking it via the name convention. Whereas, a modern way of doing it would be to have our application plug it into a version management tool, like GitHub, where we would store the code and could just pull in the version of the test that was applicable to the version of the software that we were testing. This is something we have been asking for for a while now. I understand that it's in the pipeline, and it may be in their latest version (version 11). This is something that we will be looking into this quarter. The challenge that we face everyday for test automation are more internal (people issues). We need change management and getting people to accept automation instead of the technical limitations of the tool. The tool does what we need it to do from an SAP testing perspective.

2019-02-04T08:44:00Z
author avatar
Top 20Real User

We struggle sometimes with the web side of things, although, I don't know if it is the product or the web application. When you get to the web, Worksoft needs to learn all the fields, and sometimes, it doesn't recognize them. We have had a few cases where we reached out to Worksoft, and said, "Can you help us through this?" because we were not able to do something. Sometimes we have to think about using a different tool. However, the problem with some of these other tools is that they usually require a certain level of data programming skills, and with Worksoft, you don't need that. Almost anyone can learn it if you know how to use the application that you're trying to test. So, this has been a little frustrating for us. We were getting a little frustrated with a tool called Worksoft Analyze. What the tool does is it will look at a transports that you are about to move into production, and review them against your production environment to identify all things that you should be testing by identifying all of the objects thee transports are touching. I would like to use Worksoft in a cloud application rather than the RDT set up we have currently. We are starting to move to S/4HANA, away from SAP ECC, and into the cloud with S/4HANA. I'm doing an S/4 Hana implementation project currently. If we could access the S/4 HANA quality system Worksoft Certify application in the cloud, it would solve most of my infrastructure issues. I would like an improvement in Worksoft’s web application interfaces. I know Worksoft has been focusing on certain frequently used applications, such as Salesforce. They are doing what they did with SAP to make it seamless and put all the field definitions in future upgrades. They should continue down this path. It would be nice to have a way to learn information instead of field by field. I would love to be able to have a more customizable test results report. Typically, if you run 500 automated tests and two fail, you send those results to the Functional Team for remediation. However, we recently did a big service pack update in SAP last year, where we went up six or seven service packs in one shot. Thousands of transports went in and we literally had to test all functionality. All of it. So, we ran hundreds of scripts. That team wanted to see the results of every single test. A customizable report would have decreased the file size we sent out for all of these tests.

2019-02-04T08:44:00Z
author avatar
Top 20Real User

We have requested for some minor new features which Worksoft is considering. The PRIMO image recognition functionality has room for improvement, especially around its ability to work with java interfaces, Execution manager scheduling, etc. as we have observed. As we explore more of our legacy systems, I am certain there will be a need to use more of the PRIMO features to learn the objects. Overall from a SAP perspective, it works almost seamlessly.

2019-02-04T08:44:00Z
author avatar
Consultant

There are a couple of small things, technically, that could be improved. Features we have asked for include single sign-on. It's a bigger project to make sure that our end users do not have to store passwords, usernames, and the like, for the different tools we have. We are also working on an additional integration with another tool that we have in place for lights-out testing. That's ongoing at the moment. Another idea we brought is that the definitions for the objects need to be automated. They need to be recognized automatically by Worksoft Certify instead of changing them back and forth manually. This is also something that Worksoft is currently working on. Updates, in general, is a topic that we are working on with Worksoft on a regular basis. For new products, for new UI technologies when they come out, the test-automation providers need to update their definitions to make sure that the objects are recognized correctly.

2019-01-31T08:49:00Z
author avatar
Real User

In the past, when we've tried to automate some of our web apps, it has not been as robust. If there were one thing that could be improved, it's interaction with web applications. The issue we were running into is that it was harder to identify the objects than it is with some of the other architectured applications. That's the nature of the beast with the web as well.

2019-01-31T08:49:00Z
author avatar
Real User

It is poor for a web based application. We are living in very integrated organization are most of the companies out there. There's the big companies we have these organizations that we work with, where we have plenty of different services which are very much connected. So, we are really looking solution which really can support all the different services. We really need to focus end to end instead of stand alone case. Whatever reportings are there, so they're really not very user-friendly. So there is a lot of technical data instead of user-friendly data. It would be wonderful to add web support, I would really like to see this in the future.

2018-10-08T17:34:00Z
author avatar
Real User

Worksoft Certify can better identify web test objects by providing libraries through its Extensibility framework. It has improved with it's latest version through Extensibility Tools support and additional test object attributes. Object identification is a necessary barrier for the technical execution of a test script, aside from the script's needs to verify business rules. Automation engineers must affirmatively answer the question: Is the application automatable? If Worksoft Certify or any other test automation tool can get object identification down consistently and flexibly so that maintenance of web object identification (and hence the web test script) is easy and done with no execution problems, it will allow more scripts to be developed and applied faster with the human test automation staff resources on hand. A good part of the technical test automation work is to make the script run and affect script changes when the application under test changes. When done right, the business part of automating the test application functions remains the same - leveraging your test investment. Certify may not the best solution for your needs, but among the commercial and open source offerings in the automation tools space, it should rank very high. It is also a leader in rapid SAP test automation, and can be used as general all-purpose test automation tool for varied clients like PC, SAP, and especially Web. Only one or two tools I have experienced could be suitable in place of Worksoft Certify. However those tools also carry their own set of disadvantages.

2017-07-05T06:05:00Z
Learn what your peers think about Worksoft Certify. Get advice and tips from experienced pros sharing their opinions. Updated: April 2020.
442,986 professionals have used our research since 2012.