Worksoft Certify Room for Improvement

Wayne Fisher
Global ERP Test Manager at a healthcare company with 5,001-10,000 employees
One feature that we have been asking for has been to treat tests as code and store the source code for tests in a configuration management tool. Right now, for version control of testing, it's all internally within the tool. If we have a test of a business process and want to revive that test, our methodology now is purely manual work. We go into the tool, create a copy of the existing test, and call the next one: v2. Now, we have two of them and the only way you can tell them apart is by its naming convention. This is not an efficient way in terms of how modern applications do version control. If this was code, we could plug it into a tool like Git or GitHub to manage of our versioning and branching. The reason why we want to do this is that the application which we are testing branches. When we branch the code, we put a bunch of new functionality on the new version while our production version stays unchanged. Then, at the end, we merge the two together. From an automation testing perspective, we have to run tests on both. Then, we have two current versions of our test. So, it's a bit hard to manage in the tool right now because you can only have this manual approach where we are tracking it via the name convention. Whereas, a modern way of doing it would be to have our application plug it into a version management tool, like GitHub, where we would store the code and could just pull in the version of the test that was applicable to the version of the software that we were testing. This is something we have been asking for for a while now. I understand that it's in the pipeline, and it may be in their latest version (version 11). This is something that we will be looking into this quarter. The challenge that we face everyday for test automation are more internal (people issues). We need change management and getting people to accept automation instead of the technical limitations of the tool. The tool does what we need it to do from an SAP testing perspective. View full review »
Manuel Hermoso Martinez
Senior Consultant at a tech vendor with 10,001+ employees
There are a couple of small things, technically, that could be improved. Features we have asked for include single sign-on. It's a bigger project to make sure that our end users do not have to store passwords, usernames, and the like, for the different tools we have. We are also working on an additional integration with another tool that we have in place for lights-out testing. That's ongoing at the moment. Another idea we brought is that the definitions for the objects need to be automated. They need to be recognized automatically by Worksoft Certify instead of changing them back and forth manually. This is also something that Worksoft is currently working on. Updates, in general, is a topic that we are working on with Worksoft on a regular basis. For new products, for new UI technologies when they come out, the test-automation providers need to update their definitions to make sure that the objects are recognized correctly. View full review »
Colin Hickman
Test Automation Engineer at a healthcare company with 1,001-5,000 employees
Looking at it as a product fully packaged, I would like to see more documentation or ease of use of the documentation. Sometimes documentation does exist but we have to search three different sites to find the proper way to do things or track down the technical document that explains certain fields. That, in turn, relates to the ease of use and how objects interact with each other. The application could lend itself to be simpler. Another area that I would like to see improved is how the permissions are applied. If you're applying permissions groups to a user, one of the options is to delete the group entirely and lose the entire permission group, rather than just deleting the permission from the user, which seems a little silly. In my opinion, that whole module of permissions is very confusing and lends itself to common errors. We have to rebuild permissions occasionally. The functionality is all there. I just think the way it's packaged can be confusing. We are successful and we can get things working the way they're intended to in Worksoft. It's just that sometimes finding how to do that, or where it is described, can be difficult. View full review »
Learn what your peers think about Worksoft Certify. Get advice and tips from experienced pros sharing their opinions. Updated: April 2020.
418,116 professionals have used our research since 2012.
Judy Zeman
Manager, QA at United Technologies
We struggle sometimes with the web side of things, although, I don't know if it is the product or the web application. When you get to the web, Worksoft needs to learn all the fields, and sometimes, it doesn't recognize them. We have had a few cases where we reached out to Worksoft, and said, "Can you help us through this?" because we were not able to do something. Sometimes we have to think about using a different tool. However, the problem with some of these other tools is that they usually require a certain level of data programming skills, and with Worksoft, you don't need that. Almost anyone can learn it if you know how to use the application that you're trying to test. So, this has been a little frustrating for us. We were getting a little frustrated with a tool called Worksoft Analyze. What the tool does is it will look at a transports that you are about to move into production, and review them against your production environment to identify all things that you should be testing by identifying all of the objects thee transports are touching. I would like to use Worksoft in a cloud application rather than the RDT set up we have currently. We are starting to move to S/4HANA, away from SAP ECC, and into the cloud with S/4HANA. I'm doing an S/4 Hana implementation project currently. If we could access the S/4 HANA quality system Worksoft Certify application in the cloud, it would solve most of my infrastructure issues. I would like an improvement in Worksoft’s web application interfaces. I know Worksoft has been focusing on certain frequently used applications, such as Salesforce. They are doing what they did with SAP to make it seamless and put all the field definitions in future upgrades. They should continue down this path. It would be nice to have a way to learn information instead of field by field. I would love to be able to have a more customizable test results report. Typically, if you run 500 automated tests and two fail, you send those results to the Functional Team for remediation. However, we recently did a big service pack update in SAP last year, where we went up six or seven service packs in one shot. Thousands of transports went in and we literally had to test all functionality. All of it. So, we ran hundreds of scripts. That team wanted to see the results of every single test. A customizable report would have decreased the file size we sent out for all of these tests. View full review »
Heather Whitfield
IT Program Manager at Applied Materials
I would like more reporting in analytics. There is a lot of manual work for us as program managers and test managers which has to do with supporting our value statements. E.g., if there is some way that we could systematically capture how long it is taking for automation processes to execute, then we could insert some notes as far as here is how long it took for them to do the manual capture. Then, we could calculate time saved and have a formula for savings. If they have some templates that we could all partner, there are a lot of customers who have created their own, but with the new companies coming onboard. Do they create them on their own or do they try to leverage the best practice within our customer community? There is more we can do here. View full review »
Joe McIvor
SR. Business Process Partner, Commercial Operations at GSK at a pharma/biotech company with 10,001+ employees
We went into this with the thought that we wanted to be able to hand this off to a business user, so the business user could develop their own test cases automatically through automation. We are not seeing that. We still have it assigned to an IT professional, someone who is certified in Certify. We constantly have to have that type of person around who can build these test cases for us. At the moment, there is not an automated testing tool out there that will allow a business user to develop their own test cases, and certainly not at the level that we want it to be it. So, this may not have been a realistic goal on our side to expect that one of our business people, who has their real job, could spend a couple hours here and there developing test cases on an automated testing tool, like Worksoft or any other. It's a software package, and you have to know the software to be good at it. You have to have a certification in the tool to be able to be really good at it. It would be great if our business testers could develop their own automated test cases. However, we either have to bring them up to a level of certification on the software or go hire somebody to do it. Worksoft, in essence, is the Mercedes-Benz of testing tools. If you want a Mercedes-Benz, you have to pay a bit more money. With every release you do, you have to go back and touch your old test cases and bring them up to speed, or develop new test cases. In the beginning, that is a challenge because you have to have someone who is certified in the tool to help you develop these test cases. It is a little complex for someone who is not in the autotesting space to learn it. Like any software, you don't show up to use Oracle Database on day one and think you know it. You have to learn it, get certified in it, and understand it. This tool is similar in that sense. You have to have someone who knows the tool and knows how to use it. It's not something that your business users are gonna pick up, especially if they have a day job. It will take a long time for them to pick it up without full dedication and going to get certified. View full review »
Santhi George
Testing & Quality Assurance Manager at Johnson Matthey Plc
We have requested for some minor new features which Worksoft is considering. The PRIMO image recognition functionality has room for improvement, especially around its ability to work with java interfaces, Execution manager scheduling, etc. as we have observed. As we explore more of our legacy systems, I am certain there will be a need to use more of the PRIMO features to learn the objects. Overall from a SAP perspective, it works almost seamlessly. View full review »
Vincent Immink
Test Automation Architect at a transportation company with 10,001+ employees
Performance on the web UI part, especially with some of the more comprehensive Fiori features, like the complex tables that are being used, could be improved. In those cases we have noticed a lot of execution-time increase with regards to the Certify solution. View full review »
QA Developer II at a university with 10,001+ employees
Worksoft Certify can better identify web test objects by providing libraries through its Extensibility framework. It has improved with it's latest version through Extensibility Tools support and additional test object attributes. Object identification is a necessary barrier for the technical execution of a test script, aside from the script's needs to verify business rules. Automation engineers must affirmatively answer the question: Is the application automatable? If Worksoft Certify or any other test automation tool can get object identification down consistently and flexibly so that maintenance of web object identification (and hence the web test script) is easy and done with no execution problems, it will allow more scripts to be developed and applied faster with the human test automation staff resources on hand. A good part of the technical test automation work is to make the script run and affect script changes when the application under test changes. When done right, the business part of automating the test application functions remains the same - leveraging your test investment. Certify may not the best solution for your needs, but among the commercial and open source offerings in the automation tools space, it should rank very high. It is also a leader in rapid SAP test automation, and can be used as general all-purpose test automation tool for varied clients like PC, SAP, and especially Web. Only one or two tools I have experienced could be suitable in place of Worksoft Certify. However those tools also carry their own set of disadvantages. View full review »
Paul Pandian
Principal Consultant at a tech services company with 10,001+ employees
I would like Worksoft Certify to do automation at any layer (the UI layer, API layer, or database layer) and challenge competitors in the RPA industry, like UiPath and Automation Anywhere. A lot of customers are looking at testing, not just at the UI level, but testing the application or their ecosystem at the API layer. Worksoft could invest on testing on APIs. There are some open source tools available in market which do this, like SoapUI. View full review »
Oliver Heil
VP Test and Quality Management at Deutche Telecom
We are interesting to do better, year-by-year. At the moment, we are doing automated regression tests. The next step would be DevOps or artificial intelligence. Our programs should also develop in this way. We want to have automation everywhere where it is possible. Therefore, we need more options for these next steps. We have used Capture, and it works with Worksoft Analyze. We had some experience last year in August because we started our schedule 1.0 and used Analyze in our tests. We were using the central site for one year with our ERP testing and were quite successful, but this was with Capture 1.0. Then, there was a change to Capture 2.0. In the end, there have been some challenges with the newer version. Therefore, the company testers, the local ones, do not want to use Capture 2.0. 40 percent of the test cases were finalized with automated capture and automated documentation, then the others were done manually. Because we have to create test nodes, we were asked to create a tool that automates documentation, which was Worksoft Analyze. However, with the switch to Capture 2.0, we had some challenges in the beginning. What we did afterwards, together with Worksoft, was we sorted through all the known bugs. So, at the moment, we don't have any known bugs open. We will retry this year in our central test first to find out if it Work Analyze is fine, then if it is okay, we will continue with the local test teams, as well. On the Capture 2.0 topic, we were not satisfied, because we had a version that wasn't really tested from my perspective. Of course, Worksoft said it was tested, but we found a lot of bugs. In the end, our national company and local test teams did not use Worksoft Analyze because it stopped working. We have ten steps, then on the ninth step, it stopped working and we would have to do it again. So, they stopped using Worksoft Analyze and Capture 2.0. However, this is solved. Worksoft directly helped us to find out what the bugs are, and solved them. Then, we retested it. At the moment, we don't have any open bugs. On average, it takes one day for Capture 2.0 users to create document. We expect it is faster, but you have to do it several times sometimes. You have to check the documentation that everything is fine. View full review »
QA Manager at a manufacturing company with 1,001-5,000 employees
In the past, when we've tried to automate some of our web apps, it has not been as robust. If there were one thing that could be improved, it's interaction with web applications. The issue we were running into is that it was harder to identify the objects than it is with some of the other architectured applications. That's the nature of the beast with the web as well. View full review »
SAP Manager at a logistics company with 1,001-5,000 employees
I would expect more opportunities to automate Java. I would like it to analyze what we are not using. I would like to see the impact analysis integrated with the performance testing tool. We have multiple tools doing multiple items. I would like to have one common tool. I'm also interested in load testing automation and whether we can create a script for it, then can we use the same script for my performance testing? View full review »
Stan Butler
Principal Software Engineer at a retailer with 501-1,000 employees
I would like to learn how to get better logs for their support team. View full review »
Piyush Lohana
SQA Test Automation Lead at CHEP USA
One feature that could be added to Capture 2.0 is generating a PDF file from your capture, so you can see your screenshots and steps. This will really help teams leverage the documents generated as part of requirement/training. Right now, when we do regression testing, we manually have to generate all the reports and populate all the results in HP ALM. We really are looking for a solution to have send all the results to HP ALM once Execution Manager completes the execution, then automatically logs them. Our offshore teams experience a lag/delay when using the Worksoft interface. As of now we use VPN and Remote Desktop to help us with this issues, it was be great to see how much Certify 11 has improved in terms to offshore accessibility. Every time there is a new release of Worksoft, they present it in a conference. However, there is no training document nor one point of solution where I one see what new changes/feature have been implemented, like a portal. If I don't know how to use a feature, there is no training nor documentation available. When you reach out for support, it takes time for them to research it and get back to us. I would like more use cases or at least a weekly email update to all the customers saying, "These are new features which have been included in the last week." That would really help. View full review »
Global Testing Solution Lead at a consumer goods company with 1,001-5,000 employees
First, product stability needs major improvements. Our projects get delayed and our executions fail because the product is not stable enough. We hear consistent reports of performance issues, Execution Manager crashes, and so on. What is not helping is Worksoft's ability to respond to issues. They do not have clear SLA's on when issues get closed. We have had High criticality issues that were open for months. Second, there are mixed results for non-SAP Automation. We tried to do web UI testing on SAP Fiori and some internal applications, but the results were mixed. In some cases, we are able to automate, but it takes a very long time to do it. There are other cases where we totally couldn't do it or our customers back out somehow, because of the length of time or limitations of the technology. Also, Worksoft testability assessments take quite awhile. View full review »
System Engineer at a transportation company with 10,001+ employees
We are not using Certify in the development area, only in the functional or end-to-end areas, and there is a lot of activity going on in the development area recently. Right now, the development teams are using open source tools, like Jenkins. This would be a game changer if Worksoft could start in the development area. Going forward, Worksoft will be integrating with Jenkins, which will be great for us. A part of our CI/CD pipeline, we have to deploy through Cloud AWS. So, it is good to hear that they are moving to AWS too. View full review »
Jesse Blakemore
Associate Manager Intelligent Testing at Accenture
A feature that I am looking forward to in version 11 is a search capability, where you can search within the script themselves for keywords. That will be really helpful. View full review »
Ted Devoe
QA Manager Business Applications at a university with 10,001+ employees
We are looking for some enhancements on the Capture 2.0 tool. This would give us the ability to control it directly, like we could with Capture 1.0. Right now, Capture 2.0 doesn't really work for our Business Analysts. Because they don't work with it all the time, it's a little complicated for them to stay up to speed on it. With Capture 1.0, we wrote a wrapper to make it easier for them to use, but we can't use that wrapper with Capture 2.0. So, if Capture 2.0 gets enhanced, we'll start using it. For an enhancement, we want to be able to start and stop recording through an API. Then, we want to see how many steps have been recorded through the API. We do a lot of test maintenance because they are constantly changing the applications. This is one of our biggest problems that are constantly making changes and switching products. For example, we used to use the Supply Relationship Manager. Now, all those tests that we build there will be replaced when we go to Ariba. All the old SAP GUI stuff for HCM, when we got SuccessFactors was thrown out, then had to be redone with SuccessFactors. View full review »
Automation Engineer at a pharma/biotech company with 1,001-5,000 employees
We have had run ins with some bugs on Business Process Procedure (BPP) and Execution Manager. We also did upgrade Worksoft Certify recently to clear up some issues with server fogging. View full review »
Ywanda Jackson
Testing Lead at CenterPoint Energy, Inc.
We had a lot of issues with the optics changing because they're dynamic. We just recently learned they are already worked on fixing it. Another feature that they are also working on is being able to export processes from one project and upload it to another project. Therefore, we can change our both structures within Worksoft. We prefer to run and set it up based on business use for separate projects. It's exciting to know that this is coming. We want to be able to move assets from project to another project without having to be in the same project or the same folder structure. I would like the GUI to be more user-friendly and intuitive. E.g., previously, the buttons were gray. Now, they have color to them and are fun for the user. It also makes them easier to identify. View full review »
Euronica Olivier
Quality Assurance Manager at CHEP
I would love to see more data mining modules. I want to see more stability in the Execution Manager. View full review »
IT Automation Specialist at a energy/utilities company with 1,001-5,000 employees
For Execution Manager, I would like it to be more robust interface and be able to view the remote machines full screen instead of a little window. This would be a great upgrade for us. I would also like more customized reports without having to print out big reports. View full review »
Saurab Juneja
Automation Lead at a tech services company with 10,001+ employees
We're really hopeful for the mobile testing in Worksoft Certify going forward. View full review »
Principal Consultant ERP at a tech services company with 10,001+ employees
It is very easy to use, but there are some places where they need to improve their security. E.g., the BPP tool is just a URL, which does not ask you for a username and password. Anyone can login and can see it. This is a challenge. Regarding the Execution Manager, which is good, since it comes with a username, password, etc. However, once you are logged inside, anyone can execute anything. It shouldn't allow this. Worksoft should create restrictions at the folder level structures, or somewhere they know they can align only few people to do the job, instead of allowing anyone do anything that they like. View full review »
IT Quality Assurance Manager at a manufacturing company with 10,001+ employees
It is poor for a web based application. We are living in very integrated organization are most of the companies out there. There's the big companies we have these organizations that we work with, where we have plenty of different services which are very much connected. So, we are really looking solution which really can support all the different services. We really need to focus end to end instead of stand alone case. Whatever reportings are there, so they're really not very user-friendly. So there is a lot of technical data instead of user-friendly data. It would be wonderful to add web support, I would really like to see this in the future. View full review »
Colton Otterness
Business Analyst at a manufacturing company with 1,001-5,000 employees
There is a learn functionality where Worksoft learns applications that would be nice if Worksoft expanded its support for other applications that aren't web-oriented. View full review »
Senior Manager at a tech services company with 10,001+ employees
For business users, the product needs to be more intuitive and user-friendly. The updates for SAP Fiori have been great, where previously we saw a lot of issues. A year ago, it used to fail miserably. Worksoft teams worked with our product teams to resolve this issue. I would like to see more integration features. It needs to provide the automation across the right set of plugins and integrations, along with cloud solutions, with the ability to quickly adapt. Going forward, I am looking for end-to-end testing in DevOps. View full review »
SAP Configuration ERP II at a energy/utilities company with 5,001-10,000 employees
The product had some UI issues. In the next release I heard the UI issues will be lifted up (version 11), I am excited about it because the product will have more UI features. We are thinking of upgrading our existing Worksoft Certify from 9 to 11, when it is released, as this will be good for the company and help all our users. View full review »
Divya Nayak
Team Leader at SOAIS
I am looking forward to a feature which will be available in the next release, version 11. The search feature, where you can search for any process that you have created. I would like BPP to have more filtering options during the report creation. This would make our customers happy. View full review »
Automation Test Specialist at Lennox International
We would like it to support mobile automation going forward. View full review »
Learn what your peers think about Worksoft Certify. Get advice and tips from experienced pros sharing their opinions. Updated: April 2020.
418,116 professionals have used our research since 2012.