gagneetContinuous Delivery Lead at SAI Global
We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
"It is very easy to maintain. With scripts, I can change one line and in one step. Whatever I want, I can do. I don't need to be an expert to use it."
"The easy of use and ease of integration of Worksoft Certify are very good."
"During our yearly upgrades, we have now gotten them down to ten days or less. We have Worksoft run all our integration tests, where it used to take probably six weeks to do that manually."
"Improvement means for us that we have to be better in quality. Due to automation, you can run every automated test case twice a week. If you do it manually, you do it once per release. This is a quality improvement."
"We found that Worksoft is easier to use because our business experts can do the tests. We didn't have to have IT experts."
"The most valuable feature is having a no-code solution for automation, so our QA team and some of our business users can work on automation. Then, they don't have to be developers."
"With Worksoft, we have been able to automate six of our smoke tests in four months."
"We were able to use Worksoft to automate all of the actions that we would have to take after an SAP refresh. This way we do the refresh, then that night or right afterwards, we run the Worksoft script and it resets all of our testing users. This sets them up with the right access, the right approvals, and just sets up everything on the back-end so we can do our scripts the next night."
"The most valuable feature is the ability to create code from a flow chart, and then run the code through it."
"The solution is based on a Windows model, where adding users is just a few clicks. It is easy to manage users and add them."
"The most valuable features would be the image recognition and the OCR."
"It has helped teams within our organization become more aware of the testing requirements in terms of risk and priority."
"The solution is script-less, so you don't need IT knowledge to use the solution in an operational way. This is the most valuable feature. It's also only one of two or three tools that can do good automation on SAP, and in my opinion, it's the best of those."
"The Model-Based Test Automation is the most valuable feature, where you can create reusable components. Even though we are using a scriptless automation tool, there still needs to be an understanding of how to create reusable components and how to keep refactoring and how to keep regression, the test scripts, at an okay level. We are coupling Tosca with some other risk-based testing tools, as well, but automation is primarily what we're using Tosca for, the scriptless, model-based technology which is driving automation for us."
"This solution is easy to use for everybody, including those who are not IT-educated."
"Tosca BI is important to make sure that our data integrity is in check and validated; to make sure our data is good. Our data is the number-one important driver for our company, so if that's not good, we have some big problems."
"We like the fact that it works across mobile, desktop, web, and APIs. Due to this, the solution has a broad range of applications."
"This tool is very easy to use and I think that anyone can come in, having no experience with it, and within four to six months be comfortable with it."
"The feature that I have found the most valuable is the recovery and cleanup process. Suppose there is a list of test cases and one test case has failed, it should not impact the other test cases. We can reuse the same test case. We can change the configuration of parameters and then use the test cases on the same thing. So, that's a useful thing. Otherwise, we have to use the cleanup process. Another useful feature is to have our own library files. We can create our objects in the libraries and reuse them. There is no need to create duplicate data for that. They have been giving some enhancements recently which means integration is also there. They've integrated with different software like Jenkins, Bamboo. So, we can also create pipeline points. They have recently given SAP and everything, which is very useful."
"I would like to see the impact analysis integrated with the performance testing tool. We have multiple tools doing multiple items. I would like to have one common tool."
"We are looking for some enhancements on the Capture 2.0 tool. This would give us the ability to control it directly, like we could with Capture 1.0. Right now, Capture 2.0 doesn't really work for our Business Analysts."
"There was a change to Capture 2.0. In the end, there have been some challenges with the newer version. Therefore, the company testers, the local ones, do not want to use Capture 2.0."
"When it is unstable, there will be times when a test that we are running in Certify will just stop, and it will say, "Aborted." There will be errors. There will be no explanation as to why it happens. It has now happened maybe one out of 20 times. When it happens, I just tell our QA team to stop Certify and restart it, hoping we don't see it again."
"For the couple of the issues that we were really scratching our heads over, we were in communication with the technical support several times, but they never got back to us."
"We ran into some issues with the version that we were on during the initial setup. We ran into a bug on one version, then they upgraded us to a new version, and we got hit with another bug. So, they had to put us in a beta. That was a little frustrating. However, besides the bugs that we ran into, the install was pretty straightforward."
"The product had some UI issues."
"We have had run ins with some bugs on Business Process Procedure (BPP) and Execution Manager."
"We found that we had issues regarding the VPN setup, which is one of the reasons that we did not purchase this solution."
"The reporting function is a bit shallow. The solution does not offer very comprehensive reporting in terms of your test results. The reporting time and the logs are very high level as well. These areas need improvement."
"In terms of additional features, it would be helpful to have one package for all testing. You have the manager, the AI, then you have functional, and about 10 different packages for installing."
"Not being able to mask test data in relation to testing data management, in my opinion, is also a limitation."
"The solution should work with the Linux platform. Right now, it only runs on Windows."
"There have been some setbacks because of upgrades. While Tosca has been around for a while, Tricentis has catered to smaller clients and I don't think they have done such a large, at-scale transition or transformation before or worked with a company like ours, which is doing an enterprise-wide transformation. When we go to their customer advisory-board meetings, upgrades have been an issue. They have been working a lot to make upgrades seamless."
"I would like to be able to manage different projects in one repository or have better data exchange between repositories."
"The main area where there is room for improvement is how they do upgrades. Going through this current upgrade, we were delayed a month because we are using a third-party tool. It's called Tosca Connect by Tasktop. When this latest upgrade broke that relationship between the two, it took Tricentis a month to come back with a workable solution... Their whole upgrade process needs to be better and cleaner, from an end-user standpoint."
"The solution needs to improve its simulation of mobile environments. Right now, that aspect is really lacking."
"I would like to see better integration with other testing tools."
"It would be of great help if they can fix the loading or performance issues. Sometimes, when I create the test case folder and test cases, it feels like it has loading or performance issues. When passing the objects, we can't sometimes find the exact element. We need to find out that exact location and just give the path for that, and then it works. In the pipeline, when creating Jenkins, we create the list execution for passing the execution list to the commander. I feel it is a bit late, by a fraction of seconds. I first thought it could be my mistake or a setting issue, but I worked on that, and it's not a mistake or a setting issue."
"By using automation, it reduced about 75 percent of the time when compared to any other tool."
"Saving money and better quality, these are the benefits of Certify."
"I think they came out with a different type of licensing specifically for testing. Therefore, you don't have to use a more expensive user license, you can use an automation license. So potentially, if we had 100 use cases, we could spin up a 100 different machines, have them all run and be done in five minutes. That would be the goal, but I don't know if that would actually succeed or not."
"This solution has enabled us to automate in order to tremendously save time. Only first time when you are recording and creating the script will you spend some time with it, the rest of the time, you are just executing."
"If we do one manual process, it could take approximately two hours. The same process using Worksoft probably takes ten minutes."
"We have seen ROI by being able to free up and give time back to the business for other value-added work."
"On our last big SAP implementation project, we inserted an automation resource into the beginning of the project. Between automating regression processes, data staging, and using our automation to help repair cutover and conversion issues. We saved the project about $1,700,000."
"Worksoft has paid for itself fives times over."
"Tricentis Tosca may be relatively on the higher side in terms of pricing, but their sales rep can give pretty decent deals when asked."
"We have around 200 [concurrent] licenses and the cost around $1.4 million a year."
"I am satisfied with the cost."
"My understanding is that it's an expensive product, although I don't know the specifics with regards to pricing."
"I would like to see better costing packs. There are several features but USD $11,000 for one license is expensive."
Earn 20 points
Tricentis Tosca specializes in enabling large enterprises to improve the quality of their applications by equipping them to optimize, manage, and automate their software testing.
Tosca's model-based approach to software test automation enables enterprises to achieve high automation rates while maximizing business risk coverage.
Tricentis Tosca also provides market-leading test case design and planning capabilities, test data provisioning, service virtualization, mobile testing, and more.
Tosca is fully compatible with other testing solutions and Application Lifecycle Management products. Tricentis also offers uniquely designed testing solutions for SAP, ServiceNow, Trax, Avaloq, and Oracle.
Eggplant Functional is ranked 18th in Functional Testing Tools with 3 reviews while Tricentis Tosca is ranked 1st in Regression Testing Tools with 12 reviews. Eggplant Functional is rated 7.4, while Tricentis Tosca is rated 8.6. The top reviewer of Eggplant Functional writes "Enables you to insert all the various elements into the repository and then run your tests". On the other hand, the top reviewer of Tricentis Tosca writes "Having a regression suite that we can run gives us a high level of confidence in the changes we are making". Eggplant Functional is most compared with Selenium HQ, SmartBear TestComplete, Micro Focus UFT One, froglogic Squish and Automation Anywhere (AA), whereas Tricentis Tosca is most compared with Micro Focus UFT One, SmartBear TestComplete, Selenium HQ, Tricentis qTest and Ranorex Studio. See our Eggplant Functional vs. Tricentis Tosca report.
We monitor all Regression Testing Tools reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.