it_user289665 - PeerSpot reviewer
Technical Tester at a tech services company with 501-1,000 employees
Consultant
Tbox automates complex test scenarios and it's helped us keep track of test execution and coverage.

What is most valuable?

I mostly use the TOSCA Commander to create test cases. I also utilize the Tbox feature to automate complex test scenarios. Lastly, I find the requirements linking very useful in analysis after a release (i.e. test coverage, etc.).

How has it helped my organization?

The product is very useful in keeping track of test execution and coverage. This is because it has a feature called Execution List which shows resources and the test cases they have executed. There is also a tab for Requirements where the test cases can be linked.

So, by combining those two together, you will be able to see which test cases are mapped to requirements, and if they have been executed. You will also see the number of passed and failed test cases. It is very easy to use once you know all the features. It barely crashes and recovers gracefully most of the time.

What needs improvement?

The product, at times, does not recognize objects, especially in web applications. It would be good to have that fixed in the next version. As a work around, you have to use the feature called TBox which allows you to scan complex objects.

For how long have I used the solution?

I have been using it for more than six months.

Buyer's Guide
Tricentis Tosca
April 2024
Learn what your peers think about Tricentis Tosca. Get advice and tips from experienced pros sharing their opinions. Updated: April 2024.
771,157 professionals have used our research since 2012.

What was my experience with deployment of the solution?

No issues encountered.

What do I think about the stability of the solution?

No issues encountered.

What do I think about the scalability of the solution?

No issues encountered.

How was the initial setup?

The initial setup was hassle free. Although, it would be great if the documentation for the initial set up would include more screenshots and a troubleshooting section.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
it_user10791 - PeerSpot reviewer
it_user10791Senior Manager of QA at a tech services company with 501-1,000 employees
Consultant

TBox is not a workaround. It's alternative engine to classic HTML engine.
Per my experience problems with Web automation are related with use of correct locators (IDs) and correct steering. Sometimes applications themselves are not automation friendly

it_user909723 - PeerSpot reviewer
Project Manager at a logistics company with 5,001-10,000 employees
Real User
It makes test cases which can be used by technical and business people
Pros and Cons
  • "Compared to other tools we have been looking at, you don't have to be a programmer to operate it, though it helps. It also a product that can be used by business people."
  • "We are satisfied with the support of Tricentis."
  • "Setup wasn't that straightforward; it was more complex. It all depends on the environment, because there were a lot of errors on our applications. Therefore, it wasn't an easy setup for us."
  • "It needs better integration with JIRA."
  • "I would like a better user interface."

What is our primary use case?

For our applications, it makes the test cases. So far, we have been quite happy with it. So, we don't have any complaints.

How has it helped my organization?

We build the test cases, then we just need run it by one person to get feedback right away. Otherwise, it would require planning with certain testers.

What is most valuable?

Compared to other tools we have been looking at, you don't have to be a programmer to operate it, though it helps. It also a product that can be used by business people.

What needs improvement?

  • It needs better integration with JIRA.
  • I would like a better user interface.

For how long have I used the solution?

One to three years.

What do I think about the stability of the solution?

It is stable.

What do I think about the scalability of the solution?

It is scalable.

How is customer service and technical support?

We are satisfied with the support of Tricentis so far.

How was the initial setup?

Setup wasn't that straightforward; it was more complex. It all depends on the environment, because there were a lot of errors on our applications. Therefore, it wasn't an easy setup for us. 

It took time to begin setting up for the first time because it's not a regular setup. It took us a week to set up.

What's my experience with pricing, setup cost, and licensing?

We hired a consultant to figure out all the tools in our company and how they fit in our company before we purchased the solution.

Which other solutions did I evaluate?

We also evaluated HPE, IBM Rational Functional Tester, and Ranorex. However, for us, Tosca was the perfect choice.

What other advice do I have?

Figure out your requirements and environment.

We had the impression Tosca would be the perfect fit for us. We did a proof of concept test with all our applications, Tosca was able to work with them and drive the proof of concept goal. Finally, we made a decision a year ago to work with Tricentis Tosca. We are quite happy with the product. 

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Buyer's Guide
Tricentis Tosca
April 2024
Learn what your peers think about Tricentis Tosca. Get advice and tips from experienced pros sharing their opinions. Updated: April 2024.
771,157 professionals have used our research since 2012.
PeerSpot user
Senior Manager of QA at a tech services company with 501-1,000 employees
Consultant
Very rich automation/test management framework but consider the coding needed to integrate with your application

Recently, I was asked a set of questions regarding my experience with TOSCA. Here are the questions and my answers:


General info:

Is there any need for coding or scripting? Based on my research, I expect that the module is created when scanning has been finished. But some users commented that coding or scripting is needed.

- Depends on the application and technology you are trying to automate. TOSCA has a lot of engines (HTML, .NET, Java, Webservices, etc.) with control library's that can be used out of the box. For something that is not covered by these engines (like a custom java widget) you will need to code for steering.

Are control statements like if/then/else and loops supported?

- Loops are not directly supported. If/then/else are supported for templates (data driven test cases).

Test case organization:

Is it possible to group test steps and according to our needs include/exclude particular test groups?

- Yes

Is it possible to rearrange test steps once they are created?

- Yes

Is it possible to perform multiple execution for test steps and test groups?

- Yes

Is there a possibility to create some variables whose values can be adjusted in some of the test steps?

- Yes. In TOSCA variables are called "buffers"

Is possible to add references in a test to some other test?

- It's possible to organize test steps in the library and reuse them in TC's. For other kinds of references you are free to create custom fields (to store path to other TC for example).

Is it possible to modify verdicts, for example, if a test fails that is declared as passed?

- Yes

Is a test progress view supported? Is it possible to stop/start a test on an error or some other event?

- Yes. You can define different behavior on an error (for example requesting a manual action to continue).

Is it possible to schedule tests? This is useful to have when night runs are executed

- You can trigger TOSCA execution using the TOSCA API from cmd line using windows scheduled jobs.

When some test step fails in some test group, how is that reflected to the corresponding test group? Does the parent test group also fail?

- The parent test groups are organized as "Business execution lists". If one TC fails, Business execution list will also fail.

Logging:

Is it possible to filter results?

- Yes

How is logged data is stored?

- Execution results stored in a TOSCA repository (local or shared (DB))

Is it possible to export logs/results?

- Yes. You can print repository content to various formats (excel, PDF, jpg, etc.)

Other:

How does TOSCA work with the command line?

- The TOSCA API offers all operations in the cmd as the TOSCA Commander shell. Run TC's, Create TC's, print report, everything...

Is it possible to configure test speed? For example, to insert some delay when GUI is slow.

- Yes, there are multiple settings and options to play with the speed.

Is there any possibility to explore a linux system with TOSCA? Maybe via putty or WinSCP?

- I don't have experience with TOSCA and LInux. Theoretically TOSCA can run external applications. We have created integration of TOSCA and JUnit tests for our needs.

When a test is created on one system, can it be easily transferred to another system? For example, when I create a test, I want to deliver it to another colleague who is working on another machine. Or does he have to create it on his own machine?

- You can use multi-user repository, which has checkin/checkout operations like SVN or CVS. You can also export your TC's or other TOSCA objects to file and import to other local/shared repository.

In the end, what is your opinion/experience about TOSCA?

- Overall impression about TOSCA is quite positive - it's a very rich automation/test management framework. In the right hands it can be used for creation of a really powerful and complex solution. There are many more features that are useful for automation but there can really be a need for some coding effort to integrate with your application - this needs to be considered.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
it_user10791 - PeerSpot reviewer
it_user10791Senior Manager of QA at a tech services company with 501-1,000 employees
Consultant

My review was done for the older version of TOSCA.
Currently we work with version 8.4.0 and this tool has advanced a lot.
Tricentis added many useful features and TOSCA has become once of most mature automation tools I worked with.
If/then/else and loops supported, plugin for Continuous Integration exists now, JUnit test results can be imported into TOSCA, test data service allows to setup distributed execution, etc.

See all 4 comments
it_user694683 - PeerSpot reviewer
Senior Automation Consultant at a tech services company with 201-500 employees
Consultant
Reporting is well managed and there is no requirement to build a framework around it.
Pros and Cons
  • "This tool has test data management capability along with test management."
  • "ScratchBook execution needs to be improved as Tosca crashes multiple times."

What is most valuable?

Tosca is a model based component tool and also quite flexible in terms of the customization required for most of the applications, if objects are not recognized. It allows manual testers to pick up automation, because it is a scriptless tool. Reporting is well managed within Tosca and there is no requirement to build a framework around it.

How has it helped my organization?

We are only using Tosca for our test automation. It helps the business testers to get involved and be a part of automation. It helps us define the right coverage by defining the scope in the test case design section. This tool has test data management capability along with test management.

What needs improvement?

  • Objects re-scanning (recognizing the objects again)
  • Providing features to highlight the objects
  • The user guide/help document needs to be improved for better understanding of the tool and its features.
  • ScratchBook execution needs to be improved as Tosca crashes multiple times.

For how long have I used the solution?

I have been using Tosca for the past two years.

What do I think about the stability of the solution?

If the Tosca repository becomes huge in size, then you might face performance issues. Tosca crashes many times and the best practice is to keep saving your work frequently to avoid re-work.

What do I think about the scalability of the solution?

There were no scalability issues.

How are customer service and technical support?

Technical support is available via chat or by raising an incident. They are often able to resolve minor issues. It takes really long to resolve major issues and we have to wait for them.

Which solution did I use previously and why did I switch?

I have been working on different test automation tools and I was introduced to Tosca because of the technology that it supported for our applications. The current test automation tool was unable to provide a solution for our .NET Windows-based application, which Tosca provided out-of-the-box.

How was the initial setup?

The initial setup was not very complex. The Tricentis team provided support in terms of setting up the project and assisting during the initial days to get us used to the tool.

What's my experience with pricing, setup cost, and licensing?

It is an expensive tool compared to other test automation tools. It has a lot of advantages over other tools. They provide different types of licensing like cloud, Node locked, and floating licenses.

Which other solutions did I evaluate?

We did Proof of Concept with other automation tools, such as UFT and TestPartner, but we found Tosca to be a better tool.

What other advice do I have?

I would definitely recommend this tool. It is user friendly, once you get used to it, and it is easy to implement. You might have to struggle initially to understand Tosca and its approach.

Disclosure: My company has a business relationship with this vendor other than being a customer: Yes, our company has a business relationship and is an Partner of Tosca wherein the employees of our company get different benefits like free certifications, free trial licenses for training purposes.
PeerSpot user
PeerSpot user
QA Expert at a tech services company with 51-200 employees
Consultant
Top 5
Good Visual representation, easy to understand and comfortable to implement business ideas

I have used TOSCA for R&D only,. not any real client project.

TOSCA is very good for

  • Business requirement based test case not complex test scenarios
  • Good Visual representation, easy to understand and comfortable to implement business ideas.
  • Can cover only user validations. (you can not satisfy all possible complex scenarios and requirements)
  • It is a good test case building tool for managers or business personnel not for a core QA person. So, if you are targeting for Technical QA career, it might not help that much. But, if you are on to business area, team lead who manage clients with requirements, it is very good tool for you.
  • In market, it is not that much popular, so you may not get many jobs that need TOSCA
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
it_user4401 - PeerSpot reviewer
it_user4401Developer at a transportation company with 1,001-5,000 employees
Vendor

I started using the trial version of TOSCA Testsuite to get a first look at this software. I was impressed by the way how easy it is to create and execute test cases. I noticed that non-programmers can write test cases (no scripting required). This can be a con for testers because there are no loop statements and each test should be repeated many times. I also noticed that many adapters are supported out of the box, TOSCA Testsuite is fast, easy and intuitive to use and it has professional support.

Senior Test Engineer at a tech services company with 51-200 employees
MSP
Helpful technical support, simple installation, but performance could improve
Pros and Cons
  • "The solution has plenty of features compared to other solutions."
  • "Tricentis Tosca's performance could be better. Sometimes when we are remapping or when it is loading it can take a lot of time. There are free solutions that have better performance in this area."

What is our primary use case?

Our whole team that is working on Tricentis Tosca has done training to receive certifications in automation engineering and test design.

Tricentis Tosca can be used for software testing with automation.

What is most valuable?

The solution has plenty of features compared to other solutions.

What needs improvement?

Tricentis Tosca's performance could be better. Sometimes when we are remapping or when it is loading it can take a lot of time. There are free solutions that have better performance in this area.

For how long have I used the solution?

I have been using Tricentis Tosca within the last 12 months.

How are customer service and technical support?

The technical support of Tricentis Tosca is good. They have been helpful and resolved our problem.

How was the initial setup?

The installation was straightforward.

Which other solutions did I evaluate?

I have evaluated other solutions.

What other advice do I have?

I would recommend this solution to others. It has the capability of doing many types of tests.

I rate Tricentis Tosca a seven out of ten.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
PeerSpot user
SAP TAX COE at a tech company with 10,001+ employees
Real User
The Risk Management feature is one we are seeing as very valuable in our environment.

Valuable Features

While we started implementation with a focus on testing automation, the Risk Management feature is one we are seeing as very valuable in our environment, allowing us to better focus on critical testing.

Improvements to My Organization

It has allowed us to have a highly reusable Regression Test suite. We have already been able to run it for an SAP upgrade and plan on using it on a regular basis (weekly) going forward.

Room for Improvement

The record and play is still a new feature and while SAP has been added to the latest version, it is still lacking usefulness for common repository setups.

Use of Solution

We've been using it for about 8 months

Deployment Issues

We've had no issues with deployment.

Stability Issues

We've had no issues with stability.

Scalability Issues

We've had no issues with scalability.

Customer Service and Technical Support

Customer Service:

We have had great customer service so far. Support has been responsive and helpful.

Technical Support:

Technical support has been pretty responsive so far. They have provided solutions to most of our challenges and provide work arounds when no solutions were available.

Other Advice

The tool is very different than other testing tools and it is important to explain some of these different to all the stakeholders to ensure they really understand the benefits at their level.

By that I mean that a tester might see benefit in the ease of automation but a business user will see benefit in the risk coverage visualization, for example.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
it_user712053 - PeerSpot reviewer
QA Test Lead at a tech services company with 10,001+ employees
Real User
Some of the valuable features are test case design and web services automation

What is most valuable?

  • Test case design: Integrated test data management in the tool itself
  • Web services automation: Easier API testing
  • DevOps: Testing starts as soon as development gets completed
  • Service Virtualization: Early automation

How has it helped my organization?

It is quick and easy to maintain automation with Agile implementation.

What needs improvement?

I would like to see defect raising and tracking.

For how long have I used the solution?

I've used it for almost a year.

What do I think about the stability of the solution?

There were sometimes issues with stability.

What do I think about the scalability of the solution?

There were sometimes issues with scalability.

How are customer service and technical support?

Technical support is very good.

Which solution did I use previously and why did I switch?

We switched as there is no scripting required. The framework is inbuilt, hence maintenance is easier.

How was the initial setup?

The setup was straightforward.

What's my experience with pricing, setup cost, and licensing?

Licenses are expensive, but they are worth using.

What other advice do I have?

Go for the product if you are looking for faster automation.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Buyer's Guide
Download our free Tricentis Tosca Report and get advice and tips from experienced pros sharing their opinions.
Updated: April 2024
Buyer's Guide
Download our free Tricentis Tosca Report and get advice and tips from experienced pros sharing their opinions.