What is most valuable?
Image recognition: It has allowed us to automate a GUI section of our product which involves drawing different topologies.
I’m aware that other tools have this feature, but the whole test suite, it makes it good enough for us not to look for something else.
How has it helped my organization?
No, not in global organization; we are the only ones who are using it in our location (Austria), but in our team, it changed the testing workflow:
Every second week we release a candidate, and from two weeks of hard manual testing, we are testing now only a few days (four to five), the new fixed tickets and running in parallel - the regression. We have more time to increase the regression portfolio and also decrease long delays with documentation.
What needs improvement?
Running the regression – if multiple lists are executed at once or if a list contains 200+ tests, it’s a pain to stop the execution.
For how long have I used the solution?
I have been using it for almost four years.
What do I think about the stability of the solution?
A few times, it just crashed. I didn’t encounter this issue with Tosca 8 and Tosca 9, but the PC was running for days so I cannot blame only Tosca. I assume Windows played its role, too.
What do I think about the scalability of the solution?
No, not so far. We have around 3500+ TCS.
How is customer service and technical support?
Nice and friendly, however not always coming up with the solution we were expecting. For example, after changing from Tosca 9 to Tosca 10, we were not able to run some test cases for an older tool (it was developed with Java 1.5). The solution from their side was to request a change request even if it worked in the past. In the end, we just downgraded and we are running those test cases with Tosca 9.
Which solutions did we use previously?
How was the initial setup?
Of the tool, yes. Managing to trigger our application was not so straightforward (because of our company access policy). We had to write some batch scripts for it, then it worked fine.
What's my experience with pricing, setup cost, and licensing?
Expensive, but for long-term projects, it is paying back.
Which other solutions did I evaluate?
Yes, there was an analysis, but I was not part of the company at that time.
What other advice do I have?
It is a good tool, but could be better in some aspects.
It’s relatively easy to set it up and intuitive to create test cases for non-developers. If you come from the development side you will feel some limitations, but I was always able to find a workaround.
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Sep 03 2017