How has it helped my organization?
It allows you to have a bunch of manual testers who can easily use the tool set, as well as hardcore devs or SDETs who know how to code. They can also use the tool set.
And, on the virtualization side, it really kind of helps you save money, because you can unblock yourself. If something's not ready, you can go and virtualize that, unblock your automation. We actually found in the last project that we should have used more virtualization, because our environment wasn't really stable. And so, we should have virtualized the things that we were automating so that we could demonstrate the automation wasn't the problem. That was always a question mark for people, and so that's a takeaway that I'll do again on the next project.
What is most valuable?
A couple of the most valuable features, to me, are the fact that you can have a lot of different people with different technologies use the tool, without any programming experience at all, all the way up to people who can program. And then, the more technical that you are, the more programming you have, the more you're able to customize the tool. Basically customize it to do what you want it to do. That's one thing.
The other thing is, it's got probably the greatest amount of features, in terms of different technologies that you can automate and virtualize, out of any of the solutions out there. So, it really can accomplish any task that you want to do with it.
What needs improvement?
I really want to see more of the "express" kind of model, where you get a little bit for free. I'd love to be able to see you be able to edit and author tests without having to be connected to a licensed server. And then, if you want to go and execute tests, then you go and connect to the server. That's a request I've been making, and I'd like to see that. I think it's in line with the open source model, and I think it would unblock people to be able to do a lot more work from home or from remote places, where they can't really connect to the server.
What do I think about the stability of the solution?
It's very stable. It's very robust.
I have noticed that sometimes memory consumption can get high if you use the tool repeatedly. But, it's pretty manageable. It's come a long way. I've used it for multiple versions, and I'm on version 10 now, and I'm very happy with the stability.
What do I think about the scalability of the solution?
It's very scalable. The server, we've actually scaled it up quite a bit. One of the projects I was on, we were running thousands of tests, and the server wasn't really set up to handle that. So, we increased the amount of coordinators, and RAM, and processing power. And, just by making those small changes, we were easily able to scale to, like, thousands and thousands of tests. I'm happy with the scalability.
Which solutions did we use previously?
I wasn't using any previous solution. When I came to T-Mobile, SV was a fairly new tool at T-Mobile. So, we didn't have any other previous solution. We used this one, and none of the other solutions that have been out there have been better, so we've kept using it. Didn't need to switch, and we have been continuing to invest in it, because it's been meeting and exceeding our needs.
What other advice do I have?
I give it between an eight and a nine out of 10. I don't ever really give 10s, because I always think that things can be improved, so it's a great product.
Disclosure: IT Central Station contacted the reviewer to collect the review and to validate authenticity. The reviewer was referred by the vendor, but the review is not subject to editing or approval by the vendor.
Jan 11 2018