What is our primary use case?
We are a small product team and we do software development. I'm part of the testing team and I use Azure DevOps to manage all of my test activities. This includes my test plan, where I create my test cases, write test scripts, execute them, and publish the results using the dashboards.
What is most valuable?
I like a lot of the features in Azure DevOps.
The creation of test plans is valuable and I like the reporting features that it offers. For example, I like the charts, as well as reporting progress.
The interface is user-friendly.
What needs improvement?
I have not been able to use the integration with automation features, such as test management automation, with a framework that is written in Java. Currently, Azure offers frameworks that are written in C#. I have not found anything in the Microsoft documentation to say that it supports other languages.
For how long have I used the solution?
I have been using Microsoft Azure DevOps for approximately two years.
What do I think about the stability of the solution?
Being a SaaS product, sometimes we experience hangs. However, that is okay because in general, it is very much stable. If there are any outages then I get prior notification of such events.
What do I think about the scalability of the solution?
I have not tried scaling it. In my team, we have approximately 30 people who are using it.
How are customer service and technical support?
For me, the first point of contact is my internal organization and not Microsoft directly. However, if there are any changes that require Microsoft's intervention then there is an intermediate team who coordinates it. The response has been pretty good and I am happy with the support.
Which solution did I use previously and why did I switch?
I have used several tools in the past including Zephyr and the Rational Quality Manager.
How was the initial setup?
The initial setup is pretty straightforward. We needed to set up a Microsoft account, and that gives access to the projects. Basically, the IT department or IT administrators take care of the access.
As a member of the team, once access is provided, I can just start using it. It is plug-and-play, as far as I'm concerned.
What's my experience with pricing, setup cost, and licensing?
It is a subscription model and I only pay for what I use.
Which other solutions did I evaluate?
Very recently, I was doing comparative studies of available test management solutions on the market and I find Azure DevOps to be pretty good.
What other advice do I have?
Overall, this is a good product and I recommend it.
I would rate this solution an eight out of ten.
Which deployment model are you using for this solution?
If public cloud, private cloud, or hybrid cloud, which cloud provider do you use?