SDET at a consultancy with 1,001-5,000 employees
Real User
Ability to run tests and has automation tools but integration process could be improved
Pros and Cons
  • "The most valuable feature is that we can run integrations with DevOps. From a QA perspective and a testing perspective, we can run those tests and integrate automation tools. Then we can run those tests as part of the deployment process. Every time we are deploying something, it automatically runs all the tests."
  • "Something that could be improved is the initial setup with the integration of ReadyAPI."

What is our primary use case?

Our only use case with DevOps was for integration with ReadyAPI.

What is most valuable?

The most valuable feature is that we can run integrations with DevOps. From a QA perspective and a testing perspective, we can run those tests and integrate automation tools. Then we can run those tests as part of the deployment process. Every time we are deploying something, it automatically runs all the tests.

What needs improvement?

Something that could be improved is the initial setup with the integration of ReadyAPI.

For how long have I used the solution?

I used this solution for six months.

Buyer's Guide
Microsoft Azure DevOps
April 2024
Learn what your peers think about Microsoft Azure DevOps. Get advice and tips from experienced pros sharing their opinions. Updated: April 2024.
768,857 professionals have used our research since 2012.

What do I think about the stability of the solution?

Stability is fine. I was getting some errors, but that was due to my side of things.

What do I think about the scalability of the solution?

Scalability is fine.

How was the initial setup?

I would rate this solution 6 out of 10.

I did have some issues due to our organization, but it would be different for everyone. My advice is to reach out to support if you have any problems.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Process Manager at a marketing services firm with 501-1,000 employees
Real User
User-friendly, good performance, has good support, and connects well with PowerBI
Pros and Cons
  • "We are able to generate many different types of reports from Azure."
  • "There are certain features, and reporting that can only be used in PowerBI, but not directly in DevOps."

What is our primary use case?

We use this solution for project management and delivery.

What is most valuable?

It is easy to use.

We are able to generate many different types of reports from Azure. It connects well to PowerBI. 

The performance is good.

What needs improvement?

They could have more reporting features added to the dashboard. There are certain features, and reporting that can only be used in PowerBI, but not directly in DevOps. 

We would like to have the same calculated reports that can be accessed in PowerBI, available in Microsoft Azure DevOps. 

For how long have I used the solution?

We have been using Microsoft Azure DevOps for the last two and a half years.

What do I think about the stability of the solution?

Microsoft Azure DevOps is a stable product.

What do I think about the scalability of the solution?

It is easy to scale. We have approximately 250 employees in our organization who use this solution.

How are customer service and technical support?

We have contacted technical support. They provided us with a fast resolution.

Which solution did I use previously and why did I switch?

We are using Azure, and TFS now. We are also planning to migrate to AWS as well.

How was the initial setup?

The installation was easy.

We have an IT team of four to manage and deploy this solution.

What other advice do I have?

I would definitely recommend this solution to others who are interested in using it.

I would rate Microsoft Azure DevOps an eight out of ten.

Which deployment model are you using for this solution?

Public Cloud
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Buyer's Guide
Microsoft Azure DevOps
April 2024
Learn what your peers think about Microsoft Azure DevOps. Get advice and tips from experienced pros sharing their opinions. Updated: April 2024.
768,857 professionals have used our research since 2012.
Senior Software Engineer at Xylem
Real User
Top 20
Stable, straightforward to set up and easy to use
Pros and Cons
  • "The installation is very straightforward."
  • "The price could be lowered. It would be nice if it was cheaper."

What is our primary use case?

Currently, we are using it for the continuous integration and continuous deployment of the CI/CD pipeline available for our projects.

What is most valuable?

The solution is very useful.

It's very easy to use and easy to navigate. It's a simple product to navigate.

The product is very stable; it's being used by quite a few organizations. We find it quite reliable.

The scalability, for now, is good for what we need. 

The installation is very straightforward.

What needs improvement?

We haven't had too much time to really play with the solution and therefore it's difficult to really know if there's anything missing in terms of features. We need more time with it.

The price could be lowered. It would be nice if it was cheaper.

For how long have I used the solution?

I started using the solution a few months ago. It's been about a year or so. We have not used the product for that long just yet.

What do I think about the stability of the solution?

The product is quite stable. There are no bugs or glitches. It doesn't crash or freeze. It's quite reliable in terms of performance. 

What do I think about the scalability of the solution?

The solution is scalable, at least for our purposes. We haven't run into any issues.

We have about 1,000 users on the solution currently.

How are customer service and technical support?

The forums that are available to users are quite helpful and have a lot of information. It helps us troubleshoot very well. We don't usually call anyone directly.

Which solution did I use previously and why did I switch?

We did not use a different solution before using this product.

How was the initial setup?

The product is very straightforward to set up. 

The deployment is fast as well. It only took us about 10 to 15 minutes to have everything up and running. 

What about the implementation team?

I handled the installation myself. I did not need the assistance of a consultant or integrator. It was handled in-house.

What's my experience with pricing, setup cost, and licensing?

It would be nice if the licensing was a bit cheaper.

Our IT team looks after that aspect. I don't deal with tasks such as licensing and payments directly.

Which other solutions did I evaluate?

We did not evaluate other solutions before deciding on this product.

What other advice do I have?

I'd rate the solution at an eight out of ten. So far, we've been very pleased with its capabilities.

Which deployment model are you using for this solution?

Public Cloud
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Senior Consultant at CMEx
Consultant
User-friendly with good reporting features assist with managing my test plans, and the support is responsive
Pros and Cons
  • "The creation of test plans is valuable and I like the reporting features."
  • "I have not been able to use the integration with automation features, such as test management automation, with a framework that is written in Java."

What is our primary use case?

We are a small product team and we do software development. I'm part of the testing team and I use Azure DevOps to manage all of my test activities. This includes my test plan, where I create my test cases, write test scripts, execute them, and publish the results using the dashboards.

What is most valuable?

I like a lot of the features in Azure DevOps.

The creation of test plans is valuable and I like the reporting features that it offers. For example, I like the charts, as well as reporting progress.

The interface is user-friendly.

What needs improvement?

I have not been able to use the integration with automation features, such as test management automation, with a framework that is written in Java. Currently, Azure offers frameworks that are written in C#. I have not found anything in the Microsoft documentation to say that it supports other languages.

For how long have I used the solution?

I have been using Microsoft Azure DevOps for approximately two years.

What do I think about the stability of the solution?

Being a SaaS product, sometimes we experience hangs. However, that is okay because in general, it is very much stable. If there are any outages then I get prior notification of such events.

What do I think about the scalability of the solution?

I have not tried scaling it. In my team, we have approximately 30 people who are using it.

How are customer service and technical support?

For me, the first point of contact is my internal organization and not Microsoft directly. However, if there are any changes that require Microsoft's intervention then there is an intermediate team who coordinates it. The response has been pretty good and I am happy with the support.

Which solution did I use previously and why did I switch?

I have used several tools in the past including Zephyr and the Rational Quality Manager.

How was the initial setup?

The initial setup is pretty straightforward. We needed to set up a Microsoft account, and that gives access to the projects. Basically, the IT department or IT administrators take care of the access.

As a member of the team, once access is provided, I can just start using it. It is plug-and-play, as far as I'm concerned.

What's my experience with pricing, setup cost, and licensing?

It is a subscription model and I only pay for what I use.

Which other solutions did I evaluate?

Very recently, I was doing comparative studies of available test management solutions on the market and I find Azure DevOps to be pretty good.

What other advice do I have?

Overall, this is a good product and I recommend it.

I would rate this solution an eight out of ten.

Which deployment model are you using for this solution?

Public Cloud

If public cloud, private cloud, or hybrid cloud, which cloud provider do you use?

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
XBRL Specialist at a financial services firm with 1,001-5,000 employees
Real User
Very stable and provides a nice and integrated environment for working in teams and implementing the DevOps philosophy
Pros and Cons
  • "It is easy to use. The shared repository is useful. Everything is in one environment."
  • "It is not that intuitive. Sometimes, it is hard to find some of the functions. I would like to have an old-fashioned menu structure to be able to easily find things. Its environment setup is not very good. They should improve the way it is set up for different screens and make it easier to find functionalities and maintain team members."

What is our primary use case?

I am using it as a developer in the agile scrum area.

How has it helped my organization?

It has improved the team cooperation for building, developing, and releasing systems.

What is most valuable?

It is easy to use. The shared repository is useful. Everything is in one environment.

What needs improvement?

It is not that intuitive. Sometimes, it is hard to find some of the functions. I would like to have an old-fashioned menu structure to be able to easily find things. Its environment setup is not very good. They should improve the way it is set up for different screens and make it easier to find functionalities and maintain team members.

For how long have I used the solution?

I have been using this solution for one and a half years.

What do I think about the stability of the solution?

It is very stable. If it doesn't work, it is usually because of network issues.

How are customer service and technical support?

I didn't need support from Microsoft. Any need for support was internally fulfilled by my colleagues.

What other advice do I have?

I would recommend this solution. It is a nice environment for working in teams and implementing the DevOps philosophy. It provides good support for that.

I would rate Microsoft Azure DevOps an eight out of ten.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Lead Technical Consultant (Information Technology) at a construction company with 1,001-5,000 employees
Real User
Top 20
A stable, all-in-one solution that is easy to deploy, but some areas need to be improved
Pros and Cons
  • "I like the entire tool because it is a one-stop-solution for DevOps."
  • "There are certain areas in Azure DevOps that are better in other products."

What is our primary use case?

We are a manufacturing company and I am a technical consultant who is responsible for managing the software applications that are outsourced for development. In this role, I have gained experience using Microsoft Azure DevOps.

I have also used it as a software developer in companies that I previously worked for.

What is most valuable?

I like the entire tool because it is a one-stop-solution for DevOps.

The Scrum functionality in project management is helpful, as are the code repositories. It has support for pipelines.

What needs improvement?

There are certain areas in Azure DevOps that are better in other products. These are things that I need to more fully explore.

For how long have I used the solution?

I have been working with Azure DevOps for approximately four years.

What do I think about the stability of the solution?

The stability is good and I haven't had any issues with it.

What do I think about the scalability of the solution?

At this time, the majority of our software application development is outsourced so there is not much in terms of DevOps. However, in the future, I am planning to implement DevOps here. Once that happens, I expect that our usage of this solution will increase.

How are customer service and technical support?

I have not needed to contact Microsoft's technical support.

How was the initial setup?

The initial setup is straightforward and easy. It takes very little time to deploy.

What about the implementation team?

I deployed this solution without any help.

What other advice do I have?

Personally, I like this product and it is one that I recommend. That said, based on my experience, I cannot say that it is perfect.

I would rate this solution a seven out of ten.

Which deployment model are you using for this solution?

Public Cloud

If public cloud, private cloud, or hybrid cloud, which cloud provider do you use?

Microsoft Azure
Disclosure: My company has a business relationship with this vendor other than being a customer: Partner
PeerSpot user
PeerSpot user
Lead DevOps and Release Engineer-L2 at ITWORX
Real User
It's a matter of integration to have only one platform for all your software development life cycle

What is our primary use case?

  • Source code management
  • Git repository management including a visualizing for the pull requests process
  • Build automation
  • Continuous integration
  • Project management
  • Test management 
  • Release automation
  • Deployments automation
  • Artifacts management
  • Package management
  • Agile planning 
  • Dashboards and reports
  • Requirement management
  • Work estimation 
  • Capacity management
  • Backlogs and Kanban boards for different teams
  • Load test 
  • Integration test automation and unit test projects with status reports on the test results.

How has it helped my organization?

Azure DevOps helps us to implement all our DevOps practices with a complete end-to-end cycle starting from code commit till the production deployment including continuous feedback.

This enables us to release the silos between the teams and enhance collaboration. Also, it gives us more control on the project delivery lifecycle and to fix the issues more earlier than before as we are aligned and working on one integrated system which can give us reports about any piece of info.

What is most valuable?

  • Linking the project teamwork (bugs, tasks, user stories, test cases ) with the code, build, release, delivery
  • It's a matter of integration to have only one platform for all your software development life cycle.

What needs improvement?

  • Enable more control on Application Insights integration to open different types of work items as this is area still need more enhancements.
  • Test management extension is too high to be paid on a monthly basis.
  • Test and feedback chrome extension still need more development as they are not very stable.

For how long have I used the solution?

One to three years.
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Daniel Hall - PeerSpot reviewer
Daniel HallTechnical Architect at Dwr Cymru Welsh Water
Real User

I'd add that the reliability needs improving, there have been a few outages lately, had numerous issues where marketplace modules install but cannot be used and the live updates on running pipelines stop working. As it matures I can see it being a strong competitor

See all 3 comments
Chief Technical Officer
Real User
The platform visuals and workflow are straightforward
Pros and Cons
  • "We use all the DevOps features and services, like reports, Boards, Pipelines, Artifactory, etc. The interface is interactive and intuitive. The platform visuals and workflow are straightforward in Azure DevOps."

    What is most valuable?

    We use all the DevOps features and services, like reports, Boards, Pipelines, Artifactory, etc. The interface is interactive and intuitive. The platform visuals and workflow are straightforward in Azure DevOps.

    For how long have I used the solution?

    We've been using Azure DevOps for three years.

    What do I think about the stability of the solution?

    DevOps' stability is great. No problems.

    What do I think about the scalability of the solution?

    The infrastructure is good so far, and expanding our user base isn't a problem. Microsoft takes care of the infrastructure.

    What's my experience with pricing, setup cost, and licensing?

    We are billed for a single license, no matter how many users. 

    What other advice do I have?

    I rate Azure DevOps eight out of 10. 

    Which deployment model are you using for this solution?

    Hybrid Cloud
    Disclosure: I am a real user, and this review is based on my own experience and opinions.
    PeerSpot user
    Buyer's Guide
    Download our free Microsoft Azure DevOps Report and get advice and tips from experienced pros sharing their opinions.
    Updated: April 2024
    Buyer's Guide
    Download our free Microsoft Azure DevOps Report and get advice and tips from experienced pros sharing their opinions.