Find out what your peers are saying about Jenkins, JetBrains, Atlassian and others in Build Automation.
279,610 professionals have used our research since 2012.
Find out what your peers are saying about Jenkins, JetBrains, Atlassian and others in Build Automation.
279,610 professionals have used our research since 2012.
Chart Key
Average Rating
Average rating based on reviews
Views
Number of total page views
Comparisons
Number of times compared to another product
Reviews
Total number of reviews on IT Central Station
Followers
Number of followers on IT Central Station
The total ranking of a product, represented by the bar length, is based on a weighted aggregate score. The score is calculated as follows: The product with the highest count in each area gets the highest available score. (20 points for Reviews; 16 points for Views, Comparisons, and Followers.) Every other product gets assigned points based on its total in proportion to the #1 product in that area. For example, if a product has 80% of the number of reviews compared to the product with the most reviews then the product's score for reviews would be 20% (weighting factor) * 80% = 16. For Average Rating, the maximum score is 32 points awarded linearly based on our rating scale of 1-10. If a product has fewer than ten reviews, the point contribution for Average Rating is reduced (one-third reduction in points for products with 5-9 reviews; two-thirds reduction for products with fewer than five reviews). Reviews that are more than 24 months old, as well as those written by resellers, are completely excluded from the ranking algorithm.
Most Views
From IT Central Station visitors
Most Reviews
Within the last 24 months
Most Followed
By IT Central Station users
Most Compared
From IT Central Station visitors

What is Build Automation?

Build automation tools automate the time-consuming tasks inherent in creating a “build,” or usable version of an application. They automate and orchestrate the sometimes complex processes of compiling computer source code into binary code and packaging that binary code as well as running automated tests

Some IT Central Station members use build automation solutions. In reviews, they offer opinions on the most significant selection factors to consider when looking at this type of software. One theme that emerges from user comments is the importance of vendors that can keep up with the high pace of the technical evolution of the products that must be automated. Application development tools evolve quickly, so build automation must keep up. For some aspects of build automation, an Open Source community may be the best way to for tool makers and users to stay in sync with rapid changes in development platforms and development methodologies.

Build automation tends to get complex, so users prefer build automation systems that have simplicity in adding custom functions and rules and a simple, intuitive model for doing the core tasks. Others ask for build automation solutions that are simple but can be complex. Centralized build automation and a web-based front end can help with this goal. Making builds auditable allows multiple stakeholders to have awareness of how builds have been put together.

Given their essential interconnectedness, build automation suites thrive on APIs and plug-ins. The more, the better. Templates can keep things streamlined, allowing for consistent configuration on how an application Is built. Users also recommend build automation products that can delegate the building of executable code to a machine. Then, the tool should have the ability to trigger subsequent builds in a chain based off of multiple types of triggers in a deterministic fashion. Ultimately, the tool can enable an on-demand, push-button release strategy.


Build Automation Reviews

Read top reviews of Build Automation solutions from the IT Central Station community:
Your trust is our top concern, so companies can't alter or remove reviews.
Travis CI
Real User
Senior Developer at Code Drop Pty Ltd
Nov 17 2016

What do you think of Travis CI?

Continuous integration is a hot topic across the web right now and most conferences have at least a few devops talks that touch on CI and build tools. They usually go something along the lines of, use Phing with Jenkins and touch on the fact that Jenkins used to be called Hudson, has been around for ever and has a plugin for just about everything. I’m not going to mention Jenkins as we explore a few hosted CI solutions. Hosting Your Own CI Server Managing any server is a timely process and a CI server is no different. Those Jenkins plugins don’t configure themselves. Smalls teams like ours don’t have the resources to commit to managing infrastructure and that is pretty scary when you’re talking about such a crucial aspect of the business. We’ve recently...
Jenkins
Real User
Software Engineer at a tech services company with 11-50 employees
Jan 24 2018

What is most valuable?

* Configuration management: It is so easy to configure a Jenkins instance. Migrate configuration to a new environment just by copying XML files and setting up new nodes. * Programmable pipelines: In recent versions, Jenkins has a Groovy... more»

How has it helped my organization?

Most obvious: Having builds and test tasks triggered on commit helps not to break the product. From my own experience: We significantly reduced build times of large projects (more than 80k lines of Scala code) using build time on Jenkins as a... more»

What needs improvement?

UI: Jenkins relies on the old version of interface for configuration management. Developer documentation for plugins, plugin development, integrations: Sometimes it’s tricky to do pretty obvious things.
Find out what your peers are saying about Jenkins, JetBrains, Atlassian and others in Build Automation.
279,610 professionals have used our research since 2012.
Atlassian
Real User
Solution Management at a software R&D company with 51-200 employees
Apr 12 2017

What is most valuable?

We are very fond of the flexibility it offers in terms of setting up our builds. We have a wide variety of components we need to build which often require custom actions or manipulations using in house technology. Bamboo allows us to set this... more»

How has it helped my organization?

Thanks to Bamboo we are able to build changes made by development quite quickly and allow them to deploy to our internal environments when needed (as well as automated during the night). This significantly reduces the effort required to get... more»

What needs improvement?

We are lacking proper support for branched builds using multiple source repositories. The current approach is quite clunky (or non-existent) but it seems there is something in the pipe line for the end of the year according to a recent post... more»
CircleCI
Real User
Full Stack Bot Engineer
Jan 16 2018

What is most valuable?

Some of the most valuable features include container-based builds, integration with Bit Bucket (which our organization uses) and being able to store artifacts. In addition, it has the facility to encrypt environment variables, setup SSH into... more»

How has it helped my organization?

The first thing that comes to mind is the ability to automate the build process in a seamless way and run workflows effortlessly. It supports parallel builds so it can scale well. Also, it covers the basics of any build and integration tool,... more»

What needs improvement?

Integration with Microsoft Azure is one area for improvement. Azure is growing in its user base, and supports various cloud infrastructure components such as Service Fabric, App Service, etc. Some of Azure’s deployment models (like Kudu)... more»
Real User
Software Engineer at a tech vendor with 11-50 employees
Jan 17 2018

What is most valuable?

Lack of any GUI, full-featured declarative syntax, wide adoption. Makefiles are extremely easy to work with using any preferred editor. GNU Make can be run directly from the terminal, not requiring any time wasted on clicking. Full-featured... more»

How has it helped my organization?

GNU Make is such an essential tool that it is almost impossible to imagine working without it. Not having it, developers would probably have to resort to doing everything manually or via shell scripts. Tools such as automake and various IDEs... more»

What needs improvement?

Vanilla GNU Make does not support any kind of colored output. A wrapper named colormake exists to work around this, but native (opt-in) support would be welcome.
Jenkins
Real User
Senior Automation Test Developer/Automation Test Architect at a software R&D company with 51-200 employees
Jan 30 2018

What is most valuable?

Jenkins: pipeline/delivery pipeline and we can use shell script in the configuration. Jenkins has a lot of plugins. TeamCity: We can run automaton tests.

How has it helped my organization?

CI tools such Jenkins and TeamCity, totally helps our release and tests. It saves our money, time and labour cost. And make release/delivery of the our product more visible. It drives the development team and other departments’s ambition.

What needs improvement?

For Jenkins: It needs to have less bugs. I do not how they test the plugins, but sometimes, the plugins have issues. I have no time to check where to report the issue. For TeamCity: It need to be cheaper.
Jenkins
Real User
Software Engineer at a retailer with 1,001-5,000 employees
Dec 03 2017

What is most valuable?

* Continuous Integration. Jenkins can integrate with almost any systems used for application development and testing, with its plugins. * It is open source and can be hosted on-premise. * Because of its wide usage and support forums, one can... more»

How has it helped my organization?

Jenkins has helped make teams more independent. For example, if a developer wants to check if the changes they are working on have any performance impact on their application, they would typically ask the performance engineer to do load tests... more»

What needs improvement?

Upgrading and maintaining plugins can be painful, as sometimes upgrading a plugin can break functionality of another plugin that a job is dependent on.
CircleCI
Real User
Senior Automation Test Developer/Automation Test Architect at a software R&D company with 51-200 employees
May 08 2017

What is most valuable?

Since I am an automation developer, I use selenium a lot. It is quite easy to run the tests in circleCI. Without using browserstack or saucelabs or xvfb, circleCI pre-installed chrome/chrome driver and firefox for you. It is quite good. And... more»

How has it helped my organization?

save our money for buying plans of browserstack or sauce labs save our time, do not need to setup our own xvfb, selenium grid or other stuff.

What needs improvement?

1. The feature of building CD pipeline as Jenkins: I confirmed with circleCI, this is in their to-do list 2. customized view of the pipeline and builds. 3. different triggers for the build, not only trigger by the github updates 4. If they... more»
Real User
DevOps Engineer at a tech services company with 11-50 employees
Dec 03 2017

What do you think of JetBrains TeamCity?

Valuable Features VCS Trigger: Provides excellent source control support. Able to customize a feature with the specific conditions we want. For example, if we wanted only a specific branch to trigger a build, we can do that.  • Improvements to My Organization Automatic VCS Triggers, MSTest, and NUnit integration made our workflow much faster and efficient. It just felt more mature and everything was working as we expected. • Room for Improvement The upgrade process could be smoother. Upgrading major versions can often cause some pain. • Use of Solution Three to five years. • Stability Issues We did not encounter any serious issues with stability so far. • Scalability Issues No issues with scalability. When we needed more agents, we simply used pre-configured...
Jenkins
Real User
Senior Automation Test Developer/Automation Test Architect at a software R&D company with 51-200 employees
Nov 26 2017

What do you think of Jenkins?

Valuable Features CD/CI pipeline Different types of jobs, such as Pipeline, Build, Freestyle, Maven, etc. DSL: Groovy for complicated pipeline flow. Tons of plugins Is able to integrate with other systems. Free Easy to use Jenkins Docker. • Improvements to My Organization It improves our release. It makes the release faster by adding an automated deploy and automation tests. • Room for Improvement The bug fix speed is very slow. • Use of Solution More than six years. • Stability Issues Some plugins have critical bugs and are not able to be used. • Scalability Issues Most of time, Jenkins is works well. But when you scale up, you need an administrator to manage Jenkins. • Customer Service and Technical Support You need an internal admin for Jenkins. •...
Jenkins
Real User
Software Tester at a tech vendor
Nov 26 2017

What do you think of Jenkins?

Valuable Features We use Jenkins to automatically build Python binaries into several OS's i.e. OS X, Ubuntu, Windows 32-bit and Windows 64-bit. • Improvements to My Organization We are a company run by remote workers. Using Jenkins really helps us in moving our products forward into a number of different customer segments. • Room for Improvement I think the UI and the UX can be improved. In our case, we have several products built using Jenkins. It is quite difficult to navigate into the latest stable build in a given OS. • Use of Solution Two years. • Stability Issues No stability issues. • Scalability Issues No scalability issues. As long as the configuration is set correctly, there is nothing difficult in scaling up. • Customer Service and Technical...
Real User
Software Tools Developer II at a tech vendor with 1,001-5,000 employees
Dec 03 2017

What do you think of JetBrains TeamCity?

Valuable Features Templates Meta-runners Plugins Multiple version control system support REST API support • Improvements to My Organization We can build our code daily and automatically, with email notification for failures. It's easy to move to a new release because of templates and meta-runners, and agent pooling. • Room for Improvement REST API support lacks many features in customization of builds, jobs, and settings.  Also, integration with newer technologies needs improvement. • Use of Solution Three to five years. • Stability Issues Depends on the server host, but it runs on Java so it needs high specs. Otherwise, the website takes a long time to load.  Also, supporting newer technologies is limited. • Scalability Issues You have to clean up old...
Jenkins
Real User
QA Automation Engineer at a tech services company with 1,001-5,000 employees
Jan 16 2018

What do you think of Jenkins?

Improvements to My Organization We used it for all continuous integration parts, like automation testing, deployment, etc. • Valuable Features In Jenkins v.2, the most useful feature is the Pipeline plugin. The reason why I think so is that you can build your own workflow with Groove and the plugin has many useful features like parallel executing, running commands, etc. and even imagine implementing your own features on Groove. • Room for Improvement The interface. • Use of Solution One to three years. • Stability Issues Yes, in Jenkins v.2. However, I am guessing that is because we used it right after the first release. • Scalability Issues In my opinion, there is an issue with the scalability. After Jenkins has big count of jobs, it begins to lose performance...
Jenkins
Real User
Continuous Integration Engineer 
Dec 03 2017

What do you think of Jenkins?

Valuable Features Continuous build and testing Distributed execution of build and test jobs It is essential for software development and team collaboration. Without this tool, we would be helpless. • Improvements to My Organization Immediate feedback on build errors, regression. • Room for Improvement Pipelines are still young and promising. But this part still has some room for improvement. The documentation on plugin development could be better: more examples.  • Use of Solution More than five years. • Stability Issues Sometimes, out-of-memory problems, but lately this has not occurred often. Sometimes there are obscure Java errors which are hard to understand. • Scalability Issues No issues. • Customer Service and Technical Support If there is a...
Real User
Web Developer and Software Architect at a tech vendor with 1-10 employees
Feb 25 2018

What is most valuable?

The three best features are the following: * Automated builds triggered on check-in * Execution of unit tests with code coverage reports * Automated deployment to various environments.

How has it helped my organization?

Being the sole TDD developer in an organization is not enough if the rest of the team does not test as well. Using TeamCity and emailing everyone on fail is one way to emphasize the importance of testing code and showing management why taking... more»

What needs improvement?

Last time I used it, dotnet compilation had to be done via PowerShell scripts. There was actually a lot that had to be scripted. Whether to present an error code or just throw an exception, it was unclear, as well as having to paste a script... more»
User
Lead Engineer with 1,001-5,000 employees
Apr 15 2018

What is most valuable?

I have not yet implemented the remote build feature, but this will be a big plus. We want to be able to build legacy products on a build agent without developers needing to have obsolete tool sets installed on their local PC.

How has it helped my organization?

The flexibility of TeamCity allows it to fit in workflows that I have yet to imagine. As we learn how to configure the build processes to fit our needs, it will prove to be a significant time saver.

What needs improvement?

Their online documentation is fairly extensive, but sometimes you can end up navigating in circles to find answers. I would like them (or partner with someone) to provide training classes to help newcomers get things up and running more quickly.
Jenkins
Real User
System Administrator at a marketing services firm with 51-200 employees
Jan 23 2018

What do you think of Jenkins?

Improvements to My Organization It's more structured, using naming conventions. • Valuable Features Customization Automation It's very useful when you want to automate different processes from beginning to end. • Room for Improvement Maybe centralized user management. (We are not using all the functionalities of the product). • Use of Solution Three to five years. • Stability Issues I would say it's a quite stable system. • Scalability Issues As I mentioned, we are not using all the feature of it, so it's very easy to scale it. • Customer Service and Technical Support It's free software with a big community behind it, which is very good. • Previous Solutions No previous solution. • Initial Setup It's pretty straightforward. Use apt-get to...
Shippable
User
DevOps Lead at a tech company with 51-200 employees
Jan 21 2018

What is most valuable?

Testing against multiple run times, versions, and environments is a plus point with the additional pipelines making it more interesting to see what is happening across your development process in a single pane of glass.

How has it helped my organization?

Shippable has tremendously increased our product and features delivery by at least three times. The platform has some amazing features and the integration option makes it very simple to plug with any of our favorite tools.

What needs improvement?

They lack the iOS support as of now, but heard that they are already working on it. They could work on reducing the number of permissions required while using Bitbucket.
Real User
Software Engineer with 501-1,000 employees
Dec 03 2017

What do you think of JetBrains TeamCity?

Valuable Features Good visualization of builds Easy configuration Good integration with IDE and JetBrains products • Improvements to My Organization People react faster on failing builds. • Room for Improvement I would suggest creating simple and advanced configurations. Advanced configurations will give more customizations like Jenkins does. • Use of Solution Three to five years. • Stability Issues Generally no, just in a few cases. • Scalability Issues No, adding new build agents were enough. • Customer Service and Technical Support I would give technical support an eight out of 10. They provide help quickly. • Previous Solutions At another company, we switched from Jenkins to TeamCity because of the support. • Initial Setup The setup is...
Real User
Software Engineer at a security firm with 501-1,000 employees
Aug 04 2016

What is most valuable?

Features I really like: Branch builds for Git repositories, shared resource locking, customization via plugins and meta-runners, and storing build configurations per-branch for Git code repositories.

How has it helped my organization?

TeamCity allows us to have self-sufficient development teams that can create their own builds and deployments. TeamCity has really allowed us to embrace continuous integration (even running full CI on all code branches with no extra effort).

What needs improvement?

Features I would like to see in TeamCity: Allow for shared resource locks across multiple build configurations (i.e. deploy then run integration tests against the same environment). Allow shared resource locks to accept parameters for dynamic... more»
Find out what your peers are saying about Jenkins, JetBrains, Atlassian and others in Build Automation.
279,610 professionals have used our research since 2012.

Sign Up with Email