Darwin vs Databricks comparison

Cancel
You must select at least 2 products to compare!
SparkCognition Logo
484 views|248 comparisons
100% willing to recommend
Databricks Logo
28,975 views|18,474 comparisons
96% willing to recommend
Comparison Buyer's Guide
Executive Summary

We performed a comparison between Darwin and Databricks based on real PeerSpot user reviews.

Find out what your peers are saying about Databricks, Microsoft, Alteryx and others in Data Science Platforms.
To learn more, read our detailed Data Science Platforms Report (Updated: April 2024).
768,857 professionals have used our research since 2012.
Featured Review
Quotes From Members
We asked business professionals to review the solutions they use.
Here are some excerpts of what they said:
Pros
"The most valuable feature is the model-generation. With a nice dataset, Darwin gives you a nice model. That's a really nice feature because, if we're doing that ourselves, it's trial and error; we change the parameters a little and try again. We save time by just giving the dataset to Darwin and letting Darwin generate a model. We find the models it generates are good; better than we can generate.""The thing that I find most valuable is the ability to clean the data.""The solution helps with the automatic assessment of the quality of datasets, such as missing data points or incorrect data types.""I liked the data checking feature where it looks at your data and sees how viable it is for use. That's a really cool feature. Automatic assessment of the quality of datasets, to me, seems very valuable.""Darwin has increased efficiency and productivity for our company. With our risk management team, there were models that took them more than three days to process each, only to see the outcome. Now, it takes minutes for Darwin to process the current model. So, we can have it in minutes. We don't have to wait three days for all the models to be tested, then make a decision.""I find it quite simple to use. Once you are trained on the model, you can use it anyway you want.""In terms of streamlining a lot of the low-level data science work, it does a few things there.""The key feature is the automated model-building. It has a good UI that will let people who aren't data scientists get in there and upload datasets and actually start building models, with very little training. They don't need to have any understanding of data science."

More Darwin Pros →

"Databricks integrates well with other solutions.""Automation with Databricks is very easy when using the API.""We like that this solution can handle a wide variety and velocity of data engineering, either in batch mode or real-time.""A very valuable feature is the data processing, and the solution is specifically good at using the Spark ecosystem.""What I like about Databricks is that it's one of the most popular platforms that give access to folks who are trying not just to do exploratory work on the data but also go ahead and build advanced modeling and machine learning on top of that.""The integration with Python and the notebooks really helps.""When we have a huge volume of data that we want to process with speed, velocity, and volume, we go through Databricks.""Databricks allows me to automate the creation of a cluster, optimized for machine learning and construct AI machine learning models for the client."

More Databricks Pros →

Cons
"There's always room for improvement in the UI and continuing to evolve it to do everything that the rest of AI can do.""An area where Darwin might be a little weak is its automatic assessment of the quality of datasets. The first results it produces in this area are good, but in our experience, we have found that extra analysis is needed to produce an extra-clean set of data.""The analyze function takes a lot of time.""The challenge is very big toward making models operational or to industrialize them. E.g., what we want to do is to make unique credit models for each customer. So, we are preparing the types of customers who we can try new credit models on Darwin. But, I see this still very challenging to be able to get the data sets so Darwin can work. At this point, we are working it to get the data sets ready for Darwin.""The Read Me's and the tutorials need to be greatly improved to get customers to understand how things work. It might be helpful to have some sample data sets for people to play around with, as well as some tutorial videos. It was very hard to find information on this in the time crunch that we had, to see how it worked and then make it work, while interfacing with folks at SparkCognition.""Something they are working on, which is great, is to have an API that can access data directly from the source. Currently, we have to create a specific dataset for each model.""There are issues around the ethics of artificial intelligence and machine learning. You need to have a lot of transparency regarding what is going on under the hood in order to trust it. Because so much is done under the hood of Darwin, it is hard to trust how it gets the answers it gets.""Our main data repository is on AWS. The trouble we are having is that we have to download the data from our repository to bring it into Darwin. It would be great if there was an API to connect our repository to Darwin."

More Darwin Cons →

"If I want to create a Databricks account, I need to have a prior cloud account such as an AWS account or an Azure account. Only then can I create a Databricks account on the cloud. However, if they can make it so that I can still try Databricks even if I don't have a cloud account on AWS and Azure, it would be great. That is, it would be nice if it were possible to create a pseudo account and be provided with a free trial. It is very essential to creating a workforce on Databricks. For example, students or corporate staff can then explore and learn Databricks.""Overall it's a good product, however, it doesn't do well against any individual best-of-breed products.""The Databricks cluster can be improved.""This solution only supports queries in SQL and Python, which is a bit limiting.""The ability to customize our own pipelines would enhance the product, similar to what's possible using ML files in Microsoft Azure DevOps.""Databricks would have more collaborative features than it has. It should have some more customization for the jobs.""CI/CD needs additional leverage and support.""The product should incorporate more learning aspects. It needs to have a free trial version that the team can practice."

More Databricks Cons →

Pricing and Cost Advice
  • "The license cost is not cheap, especially not for markets like Mexico. But sometimes, you do have to make these leap of faith for some tools to see if they can get you the disruption that you are aiming for. The investment has paid off for us very well."
  • "In just six months, we calculated six million pesos that we have prevented in revenue from going away with another customer because of this solution. Thanks to Darwin, we didn't lose those six million pesos."
  • "As far as I understand, my company is not paying anything to use the product."
  • "I believe our cost is $1,000 per month."
  • More Darwin Pricing and Cost Advice →

  • "Whenever we want to find the actual costing, we have to send an email to Databricks, so having the information available on the internet would be helpful."
  • "I do not exactly know the costs, but one of our clients pays between $100 USD and $200 USD monthly."
  • "Licensing on site I would counsel against, as on-site hardware issues tend to really delay and slow down delivery."
  • "We find Databricks to be very expensive, although this improved when we found out how to shut it down at night."
  • "The pricing depends on the usage itself."
  • "I am based in South Africa, where it is expensive adapting to the cloud, and then there is the price for the tool itself."
  • "The price is okay. It's competitive."
  • "Databricks uses a price-per-use model, where you can use as much compute as you need."
  • More Databricks Pricing and Cost Advice →

    report
    Use our free recommendation engine to learn which Data Science Platforms solutions are best for your needs.
    768,857 professionals have used our research since 2012.
    Questions from the Community
    Ask a question

    Earn 20 points

    Top Answer:Databricks gives you the option of working with several different languages, such as SQL, R, Scala, Apache Spark, or Python. It offers many different cluster choices and excellent integration with… more »
    Top Answer:We researched AWS SageMaker, but in the end, we chose Databricks Databricks is a Unified Analytics Platform designed to accelerate innovation projects. It is based on Spark so it is very fast. It… more »
    Top Answer:Databricks is an easy-to-set-up and versatile tool for data management, analysis, and business analytics. For analytics teams that have to interpret data to further the business goals of their… more »
    Ranking
    27th
    Views
    484
    Comparisons
    248
    Reviews
    0
    Average Words per Review
    0
    Rating
    N/A
    1st
    Views
    28,975
    Comparisons
    18,474
    Reviews
    47
    Average Words per Review
    441
    Rating
    8.3
    Comparisons
    Also Known As
    Databricks Unified Analytics, Databricks Unified Analytics Platform, Redash
    Learn More
    Overview

    SparkCognition builds leading artificial intelligence solutions to advance the most important interests of society. We help customers analyze complex data, empower decision making, and transform human and industrial productivity with award-winning machine learning technology and expert teams focused on defense, IIoT, and finance.

    Databricks is an industry-leading data analytics platform which is a one-stop product for all data requirements. Databricks is made by the creators of Apache Spark, Delta Lake, ML Flow, and Koalas. It builds on these technologies to deliver a true lakehouse data architecture, making it a robust platform that is reliable, scalable, and fast. Databricks speeds up innovations by synthesizing storage, engineering, business operations, security, and data science.

    Databricks is integrated with Microsoft Azure, Amazon Web Services, and Google Cloud Platform. This enables users to easily manage a colossal amount of data and to continuously train and deploy machine learning models for AI applications. The platform handles all analytic deployments, ranging from ETL to models training and deployment.

    Databricks deciphers the complexities of processing data to empower data scientists, engineers, and analysts with a simple collaborative environment to run interactive and scheduled data analysis workloads. The program takes advantage of AI’s cost-effectivity, flexibility, and cloud storage.

    Databricks Key Features

    Some of Databricks key features include:

    • Cloud-native: Works well on any prominent cloud provider.
    • Data storage: Stores a broad range of data, including structured, unstructured, and streaming.
    • Self-governance: Built-in governance and security controls.
    • Flexibility: Flexible for small-scale jobs as well as running large-scale jobs like Big Data processing because it’s built from Spark and is specifically optimized for Cloud environments.
    • Data science tools: Production-ready data tooling, from engineering to BI, AI, and ML.
    • Familiar languages: While Databricks is Spark-based, it allows commonly used programming languages like R, SQL, Scala, and Python to be used.
    • Team sharing workspaces: Creates an environment that provides interactive workspaces for collaboration, which allow multiple members to collaborate for data model creation, machine learning, and data extraction.
    • Data source: Performs limitless Big Data analytics by connecting to Cloud providers AWS, Azure, and Google, as well as on-premises SQL servers, JSON and CSV.

    Reviews from Real Users

    Databricks stands out from its competitors for several reasons. Two striking features are its collaborative ability and its ability to streamline multiple programming languages.

    PeerSpot users take note of the advantages of these features. A Chief Research Officer in consumer goods writes, “We work with multiple people on notebooks and it enables us to work collaboratively in an easy way without having to worry about the infrastructure. I think the solution is very intuitive, very easy to use. And that's what you pay for.”

    A business intelligence coordinator in construction notes, “The capacity of use of the different types of coding is valuable. Databricks also has good performance because it is running in spark extra storage, meaning the performance and the capacity use different kinds of codes.”

    An Associate Manager who works in consultancy mentions, “The technology that allows us to write scripts within the solution is extremely beneficial. If I was, for example, able to script in SQL, R, Scala, Apache Spark, or Python, I would be able to use my knowledge to make a script in this solution. It is very user-friendly and you can also process the records and validation point of view. The ability to migrate from one environment to another is useful.”

    Sample Customers
    Hunt Oil, Hitachi High-Tech Solutions
    Elsevier, MyFitnessPal, Sharethrough, Automatic Labs, Celtra, Radius Intelligence, Yesware
    Top Industries
    VISITORS READING REVIEWS
    Computer Software Company19%
    Financial Services Firm15%
    Government11%
    Real Estate/Law Firm11%
    REVIEWERS
    Computer Software Company25%
    Financial Services Firm16%
    Retailer9%
    Manufacturing Company9%
    VISITORS READING REVIEWS
    Financial Services Firm15%
    Computer Software Company12%
    Manufacturing Company8%
    Healthcare Company6%
    Company Size
    REVIEWERS
    Small Business75%
    Large Enterprise25%
    VISITORS READING REVIEWS
    Small Business22%
    Midsize Enterprise10%
    Large Enterprise68%
    REVIEWERS
    Small Business27%
    Midsize Enterprise14%
    Large Enterprise59%
    VISITORS READING REVIEWS
    Small Business17%
    Midsize Enterprise11%
    Large Enterprise71%
    Buyer's Guide
    Data Science Platforms
    April 2024
    Find out what your peers are saying about Databricks, Microsoft, Alteryx and others in Data Science Platforms. Updated: April 2024.
    768,857 professionals have used our research since 2012.

    Darwin is ranked 27th in Data Science Platforms while Databricks is ranked 1st in Data Science Platforms with 78 reviews. Darwin is rated 8.0, while Databricks is rated 8.2. The top reviewer of Darwin writes "Empowers SMEs to build solutions and interface them with the existing business systems, products and workflows". On the other hand, the top reviewer of Databricks writes "A nice interface with good features for turning off clusters to save on computing". Darwin is most compared with IBM Watson Studio and Microsoft Azure Machine Learning Studio, whereas Databricks is most compared with Amazon SageMaker, Informatica PowerCenter, Dataiku Data Science Studio, Microsoft Azure Machine Learning Studio and Dremio.

    See our list of best Data Science Platforms vendors.

    We monitor all Data Science Platforms reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.