Apache Hadoop vs Snowflake comparison

Cancel
You must select at least 2 products to compare!
Apache Logo
2,467 views|2,110 comparisons
87% willing to recommend
Snowflake Computing Logo
11,866 views|6,742 comparisons
96% willing to recommend
Comparison Buyer's Guide
Executive Summary

We performed a comparison between Apache Hadoop and Snowflake based on real PeerSpot user reviews.

Find out in this report how the two Data Warehouse solutions compare in terms of features, pricing, service and support, easy of deployment, and ROI.
To learn more, read our detailed Apache Hadoop vs. Snowflake Report (Updated: May 2024).
772,649 professionals have used our research since 2012.
Q&A Highlights
Question: What is the biggest difference between Apache Hadoop and Snowflake?
Answer: Interactive querying as a consumption pattern is something Snowflake handles much better than Hadoop and related query engine options - Impala, Presto, Drill etc. Heavy data scientists query workload can be an expensive query pattern on Snowflake and Hadoop can provide a more cost-efficient solution. Hadoop is also still relevant as a back-end data processing engine, instead of leveraging Snowflake for data transformation due to higher cost as well as limited procedural language capabilities (javascript based stored procedures). Snowflake fares much better than Hadoop in terms of administrative complexity.
Featured Review
Quotes From Members
We asked business professionals to review the solutions they use.
Here are some excerpts of what they said:
Pros
"Since both Apache Hadoop and Amazon EC2 are elastic in nature, we can scale and expand on demand for a specific PoC, and scale down when it's done.""The most important feature is its ability to handle large volumes. Some of our customers have really large volumes, and it is capable of handling their data in terms of the core volume and daily incremental volume. So, its processing power and speed are most valuable.""Most valuable features are HDFS and Kafka: Ingestion of huge volumes and variety of unstructured/semi-structured data is feasible, and it helps us to quickly onboard a new Big Data analytics prospect.""The most valuable features are powerful tools for ingestion, as data is in multiple systems.""The most valuable feature is scalability and the possibility to work with major information and open source capability.""Hadoop is extensible — it's elastic.""I liked that Apache Hadoop was powerful, had a lot of tools, and the fact that it was free and community-developed.""It's primarily open source. You can handle huge data volumes and create your own views, workflows, and tables. I can also use it for real-time data streaming."

More Apache Hadoop Pros →

"Can be leveraged with respect to better performance, auto tuning and competition.""The most valuable feature has been the Snowflake data sharing and dynamic data masking.""The ability to share the data and the ability to scale up and down easily are the most valuable features. The concept of data sharing and data plumbing made it very easy to provide and share data. The ability to refresh your Dev or QA just by doing a clone is also valuable. It has the dynamic scale up and scale down feature. Development and deployment are much easier as compared to other platforms where you have to go through a lot of stuff. With a tool like DBT, you can do modeling and transformation within a single tool and deploy to Snowflake. It provides continuous deployment and continuous integration abilities. There is a separation of storage and compute, so you only get charged for your usage. You only pay for what you use. When we share the data downstream with business partners, we can specifically create compute for them, and we can charge back the business.""The overall ecosystem was easy to manage. Given that we weren't a very highly technical group, it was preferable to other things we looked at because it could do all of the cloud tunings. It can tune your data warehouse to an appropriate size for controlled billing, resume and sleep functions, and all such things. It was much more simple than doing native Azure or AWS development. It was stable, and their support was also perfect. It was also very easy to deploy. It was one of those rare times where they did exactly what they said they could do.""It requires no maintenance on our part. They handle all that. The speed is phenomenal. The pricing isn't really anything more than what you would be paying for a SQL server license or another tool to execute the same thing. We have zero maintenance on our side to do anything and the speed at which it performs queries and loads the data is amazing. It handles unstructured data extremely well, too. So, if the data is in a JSON array or an XML, it handles that super well.""As long as you don't need to worry about the storage or cost, this solution would be one of the best ones on the market for scalability purposes.""I like the fact that we don't need a DBA. It automatically scales stuff.""The speed of data loading and being able to quickly create the environment are most valuable."

More Snowflake Pros →

Cons
"I think more of the solution needs to be focused around the panel processing and retrieval of data.""The solution needs a better tutorial. There are only documents available currently. There's a lot of YouTube videos available. However, in terms of learning, we didn't have great success trying to learn that way. There needs to be better self-paced learning.""It would be helpful to have more information on how to best apply this solution to smaller organizations, with less data, and grow the data lake.""Since it is an open-source product, there won't be much support.""In certain cases, the configurations for dealing with data skewness do not make any sense.""It requires a great deal of learning curve to understand. The overall Hadoop ecosystem has a large number of sub-products. There is ZooKeeper, and there are a whole lot of other things that are connected. In many cases, their functionalities are overlapping, and for a newcomer or our clients, it is very difficult to decide which of them to buy and which of them they don't really need. They require a consulting organization for it, which is good for organizations such as ours because that's what we do, but it is not easy for the end customers to gain so much knowledge and optimally use it.""Real-time data processing is weak. This solution is very difficult to run and implement.""The solution is very expensive."

More Apache Hadoop Cons →

"The aspect of it that was more complicated was stored procedures. It does not support SQL language-based stored procedures. You have to write in JavaScript. If they supported SQL language and stored procedures, it would make migration from on-prem much simpler. In most cases, if an on-prem solution has stored procedures, they're usually written in SQL. They're not written as what most on-prem DBMS would refer to as an external stored procedure, which is what these feel like to most people because they're written in a language outside of SQL.""The product's performance could be improved.""Product activation queries can't be changed while executing.""Portability is a big hurdle right now for our clients. Porting all of your existing SQL ecosystem, such as stored procedures, to Snowflake is a major pain point. Currently, Snowflake stored procedures use JavaScript, but they should support SQL-based stored procedures. It would be a huge advantage if you can write your stored procedures using SQL. It seems that they are working on this feature, and they are yet to release it. I remember seeing some notes saying that they were going to do that in the future, but the sooner this feature comes out, it would be better for Snowflake because there are a lot of clients with whom I'm interacting, and their main hurdle is to take their existing Oracle or SQL Server stored procedures and move them into Snowflake. For this, you need to learn JavaScript and how it works, which is not easy and becomes a little tricky. If it supports SQL-based procedures, then you can just cut-paste the SQL code, run it, and easily fix small issues.""To ensure the proper functioning of Snowflake as an MDS, it relies heavily on other partner tools.""For the Snowflake database, there should be some third-party features for the ETL. It would also be good to be able to use some kind of controls to get the data either from another database or a flat file. Its price should be improved. It should be cheaper than Microsoft.""They do have a native connector to connect with integration tools for loading data, but it would be much better to have the functionality built-in.""We would like to have an on-premises deployment option that has the same features, including scalability."

More Snowflake Cons →

Pricing and Cost Advice
  • "Do take into consider that data storage and compute capacity scale differently and hence purchasing a "boxed" / 'all-in-one" solution (software and hardware) might not be the best idea."
  • "​There are no licensing costs involved, hence money is saved on the software infrastructure​."
  • "This is a low cost and powerful solution."
  • "The price of Apache Hadoop could be less expensive."
  • "If my company can use the cloud version of Apache Hadoop, particularly the cloud storage feature, it would be easier and would cost less because an on-premises deployment has a higher cost during storage, for example, though I don't know exactly how much Apache Hadoop costs."
  • "We don't directly pay for it. Our clients pay for it, and they usually don't complain about the price. So, it is probably acceptable."
  • "The price could be better. Hortonworks no longer exists, and Cloudera killed the free version of Hadoop."
  • "We just use the free version."
  • More Apache Hadoop Pricing and Cost Advice →

  • "Pricing can be confusing for customers."
  • "The whole licensing system is based on credit points. You can also make a license agreement with the company so that you buy credit points and then you use them. What you do not use in one year can be carried over to the next year."
  • "You pay based on the data that you are storing in the data warehouse and there are no maintenance costs."
  • "It is not cheap."
  • "The pricing for Snowflake is competitive."
  • "On average, with the number of queries that we run, we pay approximately $200 USD per month."
  • "Pricing is approximately $US 50 per DB. Terabyte is around $US 50 per month."
  • "The price of Snowflake is very reasonable."
  • More Snowflake Pricing and Cost Advice →

    report
    Use our free recommendation engine to learn which Data Warehouse solutions are best for your needs.
    772,649 professionals have used our research since 2012.
    Answers from the Community
    Miriam Tover
    it_user1274238 - PeerSpot reviewerit_user1274238 (Director at a tech services company with 10,001+ employees)
    User

    Apache Hadoop is for data lake use cases. But getting data out of Hadoop for meaningful analytics is indeed need quite an amount of work. by either using spark/Hive/presto and so on. The way i look at Snowflake and Hadoop is they complement each other. For data lake you can use hadoop and then for datawarehouse companies can use snowflake. Depending on the size of the company you can turn snowflake into a data lake use case too. Snowflake is SQL friendly and you don't need to carry out any circus to get the data in and out of snowflake.

    Questions from the Community
    Top Answer:It's primarily open source. You can handle huge data volumes and create your own views, workflows, and tables. I can also use it for real-time data streaming.
    Top Answer:Since it is an open-source product, there won't be much support. So, you have to have deeper knowledge. You need to improvise based on that.
    Top Answer:The best thing about Snowflake is its flexibility in changing warehouse sizes or computational power.
    Top Answer:The real-time streaming feature is limited with Snowflake and could be improved. Currently, Snowflake doesn't support unstructured data. With Snowflake, you need to be very particular about the type… more »
    Ranking
    5th
    out of 35 in Data Warehouse
    Views
    2,467
    Comparisons
    2,110
    Reviews
    11
    Average Words per Review
    563
    Rating
    7.9
    1st
    out of 35 in Data Warehouse
    Views
    11,866
    Comparisons
    6,742
    Reviews
    36
    Average Words per Review
    459
    Rating
    8.3
    Comparisons
    Also Known As
    Snowflake Computing
    Learn More
    Overview
    The Apache Hadoop project develops open-source software for reliable, scalable, distributed computing. The Apache Hadoop software library is a framework that allows for the distributed processing of large data sets across clusters of computers using simple programming models. It is designed to scale up from single servers to thousands of machines, each offering local computation and storage. Rather than rely on hardware to deliver high-availability, the library itself is designed to detect and handle failures at the application layer, so delivering a highly-available service on top of a cluster of computers, each of which may be prone to failures.

    Snowflake is a cloud-based data warehousing solution for storing and processing data, generating reports and dashboards, and as a BI reporting source. It is used for optimizing costs and using financial data, as well as for migrating data from on-premises to the cloud. The solution is often used as a centralized data warehouse, combining data from multiple sources.

    Snowflake has helped organizations improve query performance, store and process JSON and XML, consolidate multiple databases into one unified table, power company-wide dashboards, increase productivity, reduce processing time, and have easy maintenance with good technical support.

    Its platform is made up of three components:

    1. Cloud services - Snowflake uses ANSI SQL to empower users to optimize their data and manage their infrastructure, while Snowflake handles the security and encryption of stored data.
    2. Query processing - Snowflake's compute layer is made up of virtual cloud data warehouses that let you analyze data through requests. Each of the warehouses does not compete for computing resources, nor do they affect the performance of each other.
    3. Database storage - Snowflake automatically manages all parts of the data storage process, including file size, compression, organization, structure, metadata, and statistics.

    Snowflake has many valuable vital features. Some of the most useful ones include:

    • Snowflake architecture provides nearly unlimited scalability and high speed because it uses a single elastic performance engine. The solution also supports unlimited concurrent users and workloads, from interactive to batch.
    • Snowflake makes automation easy and enables enterprises to automate data management, security, governance, availability, and data resiliency.
    • With seamless cross-cloud and cross-region connections, Snowflake eliminates ETL and data silos. Anyone who needs access to shared secure data can get a single copy via the data cloud. In addition, Snowflake makes remote collaboration and decision-making fast and easy via a single shared data source.
    • Snowflake’s Data Marketplace offers third-party data, which allows you to connect with Snowflake customers to extend workflows with data services and third-party applications.

    There are many benefits to implementing Snowflake. It helps optimize costs, reduce downtime, improve operational efficiency, and automate data replication for fast recovery, and it is built for high reliability and availability.

      Below are quotes from interviews we conducted with users currently using the Snowflake solution:

      Sreenivasan R., Director of Data Architecture and Engineering at Decision Minds, says, "Data sharing is a good feature. It is a majorly used feature. The elastic computing is another big feature. Separating computing and storage gives you flexibility. It doesn't require much DBA involvement because it doesn't need any performance tuning. We are not doing any performance tuning, and the entire burden of performance and SQL tuning is on Snowflake. Its usability is very good. I don't need to ramp up any user, and its onboarding is easier. You just onboard the user, and you are done with it. There are simple SQL and UI, and people are able to use this solution easily. Ease of use is a big thing in Snowflake."

      A director of business operations at a logistics company mentions, "It requires no maintenance on our part. They handle all that. The speed is phenomenal. The pricing isn't really anything more than what you would be paying for a SQL server license or another tool to execute the same thing. We have zero maintenance on our side to do anything and the speed at which it performs queries and loads the data is amazing. It handles unstructured data extremely well, too. So, if the data is in a JSON array or an XML, it handles that super well."

      A Solution Architect at a wholesaler/distributor comments, "The ability to share the data and the ability to scale up and down easily are the most valuable features. The concept of data sharing and data plumbing made it very easy to provide and share data. The ability to refresh your Dev or QA just by doing a clone is also valuable. It has the dynamic scale up and scale down feature. Development and deployment are much easier as compared to other platforms where you have to go through a lot of stuff. With a tool like DBT, you can do modeling and transformation within a single tool and deploy to Snowflake. It provides continuous deployment and continuous integration abilities. There is a separation of storage and compute, so you only get charged for your usage. You only pay for what you use. When we share the data downstream with business partners, we can specifically create compute for them, and we can charge back the business."

      Sample Customers
      Amazon, Adobe, eBay, Facebook, Google, Hulu, IBM, LinkedIn, Microsoft, Spotify, AOL, Twitter, University of Maryland, Yahoo!, Cornell University Web Lab
      Accordant Media, Adobe, Kixeye Inc., Revana, SOASTA, White Ops
      Top Industries
      REVIEWERS
      Financial Services Firm35%
      Comms Service Provider24%
      Hospitality Company6%
      Consumer Goods Company6%
      VISITORS READING REVIEWS
      Financial Services Firm29%
      Computer Software Company11%
      University6%
      Manufacturing Company5%
      REVIEWERS
      Computer Software Company30%
      Financial Services Firm20%
      Healthcare Company6%
      Manufacturing Company6%
      VISITORS READING REVIEWS
      Educational Organization27%
      Financial Services Firm13%
      Computer Software Company10%
      Manufacturing Company6%
      Company Size
      REVIEWERS
      Small Business33%
      Midsize Enterprise19%
      Large Enterprise47%
      VISITORS READING REVIEWS
      Small Business15%
      Midsize Enterprise11%
      Large Enterprise74%
      REVIEWERS
      Small Business26%
      Midsize Enterprise21%
      Large Enterprise54%
      VISITORS READING REVIEWS
      Small Business15%
      Midsize Enterprise35%
      Large Enterprise51%
      Buyer's Guide
      Apache Hadoop vs. Snowflake
      May 2024
      Find out what your peers are saying about Apache Hadoop vs. Snowflake and other solutions. Updated: May 2024.
      772,649 professionals have used our research since 2012.

      Apache Hadoop is ranked 5th in Data Warehouse with 34 reviews while Snowflake is ranked 1st in Data Warehouse with 94 reviews. Apache Hadoop is rated 7.8, while Snowflake is rated 8.4. The top reviewer of Apache Hadoop writes "Handles huge data volumes and create your own workflows and tables but you need to have deeper knowledge". On the other hand, the top reviewer of Snowflake writes "Good usability, good data sharing and elastic compute features, and requires less DBA involvement". Apache Hadoop is most compared with Azure Data Factory, Microsoft Azure Synapse Analytics, Oracle Exadata, Teradata and BigQuery, whereas Snowflake is most compared with BigQuery, Azure Data Factory, Teradata, Vertica and Teradata Cloud Data Warehouse. See our Apache Hadoop vs. Snowflake report.

      See our list of best Data Warehouse vendors and best Cloud Data Warehouse vendors.

      We monitor all Data Warehouse reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.