AWS Lake Formation vs Apache Hadoop comparison

Cancel
You must select at least 2 products to compare!
Apache Logo
2,387 views|2,021 comparisons
87% willing to recommend
Amazon Web Services (AWS) Logo
4,795 views|3,994 comparisons
75% willing to recommend
Comparison Buyer's Guide
Executive Summary

We performed a comparison between Apache Hadoop and AWS Lake Formation based on real PeerSpot user reviews.

Find out in this report how the two Cloud Data Warehouse solutions compare in terms of features, pricing, service and support, easy of deployment, and ROI.
To learn more, read our detailed AWS Lake Formation vs. Apache Hadoop Report (Updated: May 2024).
772,679 professionals have used our research since 2012.
Featured Review
Quotes From Members
We asked business professionals to review the solutions they use.
Here are some excerpts of what they said:
Pros
"The solution is easy to expand. We haven't seen any issues with it in that sense. We've added 10 servers, and we've added two nodes. We've been expanding since we started using it since we started out so small. Companies that need to scale shouldn't have a problem doing so.""Initially, with RDBMS alone, we had a lot of work and few servers running on-premise and on cloud for the PoC and incubation. With the use of Hadoop and ecosystem components and tools, and managing it in Amazon EC2, we have created a Big Data "lab" which helps us to centralize all our work and solutions into a single repository. This has cut down the time in terms of maintenance, development and, especially, data processing challenges.""Hadoop File System is compatible with almost all the query engines.""The most valuable features are the ability to process the machine data at a high speed, and to add structure to our data so that we can generate relevant analytics.""What I like about Apache Hadoop is that it's for big data, in particular big data analysis, and it's the easier solution. I like the data processing feature for AI/ML use cases the most because some solutions allow me to collect data from relational databases, while Hadoop provides me with more options for newer technologies.""It's primarily open source. You can handle huge data volumes and create your own views, workflows, and tables. I can also use it for real-time data streaming.""It is a file system for data collection. There are nodes in this cluster that contain all the information, directories, and other files. The nodes are based on the MySQL database.""The ability to add multiple nodes without any restriction is the solution's most valuable aspect."

More Apache Hadoop Pros →

"It is seamlessly integrated within the AWS ecosystem, making it straightforward to manage access patterns for AWS-native services.""The solution is quite good at handling analytics. It's done a good job at helping us centralize them.""We use AWS Lake Formation typically for the data warehouse.""The most important advantage in using AWS Lake Formation is its ability to connect the data lake to the other technologies in AWS. This is what I advise my clients.""The solution has many features that are applicable to events such as audits."

More AWS Lake Formation Pros →

Cons
"I think more of the solution needs to be focused around the panel processing and retrieval of data.""We would like to have more dynamics in merging this machine data with other internal data to make more meaning out of it.""What could be improved in Apache Hadoop is its user-friendliness. It's not that user-friendly, but maybe it's because I'm new to it. Sometimes it feels so tough to use, but it could be because of two aspects: one is my incompetency, for example, I don't know about all the features of Apache Hadoop, or maybe it's because of the limitations of the platform. For example, my team is maintaining the business glossary in Apache Atlas, but if you want to change any settings at the GUI level, an advanced level of coding or programming needs to be done in the back end, so it's not user-friendly.""It would be helpful to have more information on how to best apply this solution to smaller organizations, with less data, and grow the data lake.""It requires a great deal of learning curve to understand. The overall Hadoop ecosystem has a large number of sub-products. There is ZooKeeper, and there are a whole lot of other things that are connected. In many cases, their functionalities are overlapping, and for a newcomer or our clients, it is very difficult to decide which of them to buy and which of them they don't really need. They require a consulting organization for it, which is good for organizations such as ours because that's what we do, but it is not easy for the end customers to gain so much knowledge and optimally use it.""It would be good to have more advanced analytics tools.""I mentioned it definitely, and this is probably the only feature we can improve a little bit because the terminal and coding screen on Hadoop is a little outdated, and it looks like the old C++ bio screen. If the UI and UX can be improved slightly, I believe it will go a long way toward increasing adoption and effectiveness.""It needs better user interface (UI) functionalities."

More Apache Hadoop Cons →

"In our experience what could be improved are not the support, performance or monitoring, but at a managerial level, the very expensive professional services of AWS. This could be an area of improvement for them. It's too expensive to acquire their support.""For the end-users, it's not as user-friendly as it could be.""It falls short when it comes to more granular access control, such as cell-level or row-level entitlements which is a significant drawback for organizations that require precise control over who can access specific rows of data.""The solution could make improvements around orchestration and doing some automation stuff on AWS front automation. It would be useful if we could use automation to build images and use hardened images which are CIS compliant.""AWS Lake Formation's pricing could be cheaper."

More AWS Lake Formation Cons →

Pricing and Cost Advice
  • "Do take into consider that data storage and compute capacity scale differently and hence purchasing a "boxed" / 'all-in-one" solution (software and hardware) might not be the best idea."
  • "​There are no licensing costs involved, hence money is saved on the software infrastructure​."
  • "This is a low cost and powerful solution."
  • "The price of Apache Hadoop could be less expensive."
  • "If my company can use the cloud version of Apache Hadoop, particularly the cloud storage feature, it would be easier and would cost less because an on-premises deployment has a higher cost during storage, for example, though I don't know exactly how much Apache Hadoop costs."
  • "We don't directly pay for it. Our clients pay for it, and they usually don't complain about the price. So, it is probably acceptable."
  • "The price could be better. Hortonworks no longer exists, and Cloudera killed the free version of Hadoop."
  • "We just use the free version."
  • More Apache Hadoop Pricing and Cost Advice →

  • "AWS Lake Formation is a bit expensive."
  • More AWS Lake Formation Pricing and Cost Advice →

    report
    Use our free recommendation engine to learn which Cloud Data Warehouse solutions are best for your needs.
    772,679 professionals have used our research since 2012.
    Questions from the Community
    Top Answer:It's primarily open source. You can handle huge data volumes and create your own views, workflows, and tables. I can also use it for real-time data streaming.
    Top Answer:Since it is an open-source product, there won't be much support. So, you have to have deeper knowledge. You need to improvise based on that.
    Top Answer:It is seamlessly integrated within the AWS ecosystem, making it straightforward to manage access patterns for AWS-native services.
    Top Answer:There are significant challenges when dealing with external applications, and vendors, or pursuing a hybrid cloud strategy because AWS Lake Formation is specific to AWS and does not integrate… more »
    Ranking
    6th
    out of 35 in Data Warehouse
    Views
    2,387
    Comparisons
    2,021
    Reviews
    13
    Average Words per Review
    530
    Rating
    7.8
    12th
    Views
    4,795
    Comparisons
    3,994
    Reviews
    1
    Average Words per Review
    578
    Rating
    6.0
    Comparisons
    Learn More
    Overview
    The Apache Hadoop project develops open-source software for reliable, scalable, distributed computing. The Apache Hadoop software library is a framework that allows for the distributed processing of large data sets across clusters of computers using simple programming models. It is designed to scale up from single servers to thousands of machines, each offering local computation and storage. Rather than rely on hardware to deliver high-availability, the library itself is designed to detect and handle failures at the application layer, so delivering a highly-available service on top of a cluster of computers, each of which may be prone to failures.

    AWS Lake Formation is a service that makes it easy to set up a secure data lake in days. A data lake is a centralized, curated, and secured repository that stores all your data, both in its original form and prepared for analysis.

    Sample Customers
    Amazon, Adobe, eBay, Facebook, Google, Hulu, IBM, LinkedIn, Microsoft, Spotify, AOL, Twitter, University of Maryland, Yahoo!, Cornell University Web Lab
    bp, Cerner, Expedia, Finra, HESS, intuit, Kellog's, Philips, TIME, workday
    Top Industries
    REVIEWERS
    Financial Services Firm35%
    Comms Service Provider24%
    Hospitality Company6%
    Consumer Goods Company6%
    VISITORS READING REVIEWS
    Financial Services Firm29%
    Computer Software Company11%
    University6%
    Manufacturing Company5%
    VISITORS READING REVIEWS
    Financial Services Firm21%
    Computer Software Company12%
    Manufacturing Company8%
    Government5%
    Company Size
    REVIEWERS
    Small Business33%
    Midsize Enterprise19%
    Large Enterprise47%
    VISITORS READING REVIEWS
    Small Business15%
    Midsize Enterprise11%
    Large Enterprise74%
    VISITORS READING REVIEWS
    Small Business17%
    Midsize Enterprise10%
    Large Enterprise72%
    Buyer's Guide
    AWS Lake Formation vs. Apache Hadoop
    May 2024
    Find out what your peers are saying about AWS Lake Formation vs. Apache Hadoop and other solutions. Updated: May 2024.
    772,679 professionals have used our research since 2012.

    Apache Hadoop is ranked 6th in Data Warehouse with 34 reviews while AWS Lake Formation is ranked 12th in Cloud Data Warehouse with 5 reviews. Apache Hadoop is rated 7.8, while AWS Lake Formation is rated 7.6. The top reviewer of Apache Hadoop writes "Handles huge data volumes and create your own workflows and tables but you need to have deeper knowledge". On the other hand, the top reviewer of AWS Lake Formation writes "Strategically aligning data management in a multi-cloud environment with significant reporting challenges". Apache Hadoop is most compared with Azure Data Factory, Microsoft Azure Synapse Analytics, Oracle Exadata, Snowflake and Oracle Autonomous Data Warehouse, whereas AWS Lake Formation is most compared with Snowflake, Azure Data Factory, Amazon Redshift and Microsoft Azure Synapse Analytics. See our AWS Lake Formation vs. Apache Hadoop report.

    See our list of best Cloud Data Warehouse vendors.

    We monitor all Cloud Data Warehouse reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.