Apache Spark vs Hortonworks Data Platform comparison

Cancel
You must select at least 2 products to compare!
Apache Logo
2,498 views|1,884 comparisons
89% willing to recommend
Cloudera Logo
627 views|364 comparisons
89% willing to recommend
Comparison Buyer's Guide
Executive Summary

We performed a comparison between Apache Spark and Hortonworks Data Platform based on real PeerSpot user reviews.

Find out in this report how the two Hadoop solutions compare in terms of features, pricing, service and support, easy of deployment, and ROI.
To learn more, read our detailed Apache Spark vs. Hortonworks Data Platform Report (Updated: March 2024).
767,847 professionals have used our research since 2012.
Featured Review
Quotes From Members
We asked business professionals to review the solutions they use.
Here are some excerpts of what they said:
Pros
"The tool's most valuable feature is its speed and efficiency. It's much faster than other tools and excels in parallel data processing. Unlike tools like Python or JavaScript, which may struggle with parallel processing, it allows us to handle large volumes of data with more power easily.""Spark can handle small to huge data and is suitable for any size of company.""The features we find most valuable are the machine learning, data learning, and Spark Analytics.""The most valuable feature of this solution is its capacity for processing large amounts of data.""The most valuable feature of Apache Spark is its flexibility.""The product is useful for analytics.""The most valuable feature of Apache Spark is its memory processing because it processes data over RAM rather than disk, which is much more efficient and fast.""There's a lot of functionality."

More Apache Spark Pros →

"The product offers a fairly easy setup process.""The scalability is the key reason why we are on this platform.""The Hortonworks solution is so stable. It is working as a production system, without any error, without any downtime. If I have downtime, it is mostly caused by the hardware of the computers.""We use it for data science activities.""Distributed computing, secure containerization, and governance capabilities are the most valuable features.""The upgrades and patches must come from Hortonworks.""Hortonworks should not be expensive at all to those looking into using it.""The data platform is pretty neat. The workflow is also really good."

More Hortonworks Data Platform Pros →

Cons
"Its UI can be better. Maintaining the history server is a little cumbersome, and it should be improved. I had issues while looking at the historical tags, which sometimes created problems. You have to separately create a history server and run it. Such things can be made easier. Instead of separately installing the history server, it can be made a part of the whole setup so that whenever you set it up, it becomes available.""The solution must improve its performance.""In data analysis, you need to take real-time data from different data sources. You need to process this in a subsecond, do the transformation in a subsecond, and all that.""One limitation is that not all machine learning libraries and models support it.""We've had problems using a Python process to try to access something in a large volume of data. It crashes if somebody gives me the wrong code because it cannot handle a large volume of data.""Apache Spark could improve the connectors that it supports. There are a lot of open-source databases in the market. For example, cloud databases, such as Redshift, Snowflake, and Synapse. Apache Spark should have connectors present to connect to these databases. There are a lot of workarounds required to connect to those databases, but it should have inbuilt connectors.""At times during the deployment process, the tool goes down, making it look less robust. To take care of the issues in the deployment process, users need to do manual interventions occasionally.""The setup I worked on was really complex."

More Apache Spark Cons →

"The cost of the solution is high and there is room for improvement.""Hive performance. If Hive performance increased, Hadoop would replace (not everywhere) traditional databases.""Security and workload management need improvement.""The version control of the software is also an issue.""Deleting any service requires a lot of clean up, unlike Cloudera.""It would also be nice if there were less coding involved.""I work a lot with banking, IT and communications customers. Hortonworks must improve or must upgrade their services for these sectors.""More information could be there to simplify the process of running the product."

More Hortonworks Data Platform Cons →

Pricing and Cost Advice
  • "Since we are using the Apache Spark version, not the data bricks version, it is an Apache license version, the support and resolution of the bug are actually late or delayed. The Apache license is free."
  • "Apache Spark is open-source. You have to pay only when you use any bundled product, such as Cloudera."
  • "We are using the free version of the solution."
  • "Apache Spark is not too cheap. You have to pay for hardware and Cloudera licenses. Of course, there is a solution with open source without Cloudera."
  • "Apache Spark is an expensive solution."
  • "Spark is an open-source solution, so there are no licensing costs."
  • "On the cloud model can be expensive as it requires substantial resources for implementation, covering on-premises hardware, memory, and licensing."
  • "It is an open-source solution, it is free of charge."
  • More Apache Spark Pricing and Cost Advice →

  • "It is priced well and it is affordable"
  • "Currently, we are using the product in a sandbox environment, and there is no licensing. We might choose a licensing option once we get the results."
  • More Hortonworks Data Platform Pricing and Cost Advice →

    report
    Use our free recommendation engine to learn which Hadoop solutions are best for your needs.
    767,847 professionals have used our research since 2012.
    Questions from the Community
    Top Answer:We use Spark to process data from different data sources.
    Top Answer:In data analysis, you need to take real-time data from different data sources. You need to process this in a subsecond, and do the transformation in a subsecond
    Top Answer:Distributed computing, secure containerization, and governance capabilities are the most valuable features.
    Top Answer:I haven't done a price analysis specifically for HDP. However, when it was first introduced as Hadoop 2.0, there were a few use cases where the price was quite high. It was particularly expensive for… more »
    Top Answer:Since Cloudera acquired HDP, it's been bundled with CBH and HDP. However, the biggest challenge is cloud storage integration with Azure, GCP, and AWS. These platforms offer competitive storage… more »
    Ranking
    1st
    out of 22 in Hadoop
    Views
    2,498
    Comparisons
    1,884
    Reviews
    25
    Average Words per Review
    432
    Rating
    8.7
    6th
    out of 22 in Hadoop
    Views
    627
    Comparisons
    364
    Reviews
    5
    Average Words per Review
    354
    Rating
    8.0
    Comparisons
    Also Known As
    Hortonworks, HDP
    Learn More
    Overview

    Spark provides programmers with an application programming interface centered on a data structure called the resilient distributed dataset (RDD), a read-only multiset of data items distributed over a cluster of machines, that is maintained in a fault-tolerant way. It was developed in response to limitations in the MapReduce cluster computing paradigm, which forces a particular linear dataflowstructure on distributed programs: MapReduce programs read input data from disk, map a function across the data, reduce the results of the map, and store reduction results on disk. Spark's RDDs function as a working set for distributed programs that offers a (deliberately) restricted form of distributed shared memory

    Hortonworks is a leading innovator in the industry, creating, distributing and supporting enterprise-ready open data platforms and modern data applications. Our mission is to manage the world's data. We have a single-minded focus on driving innovation in open source communities such as Apache Hadoop, NiFi, and Spark. We along with our 1600+ partners provide the expertise, training and services that allow our customers to unlock transformational value for their organizations across any line of business. Our connected data platforms powers modern data applications that deliver actionable intelligence from all data: data-in-motion and data-at-rest. We are Powering the Future of Data.
    Sample Customers
    NASA JPL, UC Berkeley AMPLab, Amazon, eBay, Yahoo!, UC Santa Cruz, TripAdvisor, Taboola, Agile Lab, Art.com, Baidu, Alibaba Taobao, EURECOM, Hitachi Solutions
    Mayo Clinic, Symantec, Progressive Insurance, Noble Energy, Cardinal Health, Rogers, Mercy, Neustar, TRUECar, T-Mobile
    Top Industries
    REVIEWERS
    Computer Software Company30%
    Financial Services Firm15%
    University9%
    Comms Service Provider6%
    VISITORS READING REVIEWS
    Financial Services Firm24%
    Computer Software Company13%
    Manufacturing Company7%
    Comms Service Provider6%
    REVIEWERS
    Comms Service Provider30%
    Government10%
    Financial Services Firm10%
    Wholesaler/Distributor10%
    VISITORS READING REVIEWS
    Computer Software Company19%
    Financial Services Firm15%
    Government6%
    Outsourcing Company6%
    Company Size
    REVIEWERS
    Small Business40%
    Midsize Enterprise19%
    Large Enterprise40%
    VISITORS READING REVIEWS
    Small Business17%
    Midsize Enterprise12%
    Large Enterprise71%
    REVIEWERS
    Small Business25%
    Midsize Enterprise18%
    Large Enterprise57%
    VISITORS READING REVIEWS
    Small Business26%
    Midsize Enterprise13%
    Large Enterprise61%
    Buyer's Guide
    Apache Spark vs. Hortonworks Data Platform
    March 2024
    Find out what your peers are saying about Apache Spark vs. Hortonworks Data Platform and other solutions. Updated: March 2024.
    767,847 professionals have used our research since 2012.

    Apache Spark is ranked 1st in Hadoop with 60 reviews while Hortonworks Data Platform is ranked 6th in Hadoop with 25 reviews. Apache Spark is rated 8.4, while Hortonworks Data Platform is rated 8.0. The top reviewer of Apache Spark writes "Reliable, able to expand, and handle large amounts of data well". On the other hand, the top reviewer of Hortonworks Data Platform writes "Good for secure containerization, and governance capabilities ". Apache Spark is most compared with Spring Boot, AWS Batch, Spark SQL, SAP HANA and Cloudera Distribution for Hadoop, whereas Hortonworks Data Platform is most compared with Amazon EMR, Cloudera DataFlow and HPE Ezmeral Data Fabric. See our Apache Spark vs. Hortonworks Data Platform report.

    See our list of best Hadoop vendors.

    We monitor all Hadoop reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.