Apache Spark vs IBM InfoSphere BigInsights [EOL] comparison

Cancel
You must select at least 2 products to compare!
Apache Logo
2,498 views|1,884 comparisons
89% willing to recommend
IBM Logo
views| comparisons
83% willing to recommend
Comparison Buyer's Guide
Executive Summary

We performed a comparison between Apache Spark and IBM InfoSphere BigInsights [EOL] based on real PeerSpot user reviews.

Find out what your peers are saying about Apache, Cloudera, Amazon Web Services (AWS) and others in Hadoop.
To learn more, read our detailed Hadoop Report (Updated: April 2024).
768,740 professionals have used our research since 2012.
Featured Review
Quotes From Members
We asked business professionals to review the solutions they use.
Here are some excerpts of what they said:
Pros
"The solution is scalable.""There's a lot of functionality.""The most valuable feature of Apache Spark is its ease of use.""The product's deployment phase is easy.""The good performance. The nice graphical management console. The long list of ML algorithms.""It's easy to prepare parallelism in Spark, run the solution with specific parameters, and get good performance.""The most crucial feature for us is the streaming capability. It serves as a fundamental aspect that allows us to exert control over our operations.""Apache Spark provides a very high-quality implementation of distributed data processing."

More Apache Spark Pros →

"InfoSphere Streams was the one core product from the platform in which we were using. We were building a real-time response system and we built it on InfoSphere Streams."

More IBM InfoSphere BigInsights [EOL] Pros →

Cons
"I know there is always discussion about which language to write applications in and some people do love Scala. However, I don't like it.""They could improve the issues related to programming language for the platform.""The initial setup was not easy.""If you have a Spark session in the background, sometimes it's very hard to kill these sessions because of D allocation.""Apache Spark could potentially improve in terms of user-friendliness, particularly for individuals with a SQL background. While it's suitable for those with programming knowledge, making it more accessible to those without extensive programming skills could be beneficial.""Technical expertise from an engineer is required to deploy and run high-tech tools, like Informatica, on Apache Spark, making it an area where improvements are required to make the process easier for users.""Apache Spark should add some resource management improvements to the algorithms.""When you first start using this solution, it is common to run into memory errors when you are dealing with large amounts of data."

More Apache Spark Cons →

"The UI was not interactive: Responses used to be very slow and hang up at times."

More IBM InfoSphere BigInsights [EOL] Cons →

Pricing and Cost Advice
  • "Since we are using the Apache Spark version, not the data bricks version, it is an Apache license version, the support and resolution of the bug are actually late or delayed. The Apache license is free."
  • "Apache Spark is open-source. You have to pay only when you use any bundled product, such as Cloudera."
  • "We are using the free version of the solution."
  • "Apache Spark is not too cheap. You have to pay for hardware and Cloudera licenses. Of course, there is a solution with open source without Cloudera."
  • "Apache Spark is an expensive solution."
  • "Spark is an open-source solution, so there are no licensing costs."
  • "On the cloud model can be expensive as it requires substantial resources for implementation, covering on-premises hardware, memory, and licensing."
  • "It is an open-source solution, it is free of charge."
  • More Apache Spark Pricing and Cost Advice →

    Information Not Available
    report
    Use our free recommendation engine to learn which Hadoop solutions are best for your needs.
    768,740 professionals have used our research since 2012.
    Questions from the Community
    Top Answer:We use Spark to process data from different data sources.
    Top Answer:In data analysis, you need to take real-time data from different data sources. You need to process this in a subsecond, and do the transformation in a subsecond
    Ask a question

    Earn 20 points

    Ranking
    1st
    out of 22 in Hadoop
    Views
    2,498
    Comparisons
    1,884
    Reviews
    25
    Average Words per Review
    432
    Rating
    8.7
    Unranked
    In Hadoop
    Comparisons
    Also Known As
    InfoSphere BigInsights
    Learn More
    Overview

    Spark provides programmers with an application programming interface centered on a data structure called the resilient distributed dataset (RDD), a read-only multiset of data items distributed over a cluster of machines, that is maintained in a fault-tolerant way. It was developed in response to limitations in the MapReduce cluster computing paradigm, which forces a particular linear dataflowstructure on distributed programs: MapReduce programs read input data from disk, map a function across the data, reduce the results of the map, and store reduction results on disk. Spark's RDDs function as a working set for distributed programs that offers a (deliberately) restricted form of distributed shared memory

    IBM BigInsights delivers a rich set of advanced analytics capabilities that allows enterprises to analyze massive volumes of structured and unstructured data in its native format. The software combines open source Apache Hadoop with IBM innovations including sophisticated text analytics, IBM BigSheets for data exploration, IBM Big SQL for SQL access to data in Hadoop, and a range of performance, security and administrative features. The result is a cost-effective and user-friendly solution for complex, big data analytics.
    Sample Customers
    NASA JPL, UC Berkeley AMPLab, Amazon, eBay, Yahoo!, UC Santa Cruz, TripAdvisor, Taboola, Agile Lab, Art.com, Baidu, Alibaba Taobao, EURECOM, Hitachi Solutions
    Coherent Path Inc., Optibus, Delhaize America, Diyotta Inc., Ernst & Young, Teikoku Databank Ltd., NCSU, Vestas
    Top Industries
    REVIEWERS
    Computer Software Company30%
    Financial Services Firm15%
    University9%
    Marketing Services Firm6%
    VISITORS READING REVIEWS
    Financial Services Firm24%
    Computer Software Company13%
    Manufacturing Company7%
    Comms Service Provider6%
    No Data Available
    Company Size
    REVIEWERS
    Small Business40%
    Midsize Enterprise19%
    Large Enterprise40%
    VISITORS READING REVIEWS
    Small Business17%
    Midsize Enterprise12%
    Large Enterprise71%
    REVIEWERS
    Small Business43%
    Large Enterprise57%
    Buyer's Guide
    Hadoop
    April 2024
    Find out what your peers are saying about Apache, Cloudera, Amazon Web Services (AWS) and others in Hadoop. Updated: April 2024.
    768,740 professionals have used our research since 2012.

    Apache Spark is ranked 1st in Hadoop with 60 reviews while IBM InfoSphere BigInsights [EOL] doesn't meet the minimum requirements to be ranked in Hadoop. Apache Spark is rated 8.4, while IBM InfoSphere BigInsights [EOL] is rated 7.6. The top reviewer of Apache Spark writes "Reliable, able to expand, and handle large amounts of data well". On the other hand, the top reviewer of IBM InfoSphere BigInsights [EOL] writes "The BIQSQL implementation is fully SQL ANSI compliant, but I have found a lot of issues in Fluid Query". Apache Spark is most compared with Spring Boot, AWS Batch, Spark SQL, SAP HANA and Cloudera Distribution for Hadoop, whereas IBM InfoSphere BigInsights [EOL] is most compared with .

    See our list of best Hadoop vendors.

    We monitor all Hadoop reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.