Amazon Kinesis vs Apache Spark Streaming comparison

Cancel
You must select at least 2 products to compare!
Amazon Web Services (AWS) Logo
12,325 views|9,068 comparisons
88% willing to recommend
Apache Logo
4,104 views|3,301 comparisons
88% willing to recommend
Comparison Buyer's Guide
Executive Summary

We performed a comparison between Amazon Kinesis and Apache Spark Streaming based on real PeerSpot user reviews.

Find out in this report how the two Streaming Analytics solutions compare in terms of features, pricing, service and support, easy of deployment, and ROI.
To learn more, read our detailed Amazon Kinesis vs. Apache Spark Streaming Report (Updated: March 2024).
770,458 professionals have used our research since 2012.
Featured Review
Quotes From Members
We asked business professionals to review the solutions they use.
Here are some excerpts of what they said:
Pros
"The most valuable feature of Amazon Kinesis is real-time data streaming.""One of the best features of Amazon Kinesis is the multi-partition.""From my experience, one of the most valuable features is the ability to track silent events on endpoints. Previously, these events might have gone unnoticed, but now we can access them within the product range. For example, if a customer reports that their calls are not reaching the portal files, we can use this feature to troubleshoot and optimize the system.""I have worked in companies that build tools in-house. They face scaling challenges.""What turns out to be most valuable is its integration with Lambda functions because you can process the data as it comes in. As soon as data comes, you'll fire a Lambda function to process a trench of data.""The scalability is pretty good.""What I like about Amazon Kinesis is that it's very effective for small businesses. It's a well-managed solution with excellent reporting. Amazon Kinesis is also easy to use, and even a novice developer can work with it, versus Apache Kafka, which requires expertise.""Its scalability is very high. There is no maintenance and there is no throughput latency. I think data scalability is high, too. You can ingest gigabytes of data within seconds or milliseconds."

More Amazon Kinesis Pros →

"It's the fastest solution on the market with low latency data on data transformations.""Apache Spark Streaming has features like checkpointing and Streaming API that are useful.""Apache Spark Streaming was straightforward in terms of maintenance. It was actively developed, and migrating from an older to a newer version was quite simple.""Apache Spark Streaming's most valuable feature is near real-time analytics. The developers can build APIs easily for a code-steaming pipeline. The solutions have an ecosystem of integration with other stock services.""The solution is very stable and reliable.""As an open-source solution, using it is basically free.""Apache Spark Streaming is versatile. You can use it for competitive intelligence, gathering data from competitors, or for internal tasks like monitoring workflows.""The solution is better than average and some of the valuable features include efficiency and stability."

More Apache Spark Streaming Pros →

Cons
"I think the default settings are far too low.""Kinesis is good for Amazon Cloud but not as suitable for other cloud vendors.""The services which are described in the documentation could use some visual presentation because for someone who is new to the solution the documentation is not easy to follow or beginner friendly and can leave a person feeling helpless.""Could include features that make it easier to scale.""One area for improvement in the solution is the file size limitation of 10 Mb. My company works with files with a larger file size. The batch size and throughput also need improvement in Amazon Kinesis.""The solution has a two-minute maximum time delay for live streaming, which could be reduced.""One thing that would be nice would be a policy for increasing the number of Kinesis streams because that's the one thing that's constant. You can change it in real time, but somebody has to change it, or you have to set some kind of meter. So, auto-scaling of adding and removing streams would be nice.""We were charged high costs for the solution’s enhanced fan-out feature."

More Amazon Kinesis Cons →

"The solution itself could be easier to use.""It was resource-intensive, even for small-scale applications.""In terms of improvement, the UI could be better.""The cost and load-related optimizations are areas where the tool lacks and needs improvement.""The service structure of Apache Spark Streaming can improve. There are a lot of issues with memory management and latency. There is no real-time analytics. We recommend it for the use cases where there is a five-second latency, but not for a millisecond, an IOT-based, or the detection anomaly-based. Flink as a service is much better.""There could be an improvement in the area of the user configuration section, it should be less developer-focused and more business user-focused.""The initial setup is quite complex.""We would like to have the ability to do arbitrary stateful functions in Python."

More Apache Spark Streaming Cons →

Pricing and Cost Advice
  • "Under $1,000 per month."
  • "The solution's pricing is fair."
  • "It was actually a fairly high volume we were spending. We were spending about 150 a month."
  • "The fee is based on the number of hours the service is running."
  • "Amazon Kinesis pricing is sometimes reasonable and sometimes could be better, depending on the planning, so it's a five out of ten for me."
  • "In general, cloud services are very convenient to use, even if we have to pay a bit more, as we know what we are paying for and can focus on other tasks."
  • "The tool's entry price is cheap. However, pricing increases with data volume."
  • "The product falls on a bit of an expensive side."
  • More Amazon Kinesis Pricing and Cost Advice →

  • "People pay for Apache Spark Streaming as a service."
  • "I was using the open-source community version, which was self-hosted."
  • "On a scale from one to ten, where one is expensive, or not cost-effective, and ten is cheap, I rate the price a seven."
  • More Apache Spark Streaming Pricing and Cost Advice →

    report
    Use our free recommendation engine to learn which Streaming Analytics solutions are best for your needs.
    770,458 professionals have used our research since 2012.
    Questions from the Community
    Top Answer:The solution's technical support is flawless.
    Top Answer:There are certain shortcomings in the machine learning capacity offered by the product, making it an area where improvements are required. There is a need to introduce something more into the machine… more »
    Top Answer:Apache Spark Streaming is versatile. You can use it for competitive intelligence, gathering data from competitors, or for internal tasks like monitoring workflows.
    Top Answer:In terms of improvement, the UI could be better. Additionally, Spark Streaming works well for various use cases, but improvements could be made for ultra-fast scenarios where seconds matter. While… more »
    Top Answer:As a data engineer, I use Apache Spark Streaming to process real-time data for web page analytics and integrate diverse data sources into centralized data warehouses.
    Ranking
    1st
    out of 38 in Streaming Analytics
    Views
    12,325
    Comparisons
    9,068
    Reviews
    13
    Average Words per Review
    544
    Rating
    7.7
    8th
    out of 38 in Streaming Analytics
    Views
    4,104
    Comparisons
    3,301
    Reviews
    5
    Average Words per Review
    502
    Rating
    8.2
    Comparisons
    Also Known As
    Amazon AWS Kinesis, AWS Kinesis, Kinesis
    Spark Streaming
    Learn More
    Overview

    Amazon Kinesis makes it easy to collect, process, and analyze real-time, streaming data so you can get timely insights and react quickly to new information. Amazon Kinesis offers key capabilities to cost-effectively process streaming data at any scale, along with the flexibility to choose the tools that best suit the requirements of your application. With Amazon Kinesis, you can ingest real-time data such as video, audio, application logs, website clickstreams, and IoT telemetry data for machine learning, analytics, and other applications. Amazon Kinesis enables you to process and analyze data as it arrives and respond instantly instead of having to wait until all your data is collected before the processing can begin.

    Spark Streaming makes it easy to build scalable fault-tolerant streaming applications.

    Sample Customers
    Zillow, Netflix, Sonos
    UC Berkeley AMPLab, Amazon, Alibaba Taobao, Kenshoo, eBay Inc.
    Top Industries
    REVIEWERS
    Computer Software Company29%
    Media Company29%
    Transportation Company14%
    Non Tech Company14%
    VISITORS READING REVIEWS
    Computer Software Company17%
    Financial Services Firm17%
    Manufacturing Company8%
    Comms Service Provider5%
    VISITORS READING REVIEWS
    Financial Services Firm20%
    Computer Software Company19%
    Comms Service Provider7%
    Manufacturing Company5%
    Company Size
    REVIEWERS
    Small Business36%
    Midsize Enterprise36%
    Large Enterprise27%
    VISITORS READING REVIEWS
    Small Business21%
    Midsize Enterprise12%
    Large Enterprise67%
    REVIEWERS
    Small Business60%
    Midsize Enterprise10%
    Large Enterprise30%
    VISITORS READING REVIEWS
    Small Business21%
    Midsize Enterprise11%
    Large Enterprise68%
    Buyer's Guide
    Amazon Kinesis vs. Apache Spark Streaming
    March 2024
    Find out what your peers are saying about Amazon Kinesis vs. Apache Spark Streaming and other solutions. Updated: March 2024.
    770,458 professionals have used our research since 2012.

    Amazon Kinesis is ranked 1st in Streaming Analytics with 24 reviews while Apache Spark Streaming is ranked 8th in Streaming Analytics with 8 reviews. Amazon Kinesis is rated 8.0, while Apache Spark Streaming is rated 8.0. The top reviewer of Amazon Kinesis writes "Used for media streaming and live-streaming data". On the other hand, the top reviewer of Apache Spark Streaming writes "Easy integration, beneficial auto-scaling, and good open-sourced support community". Amazon Kinesis is most compared with Azure Stream Analytics, Amazon MSK, Confluent, Apache Flink and Databricks, whereas Apache Spark Streaming is most compared with Spring Cloud Data Flow, Azure Stream Analytics, Confluent, Apache Pulsar and Starburst Enterprise. See our Amazon Kinesis vs. Apache Spark Streaming report.

    See our list of best Streaming Analytics vendors.

    We monitor all Streaming Analytics reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.