Amazon Kinesis vs Apache Spark Streaming comparison

Cancel
You must select at least 2 products to compare!
Amazon Web Services (AWS) Logo
12,728 views|9,386 comparisons
90% willing to recommend
Apache Logo
4,308 views|3,491 comparisons
88% willing to recommend
Comparison Buyer's Guide
Executive Summary

We performed a comparison between Amazon Kinesis and Apache Spark Streaming based on real PeerSpot user reviews.

Find out in this report how the two Streaming Analytics solutions compare in terms of features, pricing, service and support, easy of deployment, and ROI.
To learn more, read our detailed Amazon Kinesis vs. Apache Spark Streaming Report (Updated: March 2024).
768,415 professionals have used our research since 2012.
Featured Review
Quotes From Members
We asked business professionals to review the solutions they use.
Here are some excerpts of what they said:
Pros
"Everything is hosted and simple.""From my experience, one of the most valuable features is the ability to track silent events on endpoints. Previously, these events might have gone unnoticed, but now we can access them within the product range. For example, if a customer reports that their calls are not reaching the portal files, we can use this feature to troubleshoot and optimize the system.""Kinesis is a fully managed program streaming application. You can manage any infrastructure. It is also scalable. Kinesis can handle any amount of data streaming and process data from hundreds, thousands of processes in every source with very low latency.""Setting Amazon Kinesis up is quick and easy; it only takes a few minutes to configure the necessary settings and start using it.""The solution's technical support is flawless.""The scalability is pretty good.""The solution has the capacity to store the data anywhere from one day to a week and provides limitless storage for us.""I have worked in companies that build tools in-house. They face scaling challenges."

More Amazon Kinesis Pros →

"Apache Spark Streaming is versatile. You can use it for competitive intelligence, gathering data from competitors, or for internal tasks like monitoring workflows.""The solution is better than average and some of the valuable features include efficiency and stability.""Apache Spark Streaming was straightforward in terms of maintenance. It was actively developed, and migrating from an older to a newer version was quite simple.""Apache Spark Streaming has features like checkpointing and Streaming API that are useful.""As an open-source solution, using it is basically free.""The solution is very stable and reliable.""Apache Spark Streaming's most valuable feature is near real-time analytics. The developers can build APIs easily for a code-steaming pipeline. The solutions have an ecosystem of integration with other stock services.""It's the fastest solution on the market with low latency data on data transformations."

More Apache Spark Streaming Pros →

Cons
"Amazon Kinesis should improve its limits.""Lacks first in, first out queuing.""Kinesis can be expensive, especially when dealing with large volumes of data.""In general, the pain point for us was that once the data gets into Kinesis there is no way for us to understand what's happening because Kinesis divides everything into shards. So if we wanted to understand what's happening with a particular shard, whether it is published or not, we could not. Even with the logs, if we want to have some kind of logging it is in the shard.""Amazon Kinesis involved a more complex setup and configuration than Azure Event Hub.""There are certain shortcomings in the machine learning capacity offered by the product, making it an area where improvements are required.""The services which are described in the documentation could use some visual presentation because for someone who is new to the solution the documentation is not easy to follow or beginner friendly and can leave a person feeling helpless.""One area for improvement in the solution is the file size limitation of 10 Mb. My company works with files with a larger file size. The batch size and throughput also need improvement in Amazon Kinesis."

More Amazon Kinesis Cons →

"The service structure of Apache Spark Streaming can improve. There are a lot of issues with memory management and latency. There is no real-time analytics. We recommend it for the use cases where there is a five-second latency, but not for a millisecond, an IOT-based, or the detection anomaly-based. Flink as a service is much better.""There could be an improvement in the area of the user configuration section, it should be less developer-focused and more business user-focused.""In terms of improvement, the UI could be better.""We would like to have the ability to do arbitrary stateful functions in Python.""The solution itself could be easier to use.""The cost and load-related optimizations are areas where the tool lacks and needs improvement.""The initial setup is quite complex.""It was resource-intensive, even for small-scale applications."

More Apache Spark Streaming Cons →

Pricing and Cost Advice
  • "Under $1,000 per month."
  • "The solution's pricing is fair."
  • "It was actually a fairly high volume we were spending. We were spending about 150 a month."
  • "The fee is based on the number of hours the service is running."
  • "Amazon Kinesis pricing is sometimes reasonable and sometimes could be better, depending on the planning, so it's a five out of ten for me."
  • "In general, cloud services are very convenient to use, even if we have to pay a bit more, as we know what we are paying for and can focus on other tasks."
  • "The tool's entry price is cheap. However, pricing increases with data volume."
  • "The product falls on a bit of an expensive side."
  • More Amazon Kinesis Pricing and Cost Advice →

  • "People pay for Apache Spark Streaming as a service."
  • "I was using the open-source community version, which was self-hosted."
  • "On a scale from one to ten, where one is expensive, or not cost-effective, and ten is cheap, I rate the price a seven."
  • More Apache Spark Streaming Pricing and Cost Advice →

    report
    Use our free recommendation engine to learn which Streaming Analytics solutions are best for your needs.
    768,415 professionals have used our research since 2012.
    Questions from the Community
    Top Answer:The solution's technical support is flawless.
    Top Answer:There are certain shortcomings in the machine learning capacity offered by the product, making it an area where improvements are required. There is a need to introduce something more into the machine… more »
    Top Answer:Apache Spark Streaming is versatile. You can use it for competitive intelligence, gathering data from competitors, or for internal tasks like monitoring workflows.
    Top Answer:In terms of improvement, the UI could be better. Additionally, Spark Streaming works well for various use cases, but improvements could be made for ultra-fast scenarios where seconds matter. While… more »
    Top Answer:As a data engineer, I use Apache Spark Streaming to process real-time data for web page analytics and integrate diverse data sources into centralized data warehouses.
    Ranking
    2nd
    out of 38 in Streaming Analytics
    Views
    12,728
    Comparisons
    9,386
    Reviews
    8
    Average Words per Review
    562
    Rating
    7.9
    8th
    out of 38 in Streaming Analytics
    Views
    4,308
    Comparisons
    3,491
    Reviews
    6
    Average Words per Review
    473
    Rating
    8.2
    Comparisons
    Also Known As
    Amazon AWS Kinesis, AWS Kinesis, Kinesis
    Spark Streaming
    Learn More
    Overview

    Amazon Kinesis makes it easy to collect, process, and analyze real-time, streaming data so you can get timely insights and react quickly to new information. Amazon Kinesis offers key capabilities to cost-effectively process streaming data at any scale, along with the flexibility to choose the tools that best suit the requirements of your application. With Amazon Kinesis, you can ingest real-time data such as video, audio, application logs, website clickstreams, and IoT telemetry data for machine learning, analytics, and other applications. Amazon Kinesis enables you to process and analyze data as it arrives and respond instantly instead of having to wait until all your data is collected before the processing can begin.

    Spark Streaming makes it easy to build scalable fault-tolerant streaming applications.

    Sample Customers
    Zillow, Netflix, Sonos
    UC Berkeley AMPLab, Amazon, Alibaba Taobao, Kenshoo, eBay Inc.
    Top Industries
    REVIEWERS
    Computer Software Company29%
    Media Company29%
    Transportation Company14%
    Non Tech Company14%
    VISITORS READING REVIEWS
    Computer Software Company17%
    Financial Services Firm17%
    Manufacturing Company8%
    Comms Service Provider5%
    VISITORS READING REVIEWS
    Financial Services Firm20%
    Computer Software Company19%
    Comms Service Provider7%
    Manufacturing Company6%
    Company Size
    REVIEWERS
    Small Business36%
    Midsize Enterprise36%
    Large Enterprise27%
    VISITORS READING REVIEWS
    Small Business21%
    Midsize Enterprise12%
    Large Enterprise67%
    REVIEWERS
    Small Business60%
    Midsize Enterprise10%
    Large Enterprise30%
    VISITORS READING REVIEWS
    Small Business21%
    Midsize Enterprise11%
    Large Enterprise68%
    Buyer's Guide
    Amazon Kinesis vs. Apache Spark Streaming
    March 2024
    Find out what your peers are saying about Amazon Kinesis vs. Apache Spark Streaming and other solutions. Updated: March 2024.
    768,415 professionals have used our research since 2012.

    Amazon Kinesis is ranked 2nd in Streaming Analytics with 21 reviews while Apache Spark Streaming is ranked 8th in Streaming Analytics with 8 reviews. Amazon Kinesis is rated 8.0, while Apache Spark Streaming is rated 8.0. The top reviewer of Amazon Kinesis writes "Used for media streaming and live-streaming data". On the other hand, the top reviewer of Apache Spark Streaming writes "Easy integration, beneficial auto-scaling, and good open-sourced support community". Amazon Kinesis is most compared with Azure Stream Analytics, Apache Flink, Amazon MSK, Confluent and Databricks, whereas Apache Spark Streaming is most compared with Azure Stream Analytics, Spring Cloud Data Flow, Confluent, Apache Pulsar and Starburst Enterprise. See our Amazon Kinesis vs. Apache Spark Streaming report.

    See our list of best Streaming Analytics vendors.

    We monitor all Streaming Analytics reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.