Amazon SQS vs Apache Kafka comparison

Cancel
You must select at least 2 products to compare!
Amazon Web Services (AWS) Logo
6,473 views|5,673 comparisons
87% willing to recommend
Apache Logo
14,664 views|11,146 comparisons
95% willing to recommend
Comparison Buyer's Guide
Executive Summary
Updated on Mar 6, 2024

We compared Apache Kafka and Amazon SQS based on our user's reviews in several parameters.

Apache Kafka stands out for its high scalability, fault-tolerant architecture, real-time data handling, stream processing, and data replication support. On the other hand, Amazon SQS is praised for its reliability, scalability, and ability to decouple application components seamlessly. While Apache Kafka offers easy integration with programming languages and frameworks, Amazon SQS provides efficient message handling for large volumes. Overall, Apache Kafka focuses on real-time data processing and stream processing, while Amazon SQS emphasizes reliable message handling and decoupling application components.

Features: Apache Kafka is highly valued for its high scalability, fault-tolerant architecture, and support for real-time data handling. It also offers seamless integration with programming languages and frameworks, and functionalities like stream processing and data replication. On the other hand, Amazon SQS is highly appreciated for its reliability, scalability, and the ability to decouple different components of an application, allowing for seamless integration and flexibility. It efficiently handles large volumes of messages.

Pricing and ROI: The available data did not provide any information about the setup cost for Apache Kafka. There were no details about the pricing, setup cost, and licensing for Amazon SQS from the reviewers., The ROI reviews for Apache Kafka are missing or unavailable, while for Amazon SQS, they are not available.

Room for Improvement: Apache Kafka: No specific feedback is available regarding areas for improvement. Amazon SQS: No specific feedback or suggestions have been provided for improvement.

Deployment and customer support: The given data source does not provide any user feedback specifically about the duration required to establish a new tech solution for Apache Kafka. Similarly, there is no specific information or quotes available regarding the setup time for Amazon SQS., Customer service and support for Apache Kafka cannot be compared as no reviews or feedback are available. Similarly, there are no reviews for customer service of Amazon SQS.

The summary above is based on 46 interviews we conducted recently with Apache Kafka and Amazon SQS users. To access the review's full transcripts, download our report.

To learn more, read our detailed Amazon SQS vs. Apache Kafka Report (Updated: March 2024).
769,630 professionals have used our research since 2012.
Featured Review
Quotes From Members
We asked business professionals to review the solutions they use.
Here are some excerpts of what they said:
Pros
"There is no setup just some easy configuration required.""We use the tool in interface integrations.""We use SNS as the publisher, and our procurement service subscribes to those events using SQS. In the past, we relied on time-based or batch-based processes to send data between services on-premises. With SQS, we can trigger actions based on real-time changes in business processes, improving reliability.""It is stable and scalable.""The most valuable feature of Amazon SQS is the interface.""One of the useful features is the ability to schedule a call after a certain number of messages accumulate in the container. For example, if there are ten messages in the container, you can perform a specific action.""With SQS, we can trigger events in various cloud environments. It offers numerous benefits for us.""The libraries that connect and manage the queues are rich in features."

More Amazon SQS Pros →

"When comparing it with other messaging and integration platforms, this is one of the best rated.""Resiliency is great and also the fact that it handles different data formats.""Kafka is scalable. It can manage a high volume of data from many sources.""The most valuable feature of Apache Kafka is Kafka Connect.""Good horizontal scaling and design.""Robust and delivers messages quickly.""Kafka can process messages in real-time, making it useful for applications that require near-instantaneous processing.""It is the performance that is really meaningful."

More Apache Kafka Pros →

Cons
"The current visibility timeout of five minutes is okay. However, I'd like to explore the possibility of extending it for specific use cases.""Support could be improved.""Be cautious around pay-as-you-use licensing as costs can become expensive.""The solution is not available on-premises so that rules out any customers looking for the messaging solution on-premises.""I cannot send a message to multiple people simultaneously. It can only be sent to one recipient.""I do not think that this solution is easy to use and the documentation of this solution has a lot of problems and can be improved in the next release. Most of the time, the images in the document are from older versions.""There are some issues with SQS's transaction queue regarding knowing if something has been received.""Sometimes, we have to switch to another component similar to SQS because the patching tool for SQS is relatively slow for us."

More Amazon SQS Cons →

"The model where you create the integration or the integration scenario needs improvement.""It's not possible to substitute IBM MQ with Apache Kafka because the JMS part is not very stable.""Kafka is complex and there is a little bit of a learning curve.""Pulsar gives more scalability to an even grouping, but Apache Kafka is used more if you want to send something in a time series-based. If this does not matter to you then Pulsar could be more customizable. Apache Kafka is nothing but a streaming system with local storage.""Kafka is a nightmare to administer.""Lacks elasticity and the ability to scale down.""Managing Apache Kafka can be a challenge, but there are solutions. I used the newest release, as it seems they have removed Zookeeper, which should make it easier. Confluent provides a fully managed Kafka platform, in which the cluster does not need to be managed.""Data pulling and restart ability need improving."

More Apache Kafka Cons →

Pricing and Cost Advice
  • "Amazon SQS is more affordable compared to other solutions."
  • "The pricing of Amazon SQS is reasonable. The first million requests are free every month, and after, it's cost 40 cents for every million requests. There are not any additional fees."
  • "Amazon SQS is quite expensive and is at the highest price point compared to other solutions."
  • "SQS's pricing is very good - I would rate it nine out of ten."
  • "The pricing model is pay-as-you-use. It depends on your usage and configuration."
  • "Amazon SQS is moderately priced."
  • "It's quite expensive."
  • More Amazon SQS Pricing and Cost Advice →

  • "I would not subscribe to the Confluent platform, but rather stay on the free open source version. The extra cost wasn't justified."
  • "When starting to look at a distributed message system, look for a cloud solution first. It is an easier entry point than an on-premises hardware solution."
  • "It is open source software."
  • "Licensing issues are not applicable. Apache licensing makes it simple with almost zero cost for the software itself."
  • "Apache Kafka is open-source and can be used free of charge."
  • "Kafka is open-source and it is cheaper than any other product."
  • "Kafka is more reasonably priced than IBM MQ."
  • "The solution is open source; it's free to use."
  • More Apache Kafka Pricing and Cost Advice →

    report
    Use our free recommendation engine to learn which Message Queue (MQ) Software solutions are best for your needs.
    769,630 professionals have used our research since 2012.
    Questions from the Community
    Top Answer:The tool I use to transform and move data can read the entries from Amazon SQS. For example, to start some workflow orchestration, it checks Amazon SQS, reads new messages from it, and then runs some… more »
    Top Answer:Apache Kafka is open source and can be used for free. It has very good log management and has a way to store the data used for analytics. Apache Kafka is very good if you have a high number of users… more »
    Top Answer:Apache Kafka is an open-source solution that can be used for messaging or event processing.
    Ranking
    Views
    6,473
    Comparisons
    5,673
    Reviews
    12
    Average Words per Review
    378
    Rating
    8.2
    Views
    14,664
    Comparisons
    11,146
    Reviews
    32
    Average Words per Review
    553
    Rating
    8.1
    Comparisons
    Redis logo
    Compared 22% of the time.
    Amazon MQ logo
    Compared 14% of the time.
    Anypoint MQ logo
    Compared 10% of the time.
    IBM MQ logo
    Compared 8% of the time.
    IBM MQ logo
    Compared 24% of the time.
    Red Hat AMQ logo
    Compared 13% of the time.
    Anypoint MQ logo
    Compared 12% of the time.
    PubSub+ Event Broker logo
    Compared 11% of the time.
    VMware RabbitMQ logo
    Compared 6% of the time.
    Learn More
    Overview

    Amazon Simple Queue Service (SQS) is a fully managed message queuing service that enables you to decouple and scale microservices, distributed systems, and serverless applications. SQS eliminates the complexity and overhead associated with managing and operating message oriented middleware, and empowers developers to focus on differentiating work. Using SQS, you can send, store, and receive messages between software components at any volume, without losing messages or requiring other services to be available. Get started with SQS in minutes using the AWS console, Command Line Interface or SDK of your choice, and three simple commands.

    SQS offers two types of message queues. Standard queues offer maximum throughput, best-effort ordering, and at-least-once delivery. SQS FIFO queues are designed to guarantee that messages are processed exactly once, in the exact order that they are sent.

    Apache Kafka is a highly regarded open-source, distributed event streaming platform and Message Queue (MQ) software solution that is valued and trusted worldwide by many of the top fortune 100 companies. It is considered one of the most reliable Message Queue (MQ) software solutions available in the marketplace today.

    Enterprise organizations rely on streaming platforms and MQ software solutions to process the continuous flow of high-performance data pipelines, mission-critical applications, and data integration. Apache Kafka makes it easy to process and distribute messages from one application to another from multiple environments with super-fast speeds and very high reliability.

    Additionally, in place of the usual command line processes regarding administration and management tasks, Apache Kafka supplies five exemplary core APIs for both Scala and Java:

    • Kafka Streams API can be used to facilitate stream processing applications and microservices. Input is seamlessly read from one or more topics and will initiate output to one or more topics, easily converting the input streams to output streams.
    • Kafka Connect API enables users to develop and run reusable data import/export connectors that are able to read and write streams of events from external operating systems and applications, making integration with Apache Kafka simple and streamlined.
    • Consumer API allows users to subscribe and read one or more topics and to process the stream of events produced to them.
    • Admin API gives users the ability to examine and manage brokers, topics, and various other Kafka topics.
    • Producer API using this core element, users are able to write and publish a stream of events to one or more Kafka topics.

    Apache Kafka Benefits

    Apache Kafka has many valuable benefits. Some of its most valuable benefits include:

    • Load Shifting
    • Scalability
    • Decoupling
    • High Throughput
    • High Availability
    • Safe Permanent Storage
    • Excellent Integration Capabilities
    • Large, Reliable, Open-Source Community
    • Mission Critical
    • Wide Array of Available Learning Opportunities

    Not only is Apache Kafka a robust messaging queue it is also a tremendously durable and reliable streaming platform that is fully capable of securely delivering more than one million messages per second, which amounts to trillions of success delivered messages in one day.

    Reviews from Real Users

    “From my experience with Apache Kafka, one of the most notable advantages is its ability to maintain a comprehensive record of historical data that includes every update, alteration, and version of information, unlike a conventional relational database. This feature allows for seamless tracking and analysis of the progression and transformation of the data over time, enabling users to easily review and analyze the history of the information.” Dimitrios Z., Enterprise Architect at Smals vzw

    “We are currently on a legacy version and have found that the latest version of Kafka has solved many of the issues we were facing, such as sequencing, memory management, and more. Additionally, the fact that it is open source is a major benefit.” Pratul S. Software Engineer at a financial services firm

    “The solution has improved our functionality; it's one of the best streaming platforms I've used.” Sreekar N., Co-Founder at Attaika

    Sample Customers
    EMS, NASA, BMW, Capital One
    Uber, Netflix, Activision, Spotify, Slack, Pinterest
    Top Industries
    REVIEWERS
    Financial Services Firm43%
    Manufacturing Company29%
    University14%
    Computer Software Company14%
    VISITORS READING REVIEWS
    Financial Services Firm18%
    Computer Software Company15%
    Manufacturing Company8%
    Comms Service Provider7%
    REVIEWERS
    Financial Services Firm26%
    Computer Software Company18%
    Retailer15%
    Manufacturing Company8%
    VISITORS READING REVIEWS
    Financial Services Firm29%
    Computer Software Company13%
    Manufacturing Company6%
    Retailer5%
    Company Size
    REVIEWERS
    Small Business27%
    Midsize Enterprise13%
    Large Enterprise60%
    VISITORS READING REVIEWS
    Small Business20%
    Midsize Enterprise13%
    Large Enterprise67%
    REVIEWERS
    Small Business35%
    Midsize Enterprise15%
    Large Enterprise51%
    VISITORS READING REVIEWS
    Small Business16%
    Midsize Enterprise10%
    Large Enterprise73%
    Buyer's Guide
    Amazon SQS vs. Apache Kafka
    March 2024
    Find out what your peers are saying about Amazon SQS vs. Apache Kafka and other solutions. Updated: March 2024.
    769,630 professionals have used our research since 2012.

    Amazon SQS is ranked 4th in Message Queue (MQ) Software with 13 reviews while Apache Kafka is ranked 1st in Message Queue (MQ) Software with 76 reviews. Amazon SQS is rated 8.2, while Apache Kafka is rated 8.0. The top reviewer of Amazon SQS writes "Stable, useful interface, and scales well". On the other hand, the top reviewer of Apache Kafka writes "Real-time processing and reliable for data integrity". Amazon SQS is most compared with Redis, Amazon MQ, Anypoint MQ, Oracle Event Hub Cloud Service and IBM MQ, whereas Apache Kafka is most compared with IBM MQ, Red Hat AMQ, Anypoint MQ, PubSub+ Event Broker and VMware RabbitMQ. See our Amazon SQS vs. Apache Kafka report.

    See our list of best Message Queue (MQ) Software vendors.

    We monitor all Message Queue (MQ) Software reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.