AWS Data Pipeline [EOL] vs Confluent comparison

Cancel
You must select at least 2 products to compare!
Amazon Web Services (AWS) Logo
views| comparisons
100% willing to recommend
Confluent Logo
10,171 views|7,826 comparisons
100% willing to recommend
Comparison Buyer's Guide
Executive Summary

We performed a comparison between AWS Data Pipeline [EOL] and Confluent based on real PeerSpot user reviews.

Find out in this report how the two Cloud Data Integration solutions compare in terms of features, pricing, service and support, easy of deployment, and ROI.
To learn more, read our detailed AWS Data Pipeline [EOL] vs. Confluent Report (Updated: March 2024).
767,667 professionals have used our research since 2012.
Featured Review
Quotes From Members
We asked business professionals to review the solutions they use.
Here are some excerpts of what they said:
Pros
"It is a stable solution...It is a scalable solution.""The most valuable feature of the solution is that orchestration and development capabilities are easier with the tool."

More AWS Data Pipeline [EOL] Pros →

"Confluence's greatest asset is its user-friendly interface, coupled with its remarkable ability to seamlessly integrate with a vast range of other solutions.""We mostly use the solution's message queues and event-driven architecture.""One of the best features of Confluent is that it's very easy to search and have a live status with Jira.""I find Confluent's Kafka Connectors and Kafka Streams invaluable for my use cases because they simplify real-time data processing and ETL tasks by providing reliable, pre-packaged connectors and tools.""The solution can handle a high volume of data because it works and scales well.""A person with a good IT background and HTML will not have any trouble with Confluent.""The monitoring module is impressive.""I would rate the scalability of the solution at eight out of ten. We have 20 people who use Confluent in our organization now, and we hope to increase usage in the future."

More Confluent Pros →

Cons
"The user-defined functions have shortcomings in AWS Data Pipeline.""It's almost semi-automatic because you must review and approve code push, which works well. Still, we had many problems getting there during the deployment process, but we got there."

More AWS Data Pipeline [EOL] Cons →

"Confluence could improve the server version of the solution. However, most companies are going to the cloud.""It could have more integration with different platforms.""It would help if the knowledge based documents in the support portal could be available for public use as well.""The formatting aspect within the page can be improved and more powerful.""The Schema Registry service could be improved. I would like a bigger knowledge base of other use cases and more technical forums. It would be good to have more flexible monitoring features added to the next release as well.""The pricing model should include the ability to pick features and be charged for them only.""Confluent's price needs improvement.""Currently, in the early stages, I see a gap on the security side. If you are using the SaaS version, we would like to get a fuller, more secure solution that can be adopted right out of the box. Confluence could do a better job sharing best practices or a reusable pattern that others have used, especially for companies that can not afford to hire professional services from Confluent."

More Confluent Cons →

Pricing and Cost Advice
  • "The way we use it, I think it is fair as we're getting a good value for money compared to having a server or some other data pipeline."
  • "I rate the pricing between six to eight on a scale from one to ten, where one is low price, and ten is high price."
  • More AWS Data Pipeline [EOL] Pricing and Cost Advice →

  • "Confluent is expensive, I would prefer, Apache Kafka over Confluent because of the high cost of maintenance."
  • "You have to pay additional for one or two features."
  • "The pricing model of Confluent could improve because if you have a classic use case where you're going to use all the features there is no plan to reduce the features. You should be able to pick and choose basic services at a reduced price. The pricing was high for our needs. We should not have to pay for features we do not use."
  • "On a scale from one to ten, where one is low pricing and ten is high pricing, I would rate Confluent's pricing at five. I have not encountered any additional costs."
  • "Confluence's pricing is quite reasonable, with a cost of around $10 per user that decreases as the number of users increases. Additionally, it's worth noting that for teams of up to 10 users, the solution is completely free."
  • "Confluent has a yearly license, which is a bit high because it's on a per-user basis."
  • "It comes with a high cost."
  • "Confluent is highly priced."
  • More Confluent Pricing and Cost Advice →

    report
    Use our free recommendation engine to learn which Cloud Data Integration solutions are best for your needs.
    767,667 professionals have used our research since 2012.
    Questions from the Community
    Top Answer:The most valuable feature of the solution is that orchestration and development capabilities are easier with the tool.
    Top Answer:I rate the pricing between six to eight on a scale from one to ten, where one is low price, and ten is high price.
    Top Answer:The user-defined functions have shortcomings in AWS Data Pipeline. The user-defined functions could be one of the areas where I can write a custom function and embed it as a part of AWS Data Pipeline… more »
    Top Answer:I find Confluent's Kafka Connectors and Kafka Streams invaluable for my use cases because they simplify real-time data processing and ETL tasks by providing reliable, pre-packaged connectors and… more »
    Top Answer:I would rate the pricing of Confluent as average, around a five out of ten. Additional costs could include features like multi-tenancy support and native encryption with custom algorithms, which would… more »
    Top Answer:Areas for improvement include implementing multi-storage support to differentiate between database stores based on data age and optimizing storage costs, as well as enhancing the offset management… more »
    Ranking
    Unranked
    In Cloud Data Integration
    3rd
    out of 38 in Streaming Analytics
    Views
    10,171
    Comparisons
    7,826
    Reviews
    11
    Average Words per Review
    413
    Rating
    8.5
    Comparisons
    Learn More
    Overview

    AWS Data Pipeline is a web service that helps you reliably process and move data between different AWS compute and storage services, as well as on-premises data sources, at specified intervals. ... AWS Data Pipeline also allows you to move and process data that was previously locked up in on-premises data silos.

    Confluent is an enterprise-ready, full-scale streaming platform that enhances Apache Kafka. 

    Confluent has integrated cutting-edge features that are designed to enhance these tasks: 

    • Speed up application development and connectivity
    • Enable transformations through stream processing
    • Streamline business operations at scale
    • Adhere to strict architectural standards

    Confluent is a more complete distribution of Kafka in that it enhances the integration possibilities of Kafka by introducing tools for managing and optimizing Kafka clusters while providing methods for making sure the streams are secure. Confluent supports publish-and-subscribe as well as the storing and processing of data within the streams. Kafka is easier to operate and build thanks to Confluent.

    Confluent's software is available in three different varieties: 

    1. A free, open-source streaming platform that makes it simple to start using real-time data streams
    2. An enterprise-grade version of the product with more administrative, ops, and monitoring tools
    3. A premium cloud-based version.

    Confluent Advantage Features

    Confluent has many valuable key features. Some of the most useful ones include:

    • Multi-language

      • Clients: C++, Python, Go, and .NET
      • REST proxy: Can connect to Kafka from any connected network device
      • Admin REST APIs: RESTful interface for performing administrator operations
    • Pre-built ecosystem

      • Connectors: More than 100 supported connectors, including S3, Elastic, HDFS, JDBC
      • MQTT proxy: Gain access to Kafka from MQTT gateways and devices
      • Schema registry: Centralized database to guarantee data compatibility
    • Streaming database

      • ksqlDB: Materialized views and real-time stream processing
    • GUI management 

      • Control panel: GUI for scalable Kafka management and monitoring
      • Health+: Smart alerts and cloud-based control centers
    • DevOps automation that is flexible

      • Confluent for Kubernetes: Complete API to deploy on Kubernetes
      • Automated Ansible deployment on non-containerized environments
    • Dynamic performance 

      • Self-balancing clusters: Automated partition re-balancing across brokers in the cluster
      • Tiered storage: Older Kafka data offloading to object storage with transparent access
    • Security that is enterprise-grade 

      • Role-based access control: Granular user/group access authorization
      • Audit logs that are structured: Logs of user actions kept in dedicated Kafka topics
      • Secret protection: Sensitive information is encrypted
    • Global resilience

      • Linking clusters: A real-time, highly reliable, and consistent bridge across on-premises and cloud environments
      • Multiple-region clusters: Single Kafka cluster with automated client failover distributed across multiple data centers
      • Replicator: Asynchronous replication that is based on the Kafka Connect framework
    • Support

      • Round the clock enterprise support from Kafka experts

    Reviews from Real Users

    Confluent stands out among its competitors for a number of reasons. Two major ones are its robust enterprise support and its open source option. PeerSpot users take note of the advantages of these features in their reviews: 

    Ravi B., a solutions architect at a tech services company, writes of the solution, “KSQL is a valuable feature, as is the Kafka Connect framework for connecting to the various source systems where you need not write the code. We get great support from Confluent because we're using the enterprise version and whenever there's a problem, they support us with fine-tuning and finding the root cause.”

    Amit S., an IT consultant, notes, “The biggest benefit is that it is open source. You have the flexibility of opting or not opting for enterprise support, even though the tool itself is open source.” He adds, “The second benefit is it's very modern and built on Java and Scala. You can extend the features very well, and it doesn't take a lot of effort to do so.”

    Sample Customers
    bp, Cerner, Expedia, Finra, HESS, intuit, Kellog's, Philips, TIME, workday
    ING, Priceline.com, Nordea, Target, RBC, Tivo, Capital One, Chartboost
    Top Industries
    VISITORS READING REVIEWS
    Computer Software Company21%
    Financial Services Firm18%
    Government9%
    Manufacturing Company7%
    REVIEWERS
    Computer Software Company31%
    Retailer15%
    Non Tech Company8%
    Government8%
    VISITORS READING REVIEWS
    Financial Services Firm19%
    Computer Software Company17%
    Manufacturing Company8%
    Retailer6%
    Company Size
    VISITORS READING REVIEWS
    Small Business20%
    Midsize Enterprise15%
    Large Enterprise65%
    REVIEWERS
    Small Business26%
    Midsize Enterprise21%
    Large Enterprise53%
    VISITORS READING REVIEWS
    Small Business19%
    Midsize Enterprise12%
    Large Enterprise69%
    Buyer's Guide
    AWS Data Pipeline [EOL] vs. Confluent
    March 2024
    Find out what your peers are saying about AWS Data Pipeline [EOL] vs. Confluent and other solutions. Updated: March 2024.
    767,667 professionals have used our research since 2012.

    AWS Data Pipeline [EOL] doesn't meet the minimum requirements to be ranked in Cloud Data Integration with 2 reviews while Confluent is ranked 3rd in Streaming Analytics with 19 reviews. AWS Data Pipeline [EOL] is rated 8.0, while Confluent is rated 8.4. The top reviewer of AWS Data Pipeline [EOL] writes "A tool with great orchestration and development capabilities but needs to improve its user-defined functions". On the other hand, the top reviewer of Confluent writes "Has good technical support services and a valuable feature for real-time data streaming ". AWS Data Pipeline [EOL] is most compared with AWS Database Migration Service, AWS Glue, Oracle Data Integrator (ODI), FME and Perspectium DataSync, whereas Confluent is most compared with Amazon MSK, Amazon Kinesis, Databricks, AWS Glue and Oracle GoldenGate. See our AWS Data Pipeline [EOL] vs. Confluent report.

    See our list of best Cloud Data Integration vendors.

    We monitor all Cloud Data Integration reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.