Apache Kafka vs Oracle Data Integrator (ODI) comparison

Cancel
You must select at least 2 products to compare!
Apache Logo
14,022 views|10,578 comparisons
95% willing to recommend
Oracle Logo
14,448 views|8,337 comparisons
84% willing to recommend
Comparison Buyer's Guide
Executive Summary

We performed a comparison between Apache Kafka and Oracle Data Integrator (ODI) based on real PeerSpot user reviews.

Find out what your peers are saying about Apache, IBM, VMware and others in Message Queue (MQ) Software.
To learn more, read our detailed Message Queue (MQ) Software Report (Updated: May 2024).
772,679 professionals have used our research since 2012.
Q&A Highlights
Question: Which ETL tool would you recommend to populate data from OLTP to OLAP?
Answer: We have experiences only in Pentaho Data Integrator (open source competitor of the Oracle Data Integrator). But OLAP exporting wasn't in our scope until now.
Featured Review
Quotes From Members
We asked business professionals to review the solutions they use.
Here are some excerpts of what they said:
Pros
"Kafka can process messages in real-time, making it useful for applications that require near-instantaneous processing.""Its availability is brilliant.""The solution is very scalable. We started with a cluster of three and then scaled it to seven.""The stream processing is a very valuable aspect of the solution for us.""For example, when you want to send a message to inform all your clients about a new feature, you can publish that message to a single topic in Apache Kafka. This allows all clients subscribed to that topic to receive the message. On the other hand, if you need to send billing information to a specific customer, you can publish that message on a topic dedicated to that customer. This message can then be sent as an SMS to the customer, allowing them to view it on their mobile device.""Resiliency is great and also the fact that it handles different data formats.""Excellent speeds for publishing messages faster.""Robust and delivers messages quickly."

More Apache Kafka Pros →

"The Knowledge Module approach provides an easy and reusable way to create our own integration strategies. It's easy to create these Knowledge Modules to connect to new technologies, for instance.""ODI's most valuable features are it utilizes the database engine and is very lightweight.""I do not have to maintain a separate ETL instance. I can change the SQL when something is not performing correctly.""ODI's best features are customization, integration with other versioning tools, and the ability to define new knowledge modules.""The most valuable features of ODI are the knowledge modules, such as the Loading Knowledge module and the Check Knowledge module, they are helpful. We can check for the constraints in ODI. That helps in figuring out what are the constraints that are the primary keys created in the tables. We can check them with the Check Knowledge module.""Easy to understand, very developer-friendly, and has a big forum community and lots of documentation for support.""​All our systems can be widely integrated by ODI, such as transactional systems, our data warehouses, and B2B integration.""The most valuable features of ODI are the ease of development, you can have a template, and you can onboard transfer very quickly. There's a lot of knowledge modules available that we can use. If you want to connect, for example, a Sibyl, SQL, Oracle, or different products, we don't have to develop them from scratch. They are available, but if it's not, we can go into the marketplace and see if there's a connector there. Having the connector available reduces the amount of hard work needed. We only have to put the inputs and outputs. In some of the products, we use there is already integration available for ODI, which is helpful."

More Oracle Data Integrator (ODI) Pros →

Cons
"I would like to see monitoring service tools.""Lacks elasticity and the ability to scale down.""Kafka 2.0 has been released for over a month, and I wanted to try out the new features. However, the configuration is a little bit complicated: Kafka Broker, Kafka Manager, ZooKeeper Servers, etc.""Apache Kafka can improve by adding a feature out of the box which allows it to deliver only one message.""In the next release, I would like for there to be some authorization and HTL security.""I would like to see an improvement in authentication management.""The solution can improve its cloud support.""The graphical user environment is currently lacking."

More Apache Kafka Cons →

"ODI could improve the ease of use. There is a steep learning curve to use the solution.""We used a third party to do the implementation of ODI.""Reverse engineering is complicated and challenging to manage.""I rate it a seven out of 10 because there is room for growth because ODI is still new, in comparison to Informatica, which is a mature product.""Oracle support services are not up to the mark.""It would be really good if Oracle considered enabling the tool to integrate with some other platforms that are deprecated simply for commercial reasons""The tool should improve its pricing. It prevents the application of Oracle ODI on small and medium projects in countries like Croatia, Germany, or the US. While there are no technological obstacles to using it, the high price makes it unfeasible for projects with smaller budgets.""An area for improvement in Oracle Data Integrator (ODI) is real-time integration. Currently, my company has a workaround to implement real-time integration, an area on which Oracle must focus more. Real-time integration should be easier in Oracle Data Integrator (ODI). Another area for improvement in Oracle Data Integrator (ODI) is integration with more publishers and subscribers rather than just database integrations."

More Oracle Data Integrator (ODI) Cons →

Pricing and Cost Advice
  • "I would not subscribe to the Confluent platform, but rather stay on the free open source version. The extra cost wasn't justified."
  • "When starting to look at a distributed message system, look for a cloud solution first. It is an easier entry point than an on-premises hardware solution."
  • "It is open source software."
  • "Licensing issues are not applicable. Apache licensing makes it simple with almost zero cost for the software itself."
  • "Apache Kafka is open-source and can be used free of charge."
  • "Kafka is open-source and it is cheaper than any other product."
  • "Kafka is more reasonably priced than IBM MQ."
  • "The solution is open source; it's free to use."
  • More Apache Kafka Pricing and Cost Advice →

  • "Being an ODI developer, I never had to pay for this product. I know that the pricing/licensing is not really low, but the product is really good."
  • "We found that the cost compared to other integration tools is a little high, but the solution works great."
  • "The solution is expensive because of the model they use. The cost is for the license and for support."
  • "ODI comes included when buying the cloud version of the Oracle database license."
  • "There is a standard license to use the solution but there are other costs in addition, such as hardware and operating system."
  • "Per user, it is $900 USD per year, though they will give some discount. However, even a 60% to 70% of discount for each won't help us much. On top of that, there is the perpetual license you must pay at the outset."
  • "I have yet to determine the exact figure for Oracle Data Integrator (ODI) pricing, but it has lower pricing than Informatica."
  • "The Oracle Data Integrator (ODI) pricing isn't expensive, but it's not cheap, so it's in the middle. I'd rate the pricing as three out of five."
  • More Oracle Data Integrator (ODI) Pricing and Cost Advice →

    report
    Use our free recommendation engine to learn which Message Queue (MQ) Software solutions are best for your needs.
    772,679 professionals have used our research since 2012.
    Comparison Review
    Anonymous User
    Answers from the Community
    RajneeshShukla
    AThiré - PeerSpot reviewerAThiré
    User

    There are two products I know about
    * TimeXtender : Microsoft based, Transformation logic is quiet good and can easily be extended with T-SQL , Has a semantic layer that generates metat data for cubes . price approx 40K$, works with tables
    . Attunity (Bought by Qlik) : technology agnostic , nice web interface , expensive > 100K€. Works with transaction logs

    There are many other pure ETL tools
    * ERWIN has a nice one ,

    Phil Wilkins - PeerSpot reviewerPhil Wilkins (Capgemini)
    Consultant

    Depends upon the technologies being used. If you're using Oracle for both OLTP and OLAP then you'll get a lot of value from an Oracle solution.


    The other question is how up to date do you want your OLAP DB to be? Goldengate is a good answer if you're looking to minimize latency, but it can be expensive. ODI is less expensive but better suited to bulkier data sets.  If an Oracle product wasn't the option I'd probably consider something like Informatica.

    Karoly Krokovay - PeerSpot reviewerKaroly Krokovay
    Real User

    Hi Rajneesh,
    yes here is the feature comparison between the community and enterprise edition : www.hitachivantara.com

    And a short description of the community edition: www.predictiveanalyticstoday.com

    And the download link: community.hitachivantara.com

    You can ask more from the great community: forums.pentaho.com

    Regards
    Károly

    Stefan Schäfer - PeerSpot reviewerStefan Schäfer
    User

    We usually use Talend.
    Look here: community.talend.com

    GaryM - PeerSpot reviewerGaryM
    Real User

    As someone mentioned, if you're purely Oracle shop and staying that way then there's value with prioritizing Oracle tools.  However, let me contrast that with this caveat...


    Consider expectations for tool and vendor longevity. Oracle has a long history of retiring and/or replacing tools leaving customers in the cold with prior versions/tools (I've been burned multiple times by Oracle product retirements or replacements including OWB, Oracle Designer2k, Oracle Express, Oracle OEDW, their purchase of Sagent ETL which as later abandoned).


    But I would also consider these questions and relative prioritization:  


    What is your organization's plans for moving to other database technologies?  


    Where is your org going with on-prem versus cloud solutions?  How important are PaaS versus IaaS solutions?  


    Where is your current staff's expertise?  


    Prioritize mature over immature tools. 


    How many sources do you have?  What are their technologies and does the integration tool support them?


    Is it just moving data from a single ERP such as Oracle EBS to Olap? When you say Olap what do you mean by that?  Are you talking Oracle Olap product or something else?  That makes a really big difference of course - if your ETL tool doesn't support your source(s) and target(s) then it shouldn't be considered.


    Given the industry's trajectory, I myself would highly prioritize PaaS solutions over others.

    Yeap Jiun Aing - PeerSpot reviewerYeap Jiun Aing
    Real User

    What is the OLAP that you are using? Hosted in Cloud or on-premise? 


    The target DB should have its tool to extract data.

    Efe Dagistanli - PeerSpot reviewerEfe Dagistanli
    User

    Pentaho is a really nice tool if opensource is the only option. 


    Please think about issues such as upgrade and disaster in the future. These operations are very easy in Pentaho.


    I can only suggest one thing for replication and that is Qlik. (ex-Attunity).

    RajneeshShukla - PeerSpot reviewerRajneeshShukla
    Real User

    Hi Karoly, Thanks for your input. community: forums.pentaho.com is not allowing new registrations for new users. I guess they accept queries from customers only and not from any one. Do you know any other forum, community, SMEs contacts who can help on queries?

    Questions from the Community
    Top Answer:Apache Kafka is open source and can be used for free. It has very good log management and has a way to store the data used for analytics. Apache Kafka is very good if you have a high number of users… more »
    Top Answer:Apache Kafka is an open-source solution that can be used for messaging or event processing.
    Top Answer:Oracle Integration Cloud Service has a fairly easy initial setup, and Oracle offers initial support and guidance for those who might find the setup to be challenging. There are complications that come… more »
    Top Answer:ODI significantly improves data integration and management by allowing customization of data types from various sources like SQL Server databases.
    Top Answer:The pricing for ODI varies depending on factors like usage and deployment model. While it might be expensive for small companies, it is generally reasonable for mid-sized companies. Pricing typically… more »
    Ranking
    Views
    14,022
    Comparisons
    10,578
    Reviews
    31
    Average Words per Review
    576
    Rating
    8.1
    4th
    out of 103 in Data Integration
    Views
    14,448
    Comparisons
    8,337
    Reviews
    18
    Average Words per Review
    443
    Rating
    8.2
    Comparisons
    Also Known As
    ODI
    Learn More
    Overview

    Apache Kafka is a highly regarded open-source, distributed event streaming platform and Message Queue (MQ) software solution that is valued and trusted worldwide by many of the top fortune 100 companies. It is considered one of the most reliable Message Queue (MQ) software solutions available in the marketplace today.

    Enterprise organizations rely on streaming platforms and MQ software solutions to process the continuous flow of high-performance data pipelines, mission-critical applications, and data integration. Apache Kafka makes it easy to process and distribute messages from one application to another from multiple environments with super-fast speeds and very high reliability.

    Additionally, in place of the usual command line processes regarding administration and management tasks, Apache Kafka supplies five exemplary core APIs for both Scala and Java:

    • Kafka Streams API can be used to facilitate stream processing applications and microservices. Input is seamlessly read from one or more topics and will initiate output to one or more topics, easily converting the input streams to output streams.
    • Kafka Connect API enables users to develop and run reusable data import/export connectors that are able to read and write streams of events from external operating systems and applications, making integration with Apache Kafka simple and streamlined.
    • Consumer API allows users to subscribe and read one or more topics and to process the stream of events produced to them.
    • Admin API gives users the ability to examine and manage brokers, topics, and various other Kafka topics.
    • Producer API using this core element, users are able to write and publish a stream of events to one or more Kafka topics.

    Apache Kafka Benefits

    Apache Kafka has many valuable benefits. Some of its most valuable benefits include:

    • Load Shifting
    • Scalability
    • Decoupling
    • High Throughput
    • High Availability
    • Safe Permanent Storage
    • Excellent Integration Capabilities
    • Large, Reliable, Open-Source Community
    • Mission Critical
    • Wide Array of Available Learning Opportunities

    Not only is Apache Kafka a robust messaging queue it is also a tremendously durable and reliable streaming platform that is fully capable of securely delivering more than one million messages per second, which amounts to trillions of success delivered messages in one day.

    Reviews from Real Users

    “From my experience with Apache Kafka, one of the most notable advantages is its ability to maintain a comprehensive record of historical data that includes every update, alteration, and version of information, unlike a conventional relational database. This feature allows for seamless tracking and analysis of the progression and transformation of the data over time, enabling users to easily review and analyze the history of the information.” Dimitrios Z., Enterprise Architect at Smals vzw

    “We are currently on a legacy version and have found that the latest version of Kafka has solved many of the issues we were facing, such as sequencing, memory management, and more. Additionally, the fact that it is open source is a major benefit.” Pratul S. Software Engineer at a financial services firm

    “The solution has improved our functionality; it's one of the best streaming platforms I've used.” Sreekar N., Co-Founder at Attaika

    Oracle Data Integrator (ODI) is a data integration software solution that provides a unified infrastructure to streamline data and application integration projects. It uses a powerful design approach to data integration, which separates the declarative rules from the implementation details. The solution is based on a unique ELT (Extract Load Transform) architecture, eliminating the need for a standalone ETL server and proprietary engine. 

    Oracle Data Integrator Features

    ODI has many valuable key features. Some of the most useful ones include:

    • Automatic documentation generation
    • Visualization of data flows in the interfaces
    • Customization of generated code
    • Automatic reverse-engineering of existing applications or databases
    • Graphical development and maintenance of transformation and integration interfaces
    • Robust data integrity control features, assuring the consistency and correctness of data
    • Powerful core differentiators
    • Heterogeneous ELT, declarative design and knowledge modules
    • Flexibility and modularity
    • Oracle Data Integrator repository
    • Topology navigator
    • Operator Navigator
    • Security Navigator
    • Integrator Console
    • ODI domains

    Oracle Data Integrator Benefits

    There are many benefits to implementing ODI. Some of the biggest advantages the solution offers include:

    • Efficient architecture: Oracle Data Integrator has a simple architecture that utilizes the source and target servers to perform complex transformations, making it an efficient solution.
    • Supports all platforms: ODI gives you platform independence by supporting all platforms, hardware, and OSes with the same software.
    • Cost-effective: Oracle Data Integrator reduces costs associated with initial hardware and software acquisition, and also decreases maintenance costs because it eliminates the need for an ETL Server and an ETL engine.
    • Automatic detection of faulty data: By using ODI, faulty data is recycled before insertion in the target application, providing you with a data quality firewall.
    • Easy development and maintenance: With a low learning curve, Oracle Data Integrator increases developer productivity while facilitating ongoing maintenance. 
    • Active integration: ODI includes all styles of data integration: data-based, event-based and service-based.

    Reviews from Real Users

    Below are some reviews and helpful feedback written by PeerSpot users currently using the Oracle Data Integrator (ODI) solution.

    Brian D., Business Process and Strategy Specialist Advisor at NTTData, says, “The Knowledge Module (KM) is my favorite feature of ODI. This is where I learned how to use variables to make jobs dynamic. I took that knowledge and created a KM that would go into iTunes and pull the sales of eBooks. Making something that is reusable, like a KM, is important to not only reduce build time but also maintenance in the future.”

    Ashok S., Applications Support Manager at a marketing services firm, mentions, "The most valuable features of ODI are the ease of development, you can have a template, and you can onboard transfer very quickly. There's a lot of knowledge modules available that we can use. If you want to connect, for example, a Sibyl, SQL, Oracle, or different products, we don't have to develop them from scratch. They are available, but if it's not, we can go into the marketplace and see if there's a connector there. Having the connector available reduces the amount of hard work needed. We only have to put the inputs and outputs. In some of the products, we use there is already integration available for ODI, which is helpful."

    Sample Customers
    Uber, Netflix, Activision, Spotify, Slack, Pinterest
    Griffith University, Kansas City Power & Light, Keste, Raymond James Financial, Valdosta State University
    Top Industries
    REVIEWERS
    Financial Services Firm26%
    Computer Software Company18%
    Retailer15%
    Media Company8%
    VISITORS READING REVIEWS
    Financial Services Firm29%
    Computer Software Company13%
    Manufacturing Company6%
    Retailer5%
    REVIEWERS
    Financial Services Firm24%
    Comms Service Provider11%
    Computer Software Company8%
    Government5%
    VISITORS READING REVIEWS
    Financial Services Firm16%
    Computer Software Company15%
    Government8%
    Manufacturing Company8%
    Company Size
    REVIEWERS
    Small Business35%
    Midsize Enterprise15%
    Large Enterprise51%
    VISITORS READING REVIEWS
    Small Business17%
    Midsize Enterprise11%
    Large Enterprise72%
    REVIEWERS
    Small Business32%
    Midsize Enterprise16%
    Large Enterprise53%
    VISITORS READING REVIEWS
    Small Business17%
    Midsize Enterprise12%
    Large Enterprise71%
    Buyer's Guide
    Message Queue (MQ) Software
    May 2024
    Find out what your peers are saying about Apache, IBM, VMware and others in Message Queue (MQ) Software. Updated: May 2024.
    772,679 professionals have used our research since 2012.

    Apache Kafka is ranked 1st in Message Queue (MQ) Software with 78 reviews while Oracle Data Integrator (ODI) is ranked 4th in Data Integration with 68 reviews. Apache Kafka is rated 8.0, while Oracle Data Integrator (ODI) is rated 8.2. The top reviewer of Apache Kafka writes "Real-time processing and reliable for data integrity". On the other hand, the top reviewer of Oracle Data Integrator (ODI) writes "Straightforward to implement, scalable, and has good stability and documentation, but technical support could still be improved". Apache Kafka is most compared with IBM MQ, Amazon SQS, Red Hat AMQ, Anypoint MQ and IBM Event Streams, whereas Oracle Data Integrator (ODI) is most compared with Oracle Integration Cloud Service, Informatica PowerCenter, SSIS, Azure Data Factory and Matillion ETL.

    We monitor all Message Queue (MQ) Software reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.