2018-09-11T08:28:00Z

What is your primary use case for Apache Kafka?

Miriam Tover - PeerSpot reviewer
  • 0
  • 28
PeerSpot user
41

41 Answers

TM
Real User
2024-01-17T13:22:29Z
Jan 17, 2024

We use the solution for analytics for streaming. We also use it for fraud detection.

Search for a product comparison
Amit Laddha - PeerSpot reviewer
Real User
Top 10
2023-09-13T09:37:10Z
Sep 13, 2023

My company uses Apache Kafka to keep some intermediate data in the workflow.

Jhon Rico - PeerSpot reviewer
Real User
Top 10
2023-09-08T20:53:00Z
Sep 8, 2023

I have previous professional experience using Kafka to implement a system related to gathering software events in one centralized location.

MB
Real User
Top 5Leaderboard
2023-05-11T13:52:00Z
May 11, 2023

We use Kafka for Elastic Stack and Kafka SCRAM login. I have many users of Apache Kafka. It's like a subject to study in enterprises. However, we have not decided if the systems should generalize Apache Kafka for every application and every IT system.

AT
Real User
Top 20
2023-04-25T09:46:00Z
Apr 25, 2023

We have different use cases for different clients. For example, a banking sector client wants to use Apache Kafka for fraud detection and messaging back to the client. For instance, if there's a fraudulent swipe of a credit or debit card, we stream near real-time data (usually three to five minutes old) into the platform. Then, we use a look-up model to relay the data to the messaging queue to the customers. This is just one use case. We also have data science engineers who use Kafka to feed on the data (usually within the last five to seven minutes of transactions) to detect any fraudulent transactions for internal consumption of the bank. This is not for relaying back to the customer. This client is based in the Middle East, and they have some interesting use cases.

AX
Real User
Top 20
2023-03-09T22:01:20Z
Mar 9, 2023

I primarily use Kafka in the investment banking sector to update prices and inform clients of updates.

Learn what your peers think about Apache Kafka. Get advice and tips from experienced pros sharing their opinions. Updated: March 2024.
765,234 professionals have used our research since 2012.
DZ
Real User
Top 20
2023-02-06T15:03:21Z
Feb 6, 2023

Apache Kafka is used for more than only a messaging bus but also served as a database to store information. It functioned as a streamer, similar to ETL, to manipulate and transform events before migrating them to other systems for use. The database could also act as a cache. Apache Kafka is used as a database broker, streamer, and source of truth for multiple systems due to its ability to maintain events for at least 10 days. It provided both synchronous and asynchronous communication, making it a complex system that would be easier to understand through diagrams or sketches. We use reactive frameworks.

Silvio Lucas Pereira Filho - PeerSpot reviewer
Real User
Top 10
2023-01-13T20:15:29Z
Jan 13, 2023

We are using Apache Kafka to extract data from a Portuguese data source, utilizing an open-source project for data capture. The connector for this project is linked to both Kafka and Confluence platforms. We then transform the extracted data and store it in Elasticsearch.

Abdul-Samad - PeerSpot reviewer
Real User
Top 10
2023-01-12T14:36:00Z
Jan 12, 2023

I use Kafka to send network packets from different sources to my cluster. We have around 10 users at my company.

Joaquin Marques - PeerSpot reviewer
Real User
Top 5Leaderboard
2022-12-06T15:50:00Z
Dec 6, 2022

My primary use case for Apache Kafka is replacing ETL and doing data transformations.

NK
Real User
Top 5
2022-11-09T14:44:38Z
Nov 9, 2022

We have got this product, which is meant for integration. So our use cases are essentially integrating with other systems, using any messaging stack. We use these products in Dev and QA and we have connectors for various different messaging applications. Apache Kafka just happens to be one of the messaging applications that we connect with. We also have our own messaging, it's called Enterprise Messaging Server and Rendezvous, we connect to those also. Our product is essentially used for integration. So we connect to almost all messaging applications.

AbhishekGupta - PeerSpot reviewer
Real User
Top 5Leaderboard
2022-10-08T02:36:00Z
Oct 8, 2022

Apache Kafka can be deployed on the cloud and on-premise. We use Apache Kafka internally to build a service on a cluster. Additionally, we use the intermediate persistence layer for events. There are many teams who leverage it as a message queue and further their microservice connections.

JA
Real User
Top 10
2022-10-07T11:43:46Z
Oct 7, 2022

We use an open-source version of this solution, and we have two deployments of it. One is on-prem, and the other is in the cloud. We use the on-prem version to aggregate our logs. We use the cloud version to manage queues for financial services.

Stuart-Cook - PeerSpot reviewer
Consultant
Top 10
2022-10-06T14:58:58Z
Oct 6, 2022

We used Kafka as a central message bus, transporting data from SNMP through to a database. Some of the processing in between was handled by other components.

Nor EL MALKI - PeerSpot reviewer
Real User
Top 5Leaderboard
2022-09-14T11:07:32Z
Sep 14, 2022

We have a scalable architecture where we need multiple workers to handle some processing. To make it possible, the backend catches the request and puts it in a common medium, which is the queue of Apache Kafka. The workers then can share and process it.

Guirino Ciliberti - PeerSpot reviewer
Real User
Top 5Leaderboard
2022-08-16T17:27:28Z
Aug 16, 2022

Our primary use case for this solution is streaming.

Rémy NOLLET - PeerSpot reviewer
Real User
Top 20
2022-07-20T13:35:00Z
Jul 20, 2022

We utilize Apache Kafka in several areas, including financials, logistics, and client management to name a few.

SK
Real User
Top 20
2022-07-07T06:41:00Z
Jul 7, 2022

Our primary use case of this solution is for data integration and for real-time data consumption. I'm a senior staff engineer for data and infrastructure and we are customers of Apache.

Reza Sadeghi - PeerSpot reviewer
Real User
Top 5
2022-06-26T13:43:00Z
Jun 26, 2022

We use Kafka daily for our messaging queue to reduce costs because we have a lot of consumers, producers, and repeat messages. Our company has only one system built on Apache Kafka because it's based on microservices, so all of the applications can communicate using it.

Ravi Kuppusamy - PeerSpot reviewer
Real User
Top 5Leaderboard
2022-05-17T13:52:27Z
May 17, 2022

We are building solutions on Apache Kafka for four customers. The customers we have are in various sectors, such as healthcare and architecture.

Salvatore Campana - PeerSpot reviewer
Real User
Top 5
2022-04-27T08:18:51Z
Apr 27, 2022

We use Apache Kafka to ingest a lot of data in real time that Apache Spark processes, and the result is used for a tech decision in real time – in the IT environment, infrastructure environment, and IOT environment, like for a manufacturing plant. This is an open-source framework. We also sell professional services on this solution and specifically create a business application for customers. The application is called Sherlogic. We have two kinds of customers. We have end-user customers that use the Sherlogic solution, and maybe customers don't know that there is Spark and Kafka in Sherlogic. But we have another kind of customer that uses professional services by Xautomata to create tailor-made applications in analytics and the automation process. We use Apache Kafka for our digital cloud.

ShoaibKhan - PeerSpot reviewer
Real User
Top 5
2022-03-30T12:56:54Z
Mar 30, 2022

This is a system for email and other small devices. There has been a relay of transactions continuously over the last two years it has been in production.

YL
Real User
2022-02-16T18:19:00Z
Feb 16, 2022

We use Apache Kafka for our messaging. We publish a message and ask the subscriber to listen to it. We use it to save events generated by integration with external systems. There are external events, that are first published to our Kafka queue, and then to a topic, and then we save it to our own data storage system.

Andrea Castorino - PeerSpot reviewer
Real User
Top 5
2021-12-15T20:27:56Z
Dec 15, 2021

We deployed this solution in a project for one of our customers to synchronize the different applications; to transport information from one application to another. I'm a program manager and we are customers of Apache.

DS
Real User
2021-11-23T03:09:18Z
Nov 23, 2021

It's a combination of an on-premise and cloud deployment. We use AWS, and we have our offshore deployment that's on-premise for OpenShift, Red Hat, and Kafka. Red Hat provides managed services and everything. We use Kafka and a specific deployment where we deploy on our basic VMs and consume Kafka as well. We publish or stream all our business events as well as some of the technical events. You stream it out to Kafka, and multiple consumers develop a different set of solutions. It could be reporting, analytics, or even some data persistence. Later, we used it to build a data lake solution. They all would be consuming the data or events we are streaming into Kafka.

ME
Real User
2021-08-07T05:24:00Z
Aug 7, 2021

We primarily use the solution for upstreaming messages with different payload for our applications ranging from iOT, Food delivery and patient monitoring. For example for one solution we have a real-time location finding, whereby a customer for the food delivery solution wants to know, where his or her order is on a map. The delivery person's mobile phone would start publishing its location to Kafka, and then Kafka processes it, and then publishes it to subscribers, or, in this case, the customer. It allows them to see information in real-time almost instantly.

DP
Real User
2021-06-26T01:12:49Z
Jun 26, 2021

One of our clients needed to take events out of SAP to stream them through Apache Kafka while applying data enrichment before reaching the consumers.

NC
Real User
2021-05-12T12:29:06Z
May 12, 2021

Our primary use case is based on the writing microservices, event architecture and using Kafka as an event bus. We work on distribution - enterprise-grade - and we design, develop and deploy in a confluent environment. We are customers of Kafka and I'm the chief technology officer.

WG
Real User
2021-02-09T13:56:41Z
Feb 9, 2021

We are a solution provider and Apache Kafka is being used in our client's company.

RG
Real User
2020-10-22T16:39:00Z
Oct 22, 2020

We use Apache Kafka for financial purposes. Every time one of our subscribed customers is due for an insurance payment, Apache Kafka sends an automated notification to the customer to let them know that their bill is due.

KS
Real User
2020-09-27T04:09:51Z
Sep 27, 2020

I am a solution architect and I used Apache Kafka in this role.

RH
Real User
2020-08-19T07:57:37Z
Aug 19, 2020

I am a user, as well as an integrator for our clients. This is one of the products that we implement for others.

MS
Consultant
2020-06-28T08:51:00Z
Jun 28, 2020

Apache Kafka is used for stream processing, metric and log aggregations, and as a message queue for connecting different microservices.

AM
Real User
2020-04-19T07:40:31Z
Apr 19, 2020

We use Kafka for event monitoring.

it_user998961 - PeerSpot reviewer
Real User
2020-03-30T07:58:09Z
Mar 30, 2020

I am an enterprise architect involved in Big Data and integration projects using Apache Kafa. We use it for integrating our different management systems.

LP
Real User
2020-03-30T07:58:07Z
Mar 30, 2020

I am a solution architect and this is one of the products that I implement for my customers. Kafka works well when subscribes want to stream data for specific topics.

MN
Real User
Top 20
2020-02-03T09:10:16Z
Feb 3, 2020

We primarily use the solution for big data. We often get a million messages per second, and with such a high output we use Kafka to help us handle it.

RABBAHMahmoud - PeerSpot reviewer
Real User
Top 5
2020-01-29T11:22:00Z
Jan 29, 2020

I'm a software architect. The use case will depend my customers. They usually use it for data transfer from static files to a legacy system.

OT
Real User
2020-01-19T06:38:00Z
Jan 19, 2020

We are currently using this solution on our cloud-based clusters.

JJ
MSP
Top 20
2020-01-12T07:22:00Z
Jan 12, 2020

Our company provides services and we use Apache Kafka as part of the solution that we provide to clients. One of the use cases is to collect all of the data from multiple endpoints and provide it to the users. Our application integrates with Kafka as a consumer using the API, and then sends information to the users who connect.

JL
Real User
2018-09-11T08:28:00Z
Sep 11, 2018

It's convenient and flexible for almost all kinds of data producers. We integrated it with Kafka Streams, which can perform some easy data processing, like summary, count, group, etc

Apache Kafka is a highly regarded open-source, distributed event streaming platform and Message Queue (MQ) software solution that is valued and trusted worldwide by many of the top fortune 100 companies. It is considered one of the most reliable Message Queue (MQ) software solutions available in the marketplace today. Enterprise organizations rely on streaming platforms and MQ software solutions to process the continuous flow of high-performance data pipelines, mission-critical applications,...
Download Apache Kafka ReportRead more