What is our primary use case?
We use the product internally to cover one of our data synchronization needs. The use case is likely to be unique in the world.
The solution involves 3000 pharmacies distributed geographically on several islands and continents. Each pharmacy has an ERP for managing pharmacy operations (sales, purchases, logistics, etc.). And we are synchronizing all the data and transactions that are generated in the ERP, with a central database (Exadata).
How has it helped my organization?
Our use case is complex and with Oracle GoldenGate we are improving the efficiency of the data replication and mostly the maintenance and operations support. We are in the process of migrating the current solution (based on queuing and web services) to Oracle Goldengate. Our current data synchronization process is old and not efficient enough to deal with 3000 data sources.
With Oracle Goldengate, we have more control over the CDC phase, and we can improve our management process which is critical for us.
What is most valuable?
The OGG CDC is flexible and robust but complex to manage. The OGG version with microservices is very important to us because we need to monitor and manage all the database sources. The current OGG monitor is limited to our operations and we built one for our needs using the OGG microservices.
What needs improvement?
While we like the CDC feature, it has some limitations in terms of what we can do and how to configure what we need to do. We are trying to fix those issues by implementing some workarounds.
Memory consumption is also an issue in OGG architecture. Each OGG data replicator consumes more and less 200 MB of RAM. We have 10 OGG hubs, each one with almost 300 data replicators to the central database. We need 64 GB for each Hub. a total of 640 GB just for data replication.
For how long have I used the solution?
We've been working with the product for five years.
What do I think about the stability of the solution?
The solution, especially the last version, is very stable. Even with 3000 data sources, and a complex framework we're finding the solution to be very reliable.
What do I think about the scalability of the solution?
The solution is very scalable when adopting a three-tier solution with hubs in the middle. Each OGG hub handles 300 interconnections. We have 10 hubs and, if we need to increase or expand, we put more servers in the system. It is very simple and expensive too.
How are customer service and technical support?
In Portugal, we have a direct connection with Oracle (Portugal) due to the fact that our use case is so unique. We are also in direct contact with the Oracle Goldengate project manager through Oracle Portugal.
Everyone has been very good so far. Although the team in Portugal does not have the knowledge base necessary for our purposes, teams in India or the USA generally provide the required assistance.
Which solution did I use previously and why did I switch?
At the scale where we are now, we have worked with Attunity. It is a similar CDC software data extraction. It's more straightforward and simple to configure, however, when you scale with the 3000 data sources, the system starts being unmanageable. And the total cost of ownership is higher than OGG.
How was the initial setup?
OGG technology is not simple. The first setup took almost six months because we had a hard time finding OGG specialists on the market.
There are three support teams in the project. We have a support team for infrastructure management, a team of DBAs to manage the Exadata, and an operations team to manage the 3000 databases (sources). And we also have Oracle's support for bugs and problems that we encounter along the way.
What about the implementation team?
We had external help from Oracle. And we hired specialists from Brazil who came to Portugal to help us.
What's my experience with pricing, setup cost, and licensing?
In terms of price, as a client, I want always the cheaper price. But, in this case, we have a good deal with Oracle in terms of GoldenGate licenses. It's a lot of money but the business case is working for us. We need the information, and fast access to it, so we require an effective system. We already have one solution in place working, but it's a legacy system bases on web services and the operations costs are very expensice. We need to migrate asap to this new solution.
Which other solutions did I evaluate?
Yes, the current system we are using is based on Internet protocols. We are using web services and data streaming. But when you need to manage and operate 3000 data sources, every time you need to make a change it's a nightmare. The operations costs and time consumption in software development and depoly is too high to maintain.
What other advice do I have?
We're currently in the middle of a huge project using Oracle GoldenGate. We have a unique business case in the world - synchronizing 3000 OLTP databases to an Exadata. Normally Oracle GoldenGate use cases are for 10 or 50 maximum data sources.
We are using OGG version 19 in the OGG Hubs (Replicators). In the source, we are using OGG version 13 microservices (Extractors).
We have a hybrid OGG architecture: the data source is on-premise and the hubs and the Exadata are in the OCI (Oracle Cloud Infrastructure). We have on-premise extractors and replicators in the cloud. the connection is made through FastConnect.
I'd rate the solution seven out of ten. There are several features that have some real limitations for us. The product itself is not simple to manage and we take almost 6 months to learn the basics. There's also harsh memory consumption. Each connection is consuming almost 200 megabytes of memory, and, with the 3000 databases, that's a lot of resources to manage.
Which deployment model are you using for this solution?
If public cloud, private cloud, or hybrid cloud, which cloud provider do you use?