2020-04-03T11:07:00Z

Which ETL tool would you recommend to populate data from OLTP to OLAP?


I am currently working as a solution architect for a tech vendor with 10,000+ employees. 

I need to perform a comparative analysis for ETL tools available to populate data from OLTP to OLAP.

The main criteria I am considering are:

  • Price
  • Functionality (transformation, error logging and handling, loading patterns to be supported)
  • Development and maintenance efforts
  • Popularity in market.

I want to evaluate both Oracle and Open Source options. I am also open to both tools (ODI, Golden Gate, etc) and technology- e.g. Oracle Materialized view.

Thanks! I appreciate your help. 

Guest
99 Answers

author avatar
User

There are two products I know about
* TimeXtender : Microsoft based, Transformation logic is quiet good and can easily be extended with T-SQL , Has a semantic layer that generates metat data for cubes . price approx 40K$, works with tables
. Attunity (Bought by Qlik) : technology agnostic , nice web interface , expensive > 100K€. Works with transaction logs

There are many other pure ETL tools
* ERWIN has a nice one ,

2020-04-07T09:48:17Z
author avatar
Top 20User

Hi Rajneesh,
yes here is the feature comparison between the community and enterprise edition : https://www.hitachivantara.com/en-us/pdf/brochure/leverage-open-source-benefits-with-assurance-of-hitachi-overview.pdf

And a short description of the community edition: https://www.predictiveanalyticstoday.com/pentaho-community-edition/

And the download link: https://community.hitachivantara.com/s/article/downloads

You can ask more from the great community: https://forums.pentaho.com/

Regards
Károly

2020-04-10T06:18:30Z
author avatar
Top 20User

We have experiences only in Pentaho Data Integrator (open source competitor of the Oracle Data Integrator).
But OLAP exporting wasn't in our scope until now.

2020-04-07T11:13:23Z
author avatar
Top 5LeaderboardConsultant

Depends upon the technologies being used. If you're using Oracle for both OLTP and OLAP then you'll get a lot of value from an Oracle solution.


The other question is how up to date do you want your OLAP DB to be? Goldengate is a good answer if you're looking to minimize latency, but it can be expensive. ODI is less expensive but better suited to bulkier data sets.  If an Oracle product wasn't the option I'd probably consider something like Informatica.

2020-11-02T18:18:40Z
author avatar
Top 5Real User

Hi Karoly, Thanks for your input. community: https://forums.pentaho.com/ is not allowing new registrations for new users. I guess they accept queries from customers only and not from any one. Do you know any other forum, community, SMEs contacts who can help on queries?

2020-04-13T03:28:45Z
author avatar
Top 5Real User

Hi Karoly,

Thanks for your response !!!
Is Pentaho Data Integrator available as freeware/open source tool? Does it come in basic, standard and enterprise editions flavors?

It integrates data from various heterogeneous systems like multiple variety of databases (SQL server, Oracle, DB2 etc), files (XML, XLS, CSV, text etc)? Targets can be any type of DB , file etc.?

What all flavors available like Basic, Standard, Enterprise editions? All editions are free/ open source?

Thanks,
Rajneesh

2020-04-08T13:44:08Z
author avatar
Top 5Real User

Hi AThire ,
Thanks for your response, I am looking for open source tools.

Regards,
Rajneesh

2020-04-07T13:09:28Z
author avatar
Top 5Real User

Thanks Stefan !!!
May I know if Talend is opensource /free ? It is available in all 3 editions - basic , standard end enterprise? it is capable to read data from all heterogeneous system like various types of data bases and files etc..?

2020-04-07T06:11:21Z
Find out what your peers are saying about IBM, Apache, VMware and others in Message Queue (MQ) Software. Updated: February 2021.
465,891 professionals have used our research since 2012.