Matillion ETL Room for Improvement

Chris Hastie - PeerSpot reviewer
Data Lead at InterWorks

So the main thing I would like to see improved in Matillion are two things. Firstly, their ability to process concurrent workloads. Right now, the concurrency reaches a stalling point if too many things are added, and it gets stuck waiting for each one to finish. 

Secondly, Matillion needs an improvement in its backend integration and the way that it pushes things through. It is already good, but it could be cleaner. I will say that I think both of those issues are being addressed in the new platforms that are coming out.  Matillion Unlimited Scale is the new answer to concurrent workloads, and Matillion Data Productivity Cloud is their new software-as-a-service version of a Matillion ETL provider, including a deeper git integration. So my concerns are being addressed, but those are the two things that stand out to me the most right now.

View full review »
PH
Senior Data Engineer Consultant at a tech company with 201-500 employees

Unlike Snowflake which automatically takes care of upgrading to the latest version and includes additional features, with Matillion ETL we need to do this ourselves. Matillion upgrades the tool quite often, but we need to manually apply it in our environment. This manual process can be done in a few minutes, but it has room for improvement.

Recently, I needed to develop a component that runs queries on Athena, one of the AWS services. Matillion ETL does not have this functionality out of the box, so having an additional component to handle this would be quite convenient. The tool is quite flexible, and there is no source that cannot be easily integrated. The developers are constantly adding new functionality from release to release, responding to market needs. The only thing I was missing at some point was a component for Athena queries.

View full review »
AntonHaupt - PeerSpot reviewer
Data Architect at Capitec

There's room for improvement in how it handles data streaming capabilities. Our main challenge currently is that Matillion runs on an EC2 instance, limiting us to running only two processes simultaneously at the entry level. This constraint means we can run about sixteen jobs concurrently at the moment. However, once we transition to the SaaS offering, scalability will no longer be an issue. With the SaaS solution, we'll have the flexibility to run as many jobs as needed, making it a natural next step in our progression.

View full review »
Buyer's Guide
Matillion ETL
March 2024
Learn what your peers think about Matillion ETL. Get advice and tips from experienced pros sharing their opinions. Updated: March 2024.
763,955 professionals have used our research since 2012.
MG
Director of IT Operations at a financial services firm with 10,001+ employees

Matillion’s on-premises capabilities don’t allow you to build something customized. I will give an example of tables to explain it. If we want to do a lookup, we have to copy the whole table with three million rows in it, every time. It is not cost-effective for me. We have these three million rows ported over in our S3 bucket. We have to pay for that and Snowflake as well. So, we have told them to build up a custom solution allowing us to bring over the data we care about, using the records and the drivers. But, that wasn’t out-of-the-box. So, the default way to work is to port everything over from on-premises to your AWS environment. For me, it is not cost-effective in the long run.

View full review »
Sunny Kumar - PeerSpot reviewer
Specialist Programmer at Infosys

When using the SQL loader type there were not a lot of pre-processing features for the data. For example, if there is a table with twenty columns, but we only want to load ten columns. In that case, we can use a security script to select the specific columns needed. However, if we want to perform extensive pre-processing of the data, I faced some challenges with Matillion ETL. I did not encounter many challenges, but my overall experience is limited as I only have three years of experience.

The solution could improve by adding support for instructed data types.

View full review »
Shehab Saad - PeerSpot reviewer
Business Intelligence Manager & Data Analytics (Retail Business) at B.TECH

The product must enhance its near-real-time data capture feature. Also, if they enhance CDC functionality, we can replace multiple components with one component. Otherwise, we must purchase a different component for CDC functionality and another component for data transformation. This added feature will help the user do everything with a single component.

View full review »
SK
Data Engineer

The cost of the solution is high and could be reduced.

View full review »
Tomáš Hronek - PeerSpot reviewer
Data Engineer at Merck

Sometimes, we have issues with the solution's stability and need to restart it for three weeks or more. There is some room for improvement in job clusters for Databricks.

View full review »
David Carbery - PeerSpot reviewer
Data Analytics Consultant at Snap Analytics

As someone new to the data industry and with limited experience in ETL tools, I'm not familiar with other options. My background was as a university professor until about a year ago, so I'm still getting acquainted with this field. I found some of the more complex aspects of ETL challenging, but I grasped the concepts fairly quickly.

View full review »
PT
Data analyst at a tech services company with 51-200 employees

The tool's lineage is very weak. 

View full review »
AH
Data Architect at Old Mutual Life Assurance Company (South Africa) Limited

I am looking forward to seeing the expansion of the source range for their data loader product. However, I think they have done a very good job of incorporating a lot of different data sources.

View full review »
Buyer's Guide
Matillion ETL
March 2024
Learn what your peers think about Matillion ETL. Get advice and tips from experienced pros sharing their opinions. Updated: March 2024.
763,955 professionals have used our research since 2012.