FiveTran: Strengths and Weaknesses

An overview of this new data integration tool.

Written by Matt Brown
Published on Mar. 28, 2022
FiveTran: Strengths and Weaknesses
Brand Studio Logo

The last ten years have seen a proliferation of new data integration tools, as well as an expanded definition of the capabilities and features data integration involves. In the past, data integration mainly described extract, transform, and load (ETL) tools, data virtualization tools, and application messaging tools. These days the following scenarios/use cases are commonly also supported:

  • Data engineering: This includes building and deploying data pipelines to support business intelligence and data science workloads. These pipelines combine internal/external data sources into purpose-built environments for data lakes, data warehousing, and self-service analytics.
  • Cloud enablement: These days organizations have data sources that span on-premises, multi-cloud, hybrid-cloud, and private cloud platforms.
  • Operational integration: This includes supporting master data management, data sharing between external business partners, and ensuring data consistency across internal/external data silos (like syncing records between Salesforce and Netsuite).
  • Data mesh: A data mesh is a new style of enterprise data architecture that is domain-driven and seeks to address common pitfalls of legacy approaches to data integration that promote monolithic architectures. 

Some of the tools that support the use cases above have looked more like traditional ETL tools, some of these tools are entirely cloud-based and follow an extract, load, and transform (ELT) paradigm, and some of these tools have focused mainly on the extract and load steps of ELT and been pretty light on the transformation step.

Some of the newer tools we have seen in production include Talend, Dell Boomi, Matillion, dbt, and FiveTran. This post focuses on FiveTran and discusses specific strengths and weaknesses of the product.

 

What Is FiveTran?

FiveTran is defined as a Niche Player in Gartner’s Magic Quadrant for Data Integration. It is primarily focused on the extraction and loading part of the ELT paradigm and has a library of connectors that customers can use that require virtually no coding or engineering expertise to connect source to target. They operate almost as a managed service for ELT in that they have customer-facing teams who can assist with developing new connectors or providing transformation capabilities using the open source tool dbt.

We frequently find FiveTran deployed alongside Snowflake for storage/computation purposes and Looker for data visualization purposes. The majority of our clients who adopt FiveTran are high-growth software companies who are looking to connect external SaaS services to extract and load data into internal data lakes and warehouses for data science and analytics purposes. A typical use case would be connecting Salesforce, Netsuite, and an external order management system like Ordoro to an internal data warehouse designed in Snowflake. In this scenario, FiveTran would manage the movement of data from these external sources to an internal data store for reporting and analytics.

Read About Data Lakes and More on BuiltIn.comData Lake vs. Data Warehouse: Will the Already-Blurred Line Between Them Disappear?

 

Strengths

Strengths of FiveTran

  • Managed service approach
  • Pre-built schemas for data analytics
  • Low cost of ownership

 

Managed Service Approach 

FiveTran is responsible for managing the various database connectors in its offering on behalf of their customers. Whenever there is a new change to an API or endpoint, FiveTran ensures that the existing connector is not broken as a result. Given the diversity of their customer base, customers experience a network effect of continued improvement and advancement in features of the platform. Given the wide variety of off-the-shelf connectors, it is very easy to get up and running with source-to-target connectors for data extraction and loading.

 

Pre-built Schemas for Data Analytics 

FiveTran provides over 50 prebuilt data models for supporting common analytical scenarios like finance and digital marketing needs. Across our client base we find that teams are generally looking for similar insights and thus having prebuilt schemas is an excellent way to get up and running quickly, turning raw data into information and ultimately into actionable insights.

 

Low Cost of Ownership 

A typical data engineer working with FiveTran can accomplish a lot with a relatively small team. FiveTran acts as a force multiplier for data engineers and allows teams to accomplish more with fewer resources.

 

Weaknesses

Weaknesses of FiveTran

  • Limited data transformation support
  • Lack of enterprise data management capabilities

 

Limited Data Transformation Support 

As mentioned previously, FiveTran relies on dbt under the hood to handle complex transformations for normalizing data into suitable data structures for analytics. As a result, teams may find that they are having to manage multiple tools and become annoyed that all of that can’t be combined into a common interface/tool.

 

Lack of Enterprise Data Management Capabilities 

FiveTran lacks broader data management capabilities found in more enterprise-oriented tools such as auto discovery of data semantics, data virtualization, data governance, and data quality capabilities.

Read More from Matt Brown on Built In’s Expert Contributors NetworkAzure Synapse vs Snowflake: Which MPP Platform Is Right for You?

 

Summary

FiveTran takes all of the data from your databases, events, applications, and files, and essentially replicates them into high-performance data lakes and data warehouses. It is an excellent fit for teams who want to quickly implement source-to-target data extraction and loading and are comfortable using dbt or some other means (hello python scripting!) to handle data transformations. For fast-growing software companies, it is an excellent force multiplier to keep your data engineers focused on higher-level tasks as opposed to managing source-to-target data movement.

Hiring Now
Sojern
AdTech • Digital Media • Machine Learning • Marketing Tech • Software • Travel • Hospitality
SHARE