Data Transformation Engineer

Posted 6 Hours Ago
2 Locations
In-Office or Remote
130K-150K Annually
Mid level
Insurance
The Role
Build and maintain Snowflake-based enterprise data solutions, including scalable data pipelines, ELT workflows, data models, and integrations. Develop Snowflake objects and optimize query performance, resource utilization, and warehouse configurations. Use Python for data cleaning and integration, monitor data quality and pipeline completion, translate business requirements into technical specifications, and provide on-call support.
Summary Generated by Built In

Pay Range:  

  • $130000 - $150000 / year

Our Perks & Benefits:_

  • Comprehensive benefits package including medical, dental, vision, and life insurance
  • Performance-based bonuses to reward your contributions*
  • Paid time off to recharge and maintain a healthy work-life balance
  • Flexible work options, including remote and hybrid opportunities, if eligible
  • Retirement Plan (401k) with company-matched contributions
  • Education Advancement, for employees and qualified dependents, via the Confie Enablement Scholarship Fund
  • Fitness Reimbursement – up to $15/month for gym memberships
  • Inclusive workplace through a strong commitment to Diversity, Equity, and Inclusion
  • Employee Assistance Program – confidential support for personal or professional challenges, at no cost
  • Extra Perks – optional plans for disability, hospital indemnity, health advocate program, universal life, critical illness, accident insurance, and even pet insurance

 

Purpose

Work under the guidance and supervision of the Director of Enterprise Architecture to build Confie's next-generation Enterprise Data Solutions. Require expertise in implementing and maintaining data solutions on Snowflake data cloud environments that drive critical business insights and operations. Responsible for developing robust data models, creating efficient ELT processes, and optimizing performance to support the organization's data needs


Essential Duties & Responsibilities

Design and develop data pipelines, ELT workflows to populate the cloud Data Lake and Data Warehouse on Snowflake with transformation tools (e.g., Coalesce, WhereScape, Azure Data Factory) and replication tools (e.g., Fivetran, Airbyte, etc.)

Translate business requirements into technical specifications; establish and define details, definitions, and requirements of applications, components, and enhancements

Design and develop robust and scalable data pipelines to support data integrations using Snowflake, Coalesce, Python, Airflow, and Fivetran

Design and develop Snowflake data objects (tables, views, stored procedures, udf's, etc.)

Implement ELT (Extract, Load, Transform) processes using Snowflake's features, such as SnowPipe, Streams, and Tasks

Perform data cleaning, analysis, and integration using Python

Ability to work with multiple data sources and types (structured/semi-structured/unstructured)

Design and implement efficient data models and schemas within Snowflake to support reporting, analytics, and business intelligence needs

Monitor and optimize query performance and resource utilization within Snowflake using query profilling, query optimization techniques, and workload management features

Identify and resolve performance bottlenecks and optimize data warehouse configurations for maximum efficiency

Implement processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it

Monitor data pipelines for timely and accurate completion

Stay up-to-date with industry trends and advancements in data engineering, continuously improving the team's technical knowledge and skills

On-call support


Qualifications and Education Requirements

4+ years of professional experience in data engineering, designing and implementing data pipelines, and building data infrastructure

4+ years of strong experience required in Snowflake data cloud and ETL development, including Snowflake procedures, udf's in Python and SQL, streams, tasks, Snowpipe, and working with semi-structured data

3+ years of strong experience with Python programming and extensively used frameworks/packages like Snowpark, pandas, numpy, and requests for Data Analysis and integration

Solid understanding of data warehousing concepts, dimensional modeling, and data integration techniques

2+ years of strong experience with data integration and transformation tools like Coalesce, WhereScape, and Azure Data Factory

Experience with data quality and observability concepts is a plus

Bachelor's degree in Computer Science, Engineering, or a related field

Snowflake Advanced Certification is a plus

Additional certifications related to data platforms are a plus


Other Duties

This job description is not designed to cover or contain a comprehensive listing of activities, duties, or responsibilities that are required of the employee for this job. Duties, responsibilities, and activities may change at any time with or without notice


Notice  

As permitted by applicable law and from time-to-time, Confie may use a computer system that has elements of artificial intelligence to help make decisions about your employment, including recruitment, hiring, renewal of employment, or the terms and conditions of your employment. Employees with questions about Confie’s use of these computer systems should contact Human Resources at [email protected]

Equal Opportunity Employer
This employer is required to notify all applicants of their rights pursuant to federal employment laws. For further information, please review the Know Your Rights notice from the Department of Labor.

Skills Required

  • 4+ years of professional experience in data engineering, data pipelines, and data infrastructure
  • 4+ years of experience with Snowflake data cloud and ETL development, including procedures, Python and SQL UDFs, streams, tasks, Snowpipe, and semi-structured data
  • 3+ years of experience with Python, including Snowpark, pandas, NumPy, and Requests
  • Understanding of data warehousing, dimensional modeling, and data integration techniques
  • 2+ years of experience with Coalesce, WhereScape, and Azure Data Factory
  • Bachelor's degree in Computer Science, Engineering, or a related field
  • Experience with data quality and observability concepts
  • Snowflake Advanced Certification
  • Additional certifications related to data platforms
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Huntington Beach, CA
711 Employees
Year Founded: 2008

What We Do

Confie is the largest personal lines insurance agency in the US. Since the day we established ourselves in 2008, we quickly grew to become the nation’s leading independent insurance provider for personal lines. Personal lines insurance includes auto, motorcycle, homeowners, renters, life, and health among others. We are passionate about serving our customers in their local communities through our click, call, or come-in approach. We live by our aspiration to be the most trusted source of insurance solutions so our customers can have peace of mind. In the insurance industry, we have been recognized as the #1 personal lines leader in the nation for the past five years. Confie is the only independent agency focused on personal lines insurance that consistently ranks in the Top 10 Property/Casualty agencies in the U.S. Our customers know us as friendly, professional, trustworthy, and knowledgeable. They recognize our brands and the great value we provide, and count on us for insurance solutions at competitive prices. We provide them quality coverage in the diverse communities that we serve. We believe that our employees are our brand. Our employees enjoy a positive, dynamic, inclusive and collaborative workplace where performance is rewarded, education is promoted, and employees have exciting opportunities to advance their careers. We strive to help every employee embrace our corporate values in everything they do. We promote a positive, workplace, and find satisfaction in a job well done. The secret to our continued success is our talented, diverse and dedicated employees. We are proud of our leading position in terms of employee diversity within our industry. At Confie, we offer competitive pay, great benefits, work-life balance, and significant upward opportunities for employees with passion. We look forward to you being a part of our team! Disclaimer: *2021 Top 50 Personal Lines Agency in Insurance Journal

Similar Jobs

Liberty Mutual Insurance Logo Liberty Mutual Insurance

Senior Claims Representative

Artificial Intelligence • Fintech • Insurance • Marketing Tech • Software • Analytics
Remote or Hybrid
9 Locations
40000 Employees
46K-84K Annually

MetLife Logo MetLife

Director, Group Benefits Data Strategy

Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Remote or Hybrid
United States
43000 Employees
125K-170K Annually

MetLife Logo MetLife

Senior Accounting Assistant - 20009

Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Remote or Hybrid
United States
43000 Employees
42K-50K Annually
Remote
USA
3000 Employees

Similar Companies Hiring

MassMutual India Thumbnail
Big Data • Fintech • Information Technology • Insurance • Financial Services
Hyderabad, Telangana
Granted Thumbnail
Artificial Intelligence • Healthtech • Insurance • Mobile • Financial Services
New York, New York
23 Employees
Vega Thumbnail
Artificial Intelligence • Automotive • Insurance • Transportation
US
65 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account