Lead Data Engineer

Posted 2 Days Ago
Be an Early Applicant
2 Locations
In-Office
131K-220K Annually
Entry level
Insurance
The Role
Leads a data engineering team that builds scalable big data applications and ETL workflows. Oversees data quality, security, privacy, architecture, documentation, and operational efficiency. Develops reusable Python and SQL code for data warehouses, distributed processing, cloud platforms, and data-driven solutions. Collaborates with application architects, development teams, project teams, and business stakeholders while supervising team activities and meeting project priorities.
Summary Generated by Built In
This position collects, stores, processes and builds applications within our big data platform. Responsible for integrating these applications with the architecture used across the organization.

Position Compensation Range:

$131,000.00 - $220,000.00

Pay Rate Type:

Salary

Compensation may vary based on the job level and your geographic work location. Relocation support is offered for eligible candidates.

This position has approval to transfer a valid H1 visa.

Primary Accountabilities
•Leads an engineering team to meet project deadlines and priorities.
•Supervises assigned data engineering team members & activities.
•Ensures the quality, completeness, security, privacy, and integrity of data throughout the data lifecycle.
•Documents critical workflows and operational support aspects of team’s responsibilities
•Develops deep understanding of data sources, granularity, availability, and limitations.
•Provides proactive technical oversight and advice to application architecture and development teams fostering re-use, design for scale, stability, and operational efficiency of data/analytical solutions.
•Creates maintainable, scalable code to load and manipulate data in the data warehouse.
•Facilitates communication upward and across project teams and business stakeholders.
Specialized Knowledge & Skills Requirements
•Demonstrated experience providing customer-driven solutions, support or service.
•In-depth knowledge of SQL or NoSQL and experience using a variety of data stores (e.g. RDBMS, analytic database, scalable document stores)
•Extensive hands-on Python programming experience, with an emphasis towards building ETL workflows and data-driven solutions. 
•Able to employ design patterns and generalize code to address common use cases.  
•Capable of authoring robust, high quality, reusable code and contributing to the division’s inventory of libraries.
•Expertise in big data batch computing tools (e.g. Hadoop or Spark), with demonstrated experience developing distributed data processing solutions.
•Applied knowledge of cloud computing (AWS, GCP, Azure).
•Knowledge of open source machine learning toolkits, such as sklearn, SparkML, or H2O.
•Solid data understanding and business acumen in the data rich industries like insurance or financial
•Applied knowledge of data modeling principles (e.g. dimensional modeling and star schemas).
•Strong understanding of database internals, such as indexes, binary logging, and transactions.
•Experience using tools for infrastructure-as-code (e.g. Docker, CloudFormation, Terraform, etc.)
•Experience with software engineering tools and workflows (i.e. Jenkins, CI/CD, git).
•Practical experience authoring and consuming web services.
Licenses:
•Not Applicable.
Travel Requirements
•Up to 10%.
Physical Requirements
•Work that primarily involves sitting/standing.
Working Conditions
•Not Applicable.

Additional Information
  • To ensure a strong start, all employees participate in our New Employee Orientation during their first week.  This experience is held in person at our Madison, WI Headquarters or one of our AmFam core locations to help you connect with our mission, meet key team members and build relationships that support your growth.  At times, sessions may be delivered virtually based on scheduling and availability. 
  • Offer to selected candidate will be made contingent on the results of applicable background checks
  • Offer to selected candidate is contingent on signing a non-disclosure agreement for proprietary information, trade secrets, and inventions
  • Sponsorship will not be considered for this position unless specified in the posting

We provide benefits that support your physical, emotional, and financial wellbeing. You will have access to comprehensive medical, dental, vision and wellbeing benefits that enable you to take care of your health. We also offer a competitive 401(k) contribution, a pension plan, an annual incentive, 9 paid holidays and a paid time off program (23 days accrued annually for full-time employees). In addition, our student loan repayment program and paid-family leave are available to support our employees and their families. Interns and contingent workers are not eligible for American Family Insurance Group benefits.

We are an equal opportunity employer. It is our policy to comply with all applicable federal, state and local laws pertaining to non-discrimination, non-harassment and equal opportunity. We also consider qualified applicants with criminal histories, consistent with applicable federal, state and local law.

American Family Insurance is committed to the full inclusion of all qualified individuals. If a reasonable accommodation is needed to participate in the job application or interview process, to perform essential job functions, and/or to receive other benefits and privileges of employment, please email [email protected] to request a reasonable accommodation.

#LI-BC2

Skills Required

  • Demonstrated experience providing customer-driven solutions, support, or service
  • In-depth knowledge of SQL or NoSQL and experience with multiple data stores, including relational databases, analytical databases, or scalable document stores
  • Extensive hands-on Python programming experience focused on ETL workflows and data-driven solutions
  • Experience applying design patterns and generalizing code for common use cases
  • Ability to author robust, high-quality, reusable code and contribute to shared libraries
  • Expertise with big data batch computing tools such as Hadoop or Spark and distributed data processing solutions
  • Applied knowledge of cloud computing, including AWS, GCP, or Azure
  • Knowledge of open-source machine learning toolkits such as scikit-learn, SparkML, or H2O
  • Data understanding and business acumen in data-rich industries such as insurance or financial services
  • Applied knowledge of data modeling principles, including dimensional modeling and star schemas
  • Strong understanding of database internals, including indexes, binary logging, and transactions
  • Experience with infrastructure-as-code tools such as Docker, CloudFormation, or Terraform
  • Experience with software engineering tools and workflows, including Jenkins, CI/CD, and Git
  • Practical experience authoring and consuming web services

American Family Insurance Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about American Family Insurance and has not been reviewed or approved by American Family Insurance.

  • Pay Growth & Progression Compensation has seen multiple increases, including a higher internal minimum hourly wage effective 2025 for many customer‑facing and claims roles. These moves indicate continued investment to raise the pay floor and improve total rewards competitiveness.
  • Retirement Support The total package includes a 401(k) with company match alongside a company‑funded cash‑balance pension, strengthening long‑term financial security. This combination is positioned as a standout element within the overall benefits mix.
  • Parental & Family Support Paid parental leave was expanded in 2025 for birthing parents and for all parents, including adoptive and foster. Caregiver leave adds further family support within the leave portfolio.

American Family Insurance Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Madison, WI
16,528 Employees
Year Founded: 1927

What We Do

For more than 85 years, American Family Insurance has built its reputation on sound principles. We strive to provide you industry-leading service, exceptional claims experience and products that build long-term relationships. This is accomplished by treating policyholders fairly in a helpful and caring way and making it easy and convenient to work with us. We know our customers like family. American Family Insurance thrives by conducting its business in accordance with the highest ethical standards and the law at all times. Integrity is part of our culture and always has been. The reputation we enjoy and trust-based relationships we have built with our customers are determined by the example set by management and the character and good judgment exercised at all levels of our organization. It’s a way of doing business that our customers have come to expect from us and a standard that we continue to live up to.

Similar Jobs

EXL Logo EXL

Lead Data Engineer

Information Technology • Database • Consulting
Remote or Hybrid
United States
30246 Employees

Beyond Finance Logo Beyond Finance

Platform Engineer

Fintech • Financial Services
Easy Apply
Remote or Hybrid
United States
2200 Employees
170K-205K Annually

EXL Logo EXL

Lead Data Engineer

Information Technology • Database • Consulting
Remote or Hybrid
United States
30246 Employees
94K-154K Annually

Zeta Global Logo Zeta Global

Lead Data Engineer

AdTech • Artificial Intelligence • Marketing Tech • Software • Analytics
Easy Apply
Remote or Hybrid
United States
2429 Employees
200K-215K Annually

Similar Companies Hiring

Alaffia Health Thumbnail
Artificial Intelligence • Healthtech • Insurance • Machine Learning • Payments
New York, NY
80 Employees
MassMutual India Thumbnail
Big Data • Fintech • Information Technology • Insurance • Financial Services
Hyderabad, Telangana
Granted Thumbnail
Artificial Intelligence • Healthtech • Insurance • Mobile • Financial Services
New York, New York
23 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account