Data Engineer II (AWS, Databricks, PySpark)

Reposted 6 Days Ago
2 Locations
In-Office
127K-209K Annually
Senior level
Insurance
The Role
The Data Engineer II designs and maintains scalable data pipelines using AWS and Databricks, optimizing ETL/ELT workflows, collaborating with teams to deliver high-quality datasets, and supporting AI/ML use cases through data preparation and validation.
Summary Generated by Built In
Who Are We?

Taking care of our customers, our communities and each other. That’s the Travelers Promise. By honoring this commitment, we have maintained our reputation as one of the best property casualty insurers in the industry for over 170 years. Join us to discover a culture that is rooted in innovation and thrives on collaboration. Imagine loving what you do and where you do it.

Job Category
Technology

Compensation Overview

The annual base salary range provided for this position is a nationwide market range and represents a broad range of salaries for this role across the country. The actual salary for this position will be determined by a number of factors, including the scope, complexity and location of the role; the skills, education, training, credentials and experience of the candidate; and other conditions of employment. As part of our comprehensive compensation and benefits program, employees are also eligible for performance-based cash incentive awards.

Salary Range$126,500.00 - $208,700.00

Target Openings
1

What Is the Opportunity?
Travelers Data Engineering team constructs pipelines that contextualize and provide easy access to data by the entire enterprise. As a Data Engineer, you will play a key role in growing and transforming our analytics landscape. In addition to your strong analytical mind, you will bring your inquisitive attitude and ability to translate stories found in data by leveraging a variety of data programming techniques. You will leverage your ability to design, build and deploy data solutions that capture, explore, transform, and utilize data to support Artificial Intelligence, Machine Learning and business intelligence/insights.What Will You Do?
  • Design, develop, and maintain scalable batch and streaming data pipelines using Databricks and cloud-native services
  • Build and optimize ETL/ELT workflows using Python, SQL, and Spark
  • Work with structured and semi-structured data stored in cloud object storage (e.g., Amazon S3)
  • Collaborate with analytics, BI, and application teams to deliver high-quality, trusted datasets
  • Apply FinOps best practices by monitoring resource usage, optimizing job performance, and identifying cost-saving opportunities
  • Support AI/ML use cases by preparing and curating high-quality datasets for model training and inference
  • Assist with feature engineering pipelines and data validation for ML workflows
  • Implement data quality checks, monitoring, and performance tuning
  • Follow best practices for data security, governance, and access controls
  • Support production workloads, troubleshoot issues, and participate in operational support as needed
  • Contribute to documentation, standards, and reusable data engineering patterns
What Will Our Ideal Candidate Have?
  • Bachelor’s Degree in STEM related field or equivalent.
  • Eight years of related experience.
  • Hands-on experience with Databricks and Apache Spark
  • Strong experience with AWS (e.g., S3, IAM, EC2, Lambda, Glue, or related services)
  • Proficiency in Python and SQL
  • Experience working with cloud data platforms and distributed data processing systems
  • Solid understanding of data modeling, ETL/ELT concepts, and performance optimization
  • Strong communication skills and ability to work in a collaborative team environment
  • Highly proficient use of tools, techniques, and manipulation including Cloud platforms, programming languages, and a full understanding of modern software engineering practices.
  • The ability to deliver work at a steady, predictable pace to achieve commitments, deliver complete solutions but release them in small batches, and identify and negotiate important tradeoffs.
  • Demonstrated track record of domain expertise including understanding technical concepts necessary and industry trends, and possess in-depth knowledge of immediate systems worked on and some knowledge of adjacent systems.
  • Strong problem solver who ensures systems are built with longevity and creates innovate ways to resolve issues.
  • Strong written and verbal communication skills with the ability to work collaborate well with team members and business partners.
  • Ability to lead team members and help create a safe environment for others to learn and grow as engineers. and a proven track record of self-motivation in identifying opportunities and tracking team efforts.
What is a Must Have?
  • Bachelor’s degree in computer science, related STEM field, or its equivalent in education and/or work experience.
  • 4 additional years of data engineering experience.
What Is in It for You?
  • Health Insurance: Employees and their eligible family members – including spouses, domestic partners, and children – are eligible for coverage from the first day of employment.
  • Retirement: Travelers matches your 401(k) contributions dollar-for-dollar up to your first 5% of eligible pay, subject to an annual maximum. If you have student loan debt, you can enroll in the Paying it Forward Savings Program. When you make a payment toward your student loan, Travelers will make an annual contribution into your 401(k) account. You are also eligible for a Pension Plan that is 100% funded by Travelers.
  • Paid Time Off: Start your career at Travelers with a minimum of 20 days Paid Time Off annually, plus nine paid company Holidays.
  • Wellness Program: The Travelers wellness program is comprised of tools, discounts and resources that empower you to achieve your wellness goals and caregiving needs. In addition, our mental health program provides access to free professional counseling services, health coaching and other resources to support your daily life needs.
  • Volunteer Encouragement: We have a deep commitment to the communities we serve and encourage our employees to get involved. Travelers has a Matching Gift and Volunteer Rewards program that enables you to give back to the charity of your choice.
Employment Practices

Travelers is an equal opportunity employer. We value the unique abilities and talents each individual brings to our organization and recognize that we benefit in numerous ways from our differences. 

In accordance with local law, candidates seeking employment in Colorado are not required to disclose dates of attendance at or graduation from educational institutions.

If you are a candidate and have specific questions regarding the physical requirements of this role, please send us an email so we may assist you.

Travelers reserves the right to fill this position at a level above or below the level included in this posting.

To learn more about our comprehensive benefit programs please visit http://careers.travelers.com/life-at-travelers/benefits/.

Top Skills

AWS
Databricks
Pyspark
Python
Spark
SQL
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: New York, NY
35,118 Employees

What We Do

Travelers provides insurance coverage to protect the things that are important to you – your home, your car, your valuables and your business. We have been around for more than 165 years and have earned a reputation as one of the best property casualty insurers in the industry because we take care of our customers, agents, brokers, communities and each other.

Every day, our approximately 30,000 employees and 13,500 independent agents and brokers in the United States, Canada, the United Kingdom and Ireland help provide peace of mind to our customers.

Our expertise and focus on innovation have made us an industry leader and the only property casualty company in the Dow Jones Industrial Average. Our history of advancements has propelled our company, and our industry, to deliver higher standards – from writing the first auto and space travel policies to founding the Travelers Institute for public policy and launching a hybrid car discount.

By minimizing risk, preventing loss and helping our customers prepare for the unknown, Travelers’ comprehensive products and services enable individuals and businesses to feel confident and secure about the future.

Similar Jobs

In-Office
3 Locations
35118 Employees
127K-209K Annually

Wipfli Logo Wipfli

Senior Manager, Accounting Advisory - Tribal Government Industry

Cloud • Fintech • Software • Business Intelligence • Consulting • Financial Services
Remote or Hybrid
United States
3000 Employees
142K-195K Annually

Wipfli Logo Wipfli

Senior Manager/Director, Tax - High Net Worth

Cloud • Fintech • Software • Business Intelligence • Consulting • Financial Services
Remote or Hybrid
Minneapolis, MN, USA
3000 Employees
167K-213K Annually

Wipfli Logo Wipfli

Senior Manager/Director, Tax - Insurance

Cloud • Fintech • Software • Business Intelligence • Consulting • Financial Services
Remote or Hybrid
United States
3000 Employees
142K-192K Annually

Similar Companies Hiring

Globe Life Thumbnail
Insurance • Financial Services
McKinney, TX
1657 Employees
MassMutual India Thumbnail
Insurance • Information Technology • Fintech • Financial Services • Big Data
Hyderabad, Telangana
Granted Thumbnail
Mobile • Insurance • Healthtech • Financial Services • Artificial Intelligence
New York, New York
23 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account