Lead Data Engineer

Posted 4 Days Ago
Be an Early Applicant
4 Locations
In-Office
99K-163K Annually
Senior level
Insurance • Financial Services
The Role
The Lead Data Engineer will design, build, and maintain data pipelines, mentor team members, and create scalable data solutions for operational, reporting, and ML purposes.
Summary Generated by Built In

Guardian is seeking a highly skilled and motivated Lead Data Engineer to join the FPRS&CSWM Data Engineering team. In this role, you will play a crucial part in designing, building, and maintaining the data pipelines that power our Operational ,reporting, ML & AI use cases. Your expertise will help us transform raw data into actionable insights via data products, ensuring that our data solutions are robust, scalable and efficient. The ideal candidate will have a passion for data engineering, thrive in a collaborative environment and are excited about leveraging cutting-edge technologies to drive business success.

Your contributions will go beyond hands-on engineering, as you help bring life to innovative ideas and mentor other engineers. You’ll thrive in a fast-paced, collaborative environment, balancing technical execution with a deep understanding of business needs. We value curiosity, creativity, and continuous learning. If you’re passionate about solving meaningful problems and creating value through data-driven innovation, we look forward to welcoming you to our team.

You will

  • Lead technical design and implementation of data engineering solutions, ensuring best practices and high-quality deliverables.
  • Mentor and guide junior engineers, conducting code reviews and technical sessions to foster team growth.
  • Perform detailed analysis of raw data sources by applying business context and collaborate with cross-functional teams to transform raw data into data products
  • Create scalable and trusted data pipelines which generate curated data assets in centralized data lake/data warehouse ecosystems.
  • Monitor and troubleshoot data pipeline performance, identifying and resolving bottlenecks and issues.
  • Construct meaningful data assets sourced from structured, semi structured, and unstructured data.
  • Develop real-time data solutions by creating new API endpoints or streaming frameworks.
  • Develop, test, and maintain robust tools, frameworks, and libraries that standardize and streamline the data lifecycle.
  • Collaborate with cross-functional teams of Data Science, Data Engineering, business units, and other IT teams.
  • Create and maintain effective documentation for projects and practices, ensuring transparency and effective team communication.
  • Provide technical leadership and mentorship on continuous improvement in building reusable and scalable solutions.
  • Contribute to enhancing strategy for advanced data engineering practices and lead execution of key initiatives.
  • Stay up-to-date with the latest trends in modern data engineering, machine learning & AI.

You have

  • Bachelor’s or Master’s degree with 8+ years of experience in Computer Science, Engineering, or a related field.
  • 5+ years of experience working with Python, SQL, PySpark, and bash scripts. Proficient in software development lifecycle and software engineering practices.
  • 4+ years of experience developing and maintaining robust data pipelines for both structured and unstructured data for advanced analytical and reporting use cases.
  • 3+ years of experience working with Cloud Data Warehousing (Redshift, Snowflake, Databricks SQL or equivalent) platforms and distributed frameworks like Spark.
  • 2+ years of experience leading a team of engineers and a track record of delivering robust and scalable data solutions with highest quality.
  • Solid understanding of data modeling and warehousing techniques. Experience working in a data warehouse is a plus.
  • Proficiency in understanding REST APIs, experience using different types of APIs to extract data or perform functionalities.
  • Hands-on experience building and maintaining tools and libraries used by multiple teams across the organization (e.g., Data Engineering utility libraries, DQ Libraries).
  • Proficient in understanding and incorporating software engineering principles in design & development process.
  • Hands-on experience with CI/CD tools (e.g., Jenkins or equivalent), version control (Github, Bitbucket), orchestration (Airflow, Prefect or equivalent).
  • Excellent communication skills and ability to work and collaborate with cross-functional teams across technology and business.

Location

  • Three days a week at a Guardian office in Bethlehem, PA, New York, NY. Pittsfield, MA or Holmdel, NJ.

Salary Range:

$99,150.00 - $162,885.00

The salary range reflected above is a good faith estimate of base pay for the primary location of the position. The salary for this position ultimately will be determined based on the education, experience, knowledge, and abilities of the successful candidate. In addition to salary, this role may also be eligible for annual, sales, or other incentive compensation.

Our Promise

At Guardian, you’ll have the support and flexibility to achieve your professional and personal goals.  Through skill-building, leadership development and philanthropic opportunities, we provide opportunities to build communities and grow your career, surrounded by diverse colleagues with high ethical standards.

Inspire Well-Being

As part of Guardian’s Purpose – to inspire well-being – we are committed to offering contemporary, supportive, flexible, and inclusive benefits and resources to our colleagues. Explore our company benefits at www.guardianlife.com/careers/corporate/benefits. Benefits apply to full-time eligible employees. Interns are not eligible for most Company benefits.

Equal Employment Opportunity

Guardian is an equal opportunity employer. All qualified applicants will be considered for employment without regard to age, race, color, creed, religion, sex, affectional or sexual orientation, national origin, ancestry, marital status, disability, military or veteran status, or any other classification protected by applicable law.

Accommodations

Guardian is committed to providing access, equal opportunity and reasonable accommodation for individuals with disabilities in employment, its services, programs, and activities. Guardian also provides reasonable accommodations to qualified job applicants (and employees) to accommodate the individual's known limitations related to pregnancy, childbirth, or related medical conditions, unless doing so would create an undue hardship. If reasonable accommodation is needed to participate in the job application or interview process, to perform essential job functions, and/or to receive other benefits and privileges of employment, please contact [email protected]. Please note: this resource is for accommodation requests only. For all other inquires related to your application and careers at Guardian, refer to the Guardian Careers site.

Visa Sponsorship

Guardian is not currently or in the foreseeable future sponsoring employment visas. In order to be a successful applicant. you must be legally authorized to work in the United States, without the need for employer sponsorship.

Current Guardian Colleagues: Please apply through the internal Jobs Hub in Workday.

Top Skills

Airflow
AWS
Bash
Bitbucket
Ci/Cd
Databricks Sql
Git
Jenkins
Prefect
Pyspark
Python
Redshift
Snowflake
Spark
SQL
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: New York, NY
8,709 Employees
Year Founded: 1860

What We Do

Who we are

Guardian makes a difference in the lives of people when they need us most. With over 160 years of stability and fiscal integrity, we are a trusted resource to generations of families and business owners, inspiring well-being and helping build financial confidence.

Today, we stand behind 29 million consumers, helping them prepare and plan for a bright future for themselves and their families. We help business owners care for their employees. And we help people recover and thrive in times of unexpected loss.

As a modern mutual insurance company, we believe in driving value beyond dividends. We invest in our colleagues and are building a progressive, innovative and inclusive culture. We uplift individuals and communities through thoughtful social and environmental programs.

What we stand for

In 1860, a community of immigrants joined together to insure and protect their businesses and families. They were guided by powerful ideals that we’ve continued to stand behind and evolved throughout the years: we do the right thing, we believe people count, we courageously shape the future together, and we go above and beyond for the people we serve.

Guardian employees embrace and live by these values every day. They remind us to put people at the heart of all we do so that we can help protect what matters most to you. Want to help bring these values to life? Join us for a rewarding career and the opportunity to shape the future.

Disclosures:
Financial information concerning Guardian as of December 31, 2022, on a statutory basis: Admitted assets = $76.0 billion; liabilities = $67.2 billion (including $55.0 billion of reserves); and surplus = $8.8 billion. Dividends are not guaranteed. They are declared annually by Guardian’s Board of Directors.
Guardian® is a registered trademark of The Guardian Life Insurance Company of America. © Copyright 2023 The Guardian Life Insurance Company of America 2023-156184 Exp. 5/25

Similar Jobs

GoodRx Logo GoodRx

Lead Data Engineer

Consumer Web • Coupons • Healthtech • Social Impact • Pharmaceutical
Remote or Hybrid
USA
800 Employees
75K-323K Annually

Launch Potato Logo Launch Potato

Lead Data Engineer

AdTech • Big Data • Consumer Web • Digital Media • Marketing Tech
Easy Apply
In-Office or Remote
Newark, NJ, USA
160 Employees
150K-190K Annually

Launch Potato Logo Launch Potato

Lead Data Engineer

AdTech • Big Data • Consumer Web • Digital Media • Marketing Tech
Easy Apply
In-Office or Remote
Jersey City, NJ, USA
160 Employees
150K-190K Annually

Zelis Logo Zelis

Lead Data Engineer

Information Technology • Consulting
In-Office
6 Locations
924 Employees
127K-161K Annually

Similar Companies Hiring

Amplify Platform Thumbnail
Fintech • Financial Services • Consulting • Cloud • Business Intelligence • Big Data Analytics
Scottsdale, AZ
62 Employees
Rain Thumbnail
Web3 • Payments • Infrastructure as a Service (IaaS) • Fintech • Financial Services • Cryptocurrency • Blockchain
New York, NY
80 Employees
Granted Thumbnail
Mobile • Insurance • Healthtech • Financial Services • Artificial Intelligence
New York, New York
23 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account