Manager of Data Engineering

Role

SmarterDx is seeking a Manager of Data Engineering to lead and grow our data engineering team. In this senior role, you will oversee the implementation and integration of client data into SmarterDx products, ensuring the highest standards of data transformation, validation, and resilience. You will drive strategic initiatives, enhance system robustness, and optimize data processes, while providing leadership and direction to the data engineering team.

Key Responsibilities

• Lead and mentor the data engineering team to foster a culture of excellence and continuous improvement, owning the data platform and collaborating with cross-functional teams.
• Ensure data engineering efforts align with company needs, particularly supporting Data Science in feature engineering and data modeling for new products.
• Oversee the standardization and normalization of client data, implementing rigorous testing and validation to meet SmarterDx data specifications.
• Design and implement robust ETL pipelines to facilitate comprehensive data analysis for SmarterDx products.
• Lead initiatives to enhance system resilience, improve instrumentation, and monitor impacts, driving continuous improvement in data processes.
• Develop and enforce industry standards and best practices in data engineering to ensure reliability and scalability of data infrastructure.
• Participate in and lead a rotation of engineers to address production data issues, optimizing performance and efficiency of data workflows.

Your Qualities

• Experience:
  • 7+ years of data engineering experience, with a significant portion in a leadership role, preferably in the healthcare industry involving clinical and/or billing/claims data.
  • Proven track record in SQL, ELT processes, and data orchestration, with experience in DBT, Airflow, and Python being a significant plus.
• Leadership:
  • Demonstrated ability to lead and inspire a high-performing data engineering team.
  • Strong strategic thinking and problem-solving skills, with a pragmatic approach to decision-making.
  • Excellent communication and collaboration skills, with the ability to influence stakeholders at all levels.
• Personal Attributes:
  • Own and take full responsibility for initiatives from inception to successful implementation.
  • Ability to roll up your sleeves and jump into the codebase to assist the team when necessary.
  • Demonstrate versatility and proficiency in navigating complex processes and ambiguous situations.
  • Embrace a collaborative team environment and provide constructive advice to achieve positive outcomes.

Our Data Science stack

• Databases: Snowflake (primary), DynamoDB
• Cloud Infrastructure: AWS (including S3, MWAA, Sagemaker)
• Technologies: SQL, dbt, Python

Compensation

• $170-200k+ base salary (upward flexibility for more Senior candidates) + equity