Sr Data Engineer

Job Title: Sr. Data Engineer

Position Summary: 

The Senior Data Engineer must have expertise in SQL, Python and PySpark, with extensive knowledge and practical experience in utilizing AWS services. The Senior Data Engineer has a strong background in data engineering, with a focus on building scalable and efficient data pipelines. They will work with a wide array of healthcare data for ingestion, processing and consumption including but not limited to eligibility, claims, payments and risk adjustment. The Senior Data Engineer supports Pareto Operations.

 Key Duties and Responsibilities:​

• Design, develop, and maintain robust data pipelines using Python and PySpark to process large volumes of healthcare data efficiently in a multitenant analytics platform.
• Collaborate with cross-functional teams to understand data requirements, implement data models, and ensure data integrity throughout the pipeline.
• Optimize data workflows for performance and scalability, considering factors such as data volume, velocity, and variety.
• Implement best practices for data ingestion, transformation, and storage in AWS services such as S3, Glue, EMR, Athena, and Redshift.
• Model data in relational databases (e.g., PostgreSQL, MySQL) and file-based databases to support data processing requirements.
• Design and implement ETL processes using Python and PySpark to extract, transform, and load data from various sources into target databases.
• Troubleshoot and enhance existing ETLs and processing scripts to improve efficiency and reliability of data pipelines.
• Develop monitoring and alerting mechanisms to proactively identify and address data quality issues and performance bottlenecks.

Education and Experience:                 

• Bachelor's or Master's degree in Computer Science, Data Engineering, or a related field.
• Minimum of 5 years of experience in data engineering, with a focus on building and optimizing data pipelines.
• Expertise in Python programming and hands-on experience with SQL and PySpark for data processing and analysis.
• Proficiency in Python frameworks and libraries for scientific computing (e.g. Numpy, Pandas, SciPy, Pytorch, Pyarrow).
• Strong understanding of AWS services and experience in deploying data solutions on cloud platforms.
• Experience working with healthcare data, including but not limited to eligibility, claims, payments, and risk adjustment datasets.
• Expertise in modeling data in relational databases (e.g., PostgreSQL, MySQL) and file-based databases, ETL processes and data warehousing concepts.
• Proven track record of designing, implementing, and troubleshooting ETL processes and processing scripts using Python and PySpark.
• Excellent problem-solving skills and the ability to work independently as well as part of a team.
• Relevant certifications in AWS or data engineering would be a plus.

Knowledge, Skills, and Abilities:               

• Expertise in Python programming language for data processing and analysis.
• Expertise in PySpark for building scalable data pipelines.
• Hands-on experience with SQL query authoring for data analyses and validation
• In-depth knowledge of AWS services such as S3, Glue, EMR, Athena, and Redshift for data storage and processing.
• Familiarity with relational databases (e.g., PostgreSQL, MySQL) and file-based databases for data modeling and storage.
• Understanding of data modeling, ETL processes, and data warehousing concepts.
• Knowledge of best practices in data engineering and experience in optimizing data workflows for performance and scalability.
• Experience in healthcare data domains, including eligibility, claims, payments, and risk adjustment datasets.
• Up-to-date knowledge of emerging technologies and trends in data engineering.
• Strong problem-solving skills and the ability to troubleshoot and optimize data pipelines and ETL processes.
• Excellent communication and collaboration skills to work effectively with cross-functional teams.
• Proficient in designing, implementing, and maintaining data pipelines for processing large volumes of data.
• Ability to model data in relational and file-based databases to support data processing requirements.
• Skill in developing monitoring and alerting mechanisms to ensure data quality and pipeline reliability.
• Experience in deploying data solutions on cloud platforms and utilizing AWS services for data processing.
• Proficiency in writing efficient and maintainable code for data processing tasks.
• Ability to stay organized, prioritize tasks, and meet project deadlines effectively.
• Ability to work independently and in a team-oriented, collaborative environment.
• Strong analytical skills to identify and address data quality issues and performance bottlenecks.
• Capability to innovate and recommend solutions for continuous improvement in data engineering processes.
• Ability to communicate complex technical concepts to non-technical stakeholders effectively.
• Strong attention to detail and commitment to delivering high-quality work.
• Ability to deal with problems involving several concrete variables in standardized situations. 
• Ability to interact politely, tactfully and firmly with a wide range of people and personalities. 
• Ability to work in an environment with potential interruptions. 
• Ability to manage multiple simultaneous tasks with individual timeframes and priorities. 

The expected base salary for this position ranges from $90,000 – 120,000 with a bonus target of up to 5% of the base salary. We do consider a wide range of factors when making offer decisions, including (but not limited to) the scope and responsibilities of the position, a candidate’s relevant skills, training, experience, education and where applicable, licensure and certifications obtained. We also consider organizational and market factors when making offer decisions.

Equal Employment Opportunity Statement:
Convey Health Solutions is an Equal Opportunity Employer committed to fostering an inclusive and diverse workforce. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex (including pregnancy, sexual orientation, or gender identity), national origin, age, disability, genetic information, veteran status, or any other characteristic protected by applicable federal, state, or local laws.
Convey Health Solutions also provides reasonable accommodations to qualified individuals with disabilities in accordance with applicable laws. Applicants requiring accommodation during the application or interview process should contact the Human Resources department.

The Convey Health Solutions family of companies, including Pareto Intelligence™, delivers a powerful combination of purpose-built technology, advanced analytics, and expert services to help health plans thrive in a complex, post, Affordable Care Act environment.
As a trusted partner to Medicare and commercial payers, we provide scalable, compliant solutions that span the entire member lifecycle, from enrollment and billing to risk adjustment, Stars performance, and member engagement. Pareto’s deep analytics and financial intelligence complement Conveys’ operational expertise, enabling our clients to improve performance, reduce costs, and create better healthcare experiences for millions of Americans, especially seniors and vulnerable populations.
Together, we help health plans scale smarter, grow stronger, and make healthcare work better for the people who need it most.
Learn more at www.ConveyHealthSolutions.com.