We are seeking a Lead AWS Data Engineer to drive data engineering architecture, pipeline development, and technical delivery using AWS native services, Python, and PySpark. The role involves building scalable data products, modernizing enterprise data platforms, and providing technical leadership to data engineering teams.
Lead the design and development of scalable data pipelines using AWS Glue, EMR, S3, Python, and PySpark.
Drive enterprise data integration, ETL/ELT workflows, and data product development.
Define engineering standards and conduct design and code reviews.
Optimize pipeline performance, data quality, and processing scalability.
Guide and mentor Data Engineers while collaborating with architecture, technology, and business teams.
Requirements
Strong experience in AWS Data Engineering, S3, Glue, and EMR.
Proficiency in Python, PySpark, SQL, and ETL/ELT.
Expertise in data pipeline design, optimization, and enterprise data integration.
Experience in technical leadership, code reviews, and team mentoring.
Experience with Amazon Redshift, Athena, and DynamoDB.
Knowledge of Apache Iceberg and data lake/lakehouse architecture.
Experience with domain-oriented data products and authoritative data sources.
Exposure to large-scale enterprise data modernization.
Benefits
Skills Required
- Strong experience in AWS data engineering, Amazon S3, AWS Glue, and Amazon EMR
- Proficiency in Python, PySpark, SQL, and ETL/ELT
- Expertise in data pipeline design, optimization, and enterprise data integration
- Experience with technical leadership, code reviews, and team mentoring
- Experience with Amazon Redshift, Amazon Athena, and Amazon DynamoDB
- Knowledge of Apache Iceberg and data lake or lakehouse architecture
- Experience with domain-oriented data products and authoritative data sources
- Exposure to large-scale enterprise data modernization
What We Do
Exavalu leads the way in business and technology consulting and solution delivery, focusing on specialized digital transformation across the Insurance, Healthcare & Life Sciences, and Nonprofit industries. As an award-winning digital transformation advisor, we take pride in delivering leading-edge solutions to clients worldwide. Led by industry veterans and technology experts, we bring our deep understanding in customer experience, process automation, digital engineering, cloud, data and AI with a very strong industry core foundation. Drawing on our industry insights and technological acumen, we enable clients to drives growth, profitability, and cost optimization. We mitigate risks and elevate customer experience through our comprehensive suite of services, including strategic advisory, expert-led technology [build and maintenance], and best-in-class products and solutions. Our unwavering focus on understanding the industry's hard problems and finding the right solution has garnered recognition as the preferred ally for organizations seeking transformative growth.
