Experience: 10–12 Years
Location: Cairo, Egypt (Onsite)
Employment Type: Full-Time
We are seeking an experienced Lead Data Engineer with deep expertise in AWS to architect, lead, and oversee the development of enterprise-grade, scalable data platforms. The role demands strong technical leadership, solution architecture skills, and ownership of end-to-end data engineering initiatives. The candidate will mentor teams, drive best practices, and ensure secure, high-performance, and cost-optimized data solutions.
Key Responsibilities- Lead design and implementation of batch and real-time data pipelines on AWS
- Architect and implement ETL/ELT solutions using AWS Glue, Spark on EMR, and other AWS-native services
- Lead workflow orchestration using Apache Airflow (MWAA)
- Architect serverless data processing solutions with AWS Lambda
- Design enterprise-grade data warehousing solutions using Amazon Redshift
- Develop and enforce data storage strategies using Amazon S3 and DynamoDB
- Implement and govern data cataloging, governance, and access control using AWS DataZone
- Establish monitoring, logging, and observability using Amazon CloudWatch
- Drive performance optimization, scalability, and cost efficiency
- Troubleshoot complex data processing and infrastructure issues
- Collaborate with cross-functional teams including Analytics, BI, Data Science, and Business teams
- Provide technical leadership, conduct code reviews, and mentor junior engineers
- Ensure adherence to security, compliance, and data governance standards
- Participate in architecture discussions and contribute to long-term data strategy
- 10–12 years of experience in Data Engineering or related roles
- 5+ years of hands-on experience designing enterprise-grade AWS solutions
- Expertise with: AWS Glue, Amazon EMR (Spark), AWS Lambda, Apache Airflow (MWAA), Amazon EC2, Amazon CloudWatch, Amazon Redshift, Amazon DynamoDB, AWS DataZone, Amazon S3
- Strong programming skills in Python
- Advanced SQL skills with performance tuning expertise
- Strong understanding of data warehousing, data modeling (Star/Snowflake), ETL/ELT best practices
- Experience designing scalable, distributed data processing systems
- Proven experience in leading teams, mentoring engineers, and making architectural decisions
- Experience working in Agile/Scrum delivery environments
- AWS Professional Certification (Solutions Architect / Data Analytics Specialty)
- Experience with real-time streaming (Kinesis, Kafka)
- Exposure to metadata management, data lineage, and governance tools
- Expertise in cost optimization strategies in AWS
- Experience working with large-scale enterprise data platforms
Top Skills
What We Do
NorthBay is an AWS Premier Partner focused on Database & Application migrations, data & analytics, DevOps & DataOps, application modernization and ML/Ai.
Our practice areas include big data and analytics, machine learning, artificial intelligence and database migrations.
