Experience: 5–7 Years
Location: Cairo, Egypt (Onsite)
Employment Type: Full-Time
We are looking for a skilled Senior Data Engineer with strong AWS expertise to design, develop, and optimize cloud-based data pipelines and solutions. The role involves hands-on development, collaboration with cross-functional teams, and contributing to scalable, high-performance data platforms. The ideal candidate has solid AWS experience, strong programming skills, and an understanding of data engineering best practices.
Key Responsibilities- Develop and maintain batch and real-time data pipelines on AWS
- Implement ETL/ELT solutions using AWS Glue, Spark on EMR, and other AWS services
- Assist in workflow orchestration using Apache Airflow (MWAA)
- Support serverless data processing using AWS Lambda
- Participate in designing data warehousing solutions using Amazon Redshift
- Design and manage data storage strategies with Amazon S3 and DynamoDB
- Apply data governance and access controls using AWS DataZone
- Monitor and troubleshoot data platform issues using Amazon CloudWatch
- Collaborate with Analytics, BI, Data Science, and Business teams
- Write clean, efficient code, and perform peer code reviews
- Follow security, compliance, and data governance standards
- 5–7 years of experience in Data Engineering or related roles
- 3+ years of hands-on experience designing data solutions on AWS
- Proficiency with: AWS Glue, Amazon EMR (Spark), AWS Lambda, Apache Airflow (MWAA), Amazon EC2, Amazon CloudWatch, Amazon Redshift, Amazon DynamoDB, AWS DataZone, Amazon S3
- Strong programming skills in Python
- Advanced SQL skills with performance tuning expertise
- Understanding of data warehousing, data modeling (Star/Snowflake), ETL/ELT best practices
- Familiarity with Agile/Scrum delivery environments
- Problem-solving and analytical skills
- AWS Professional Certification (Solutions Architect / Data Analytics Specialty)
- Experience with real-time streaming (Kinesis, Kafka)
- Exposure to data governance and metadata management tools
- Knowledge of cost optimization in AWS
Skills Required
- 5-7 years of experience in Data Engineering or related roles
- 3+ years of hands-on experience designing data solutions on AWS
- Proficiency with AWS Glue
- Proficiency with Amazon EMR (Spark)
- Proficiency with AWS Lambda
- Proficiency with Apache Airflow (MWAA)
- Proficiency with Amazon EC2
- Proficiency with Amazon CloudWatch
- Proficiency with Amazon Redshift
- Proficiency with Amazon DynamoDB
- Proficiency with AWS DataZone
- Proficiency with Amazon S3
- Strong programming skills in Python
- Advanced SQL skills with performance tuning expertise
- Understanding of data warehousing, data modeling (Star/Snowflake), ETL/ELT best practices
- Familiarity with Agile/Scrum delivery environments
- Problem-solving and analytical skills
- AWS Professional Certification (Solutions Architect / Data Analytics)
- Experience with real-time streaming (Kinesis, Kafka)
- Exposure to data governance and metadata management tools
- Knowledge of cost optimization in AWS
What We Do
NorthBay is an AWS Premier Partner focused on Database & Application migrations, data & analytics, DevOps & DataOps, application modernization and ML/Ai. Our practice areas include big data and analytics, machine learning, artificial intelligence and database migrations.
