We are seeking a Level 2 AWS Data Engineer to join our team. This role involves monitoring, troubleshooting, and optimizing AWS-based data pipelines while ensuring data integrity and pipeline continuity. You will work with AWS Glue, Lambda, Step Functions, and other AWS data services to investigate job failures, re-run ETL jobs, and support production workloads. This position operates in rotational shifts (24/7) with alternate weekends off to provide continuous coverage.
Location: Lahore, Karachi, Islamabad
Work Schedule: 5 days a week, 8-hour rotational shifts (24/7 coverage) with alternate weekends off
- Monitor, troubleshoot, and support AWS data pipelines using any two of AWS Glue, Lambda, Step Functions, Athena, Redshift, or Airflow.
- Investigate job failures, analyze CloudWatch logs, and collaborate with L2/L3 teams to implement corrective actions.
- Re-run failed jobs and retry data ingestion processes while ensuring data consistency.
- Work closely with L2/L3 engineers and data architects to escalate and resolve complex issues.
- Maintain documentation of troubleshooting steps, common issues, and resolutions.
- Participate in incident response and recovery procedures as needed.
- Provide technical support for production data pipelines, ensuring SLAs are met.
- Bachelor’s degree in Computer Science, Data Science, Information Technology, or a related field.
- Up to 2+ years of experience in Data Processing / ETL.
- Hands-on experience with any two of AWS Glue, Athena, Lambda, Step Functions, Redshift.
- Proficiency in Python and SQL for data querying and processing (preferred).
- Familiarity with PySpark and ETL development (a plus).
- Experience in monitoring and debugging AWS Glue jobs, Step Functions, and Lambda logs (a plus).
- Strong analytical and problem-solving skills to diagnose and resolve data processing failures.
- Ability to work independently while effectively collaborating with cross-functional teams.
- AWS certifications such as AWS Certified Data Analytics – Specialty or AWS Certified Solutions Architect Associate (preferred but not mandatory).
- Excellent communication and interpersonal skills.
- Prior experience in L1/L2 support (a plus).
- Senior Data Engineer (L2/L3 Support / ETL Development)
- Big Data Engineer / AWS Data Architect
- Data Engineering Lead / Architect
What We Do
NorthBay is an AWS Premier Partner focused on Database & Application migrations, data & analytics, DevOps & DataOps, application modernization and ML/Ai.
Our practice areas include big data and analytics, machine learning, artificial intelligence and database migrations.
