Key Responsibilities:
Design, develop, and manage complex Airflow DAGs for data workflows, ETL/ELT pipelines, and task automation.
Integrate Airflow with various data sources (e.g., databases, APIs, cloud storage) and targets.
Optimize and monitor pipeline performance and troubleshoot failures in a timely manner.
Collaborate with data engineers, analysts, and platform teams to support end-to-end data solutions.
Implement best practices for code quality, testing, version control, and deployment.
Maintain documentation and provide technical mentorship to junior engineers.
Required Skills:
3+ years of hands-on experience with Apache Airflow in production environments.
Strong programming skills in Python.
Solid understanding of data engineering concepts, including ETL/ELT processes, workflow orchestration, and data validation.
Experience with SQL and relational databases (e.g., PostgreSQL, MySQL).
Familiarity with cloud platforms (e.g., AWS, GCP, Azure) and their storage and compute services.
Knowledge of containerization tools like Docker and orchestration with Kubernetes (a plus).
Compensation, Benefits and Duration
Minimum Compensation: USD 36,000
Maximum Compensation: USD 126,000
Compensation is based on actual experience and qualifications of the candidate. The above is a reasonable and a good faith estimate for the role.
Medical, vision, and dental benefits, 401k retirement plan, variable pay/incentives, paid time off, and paid holidays are available for full time employees.
This position is not available for independent contractors
No applications will be considered if received more than 120 days after the date of this post
Skills Required
- 3+ years of hands-on experience with Apache Airflow in production
- Strong programming skills in Python
- Solid understanding of data engineering concepts including ETL/ELT, workflow orchestration, and data validation
- Experience with SQL and relational databases (PostgreSQL, MySQL)
- Familiarity with cloud platforms (AWS, GCP, Azure)
- Knowledge of Docker and Kubernetes
What We Do
Photon.com has emerged as one of the world’s largest and fastest-growing Digital Agencies. We work with 40% of the Fortune 100 on their Digital initiatives and are known for our ability to integrate Strategy Consulting, Creative Design, and Technology at scale. Please visit www.photon.com to learn more about us, how we work, and our customer case studies. Digital Transformation Starts Here.
