Experience - 4 - 6 years
Key Responsibilities
DAG Development & Developer Enablement
• Design, develop, and optimize Airflow DAGs for enterprise use cases
• Demonstrate strong experience with operators such as PythonOperator, SQL operators,
API/HTTP operators, KubernetesPodOperator etc.
• Apply advanced DAG patterns including dynamic DAGs, branching, sensors, retries, and
error handling
• Troubleshoot DAG failures, performance issues, and integration challenges
• Enable orchestration of modern data workflows including DBT pipelines
• Provide reusable templates, best practices, and onboarding support to drive self-service
adoption
Platform Operations & Kubernetes Support
• Support Airflow platform deployed on AKS, covering scheduler, webserver/API, workers,
and metadata services
• Troubleshoot issues related to task execution, scheduling delays, and resource bottlenecks
• Diagnose Kubernetes-level issues involving pods, networking, storage, and RBAC
• Work with Azure services such as Key Vault, Storage, and networking
• Support CI/CD pipelines for DAG and container-based deployments
• Improve platform stability, monitoring, and alerting
Required Skills
• Strong experience with Apache Airflow (3.x or later) in production environments
• Proven experience in DAG development using operators and orchestration patterns
• Working knowledge of Kubernetes (AKS preferred) to support Airflow runtime
• Expert-level Python knowledge for building, debugging, and maintaining production-
grade workflows and supporting libraries
• Expertise in writing unit, integration, and DAG validation tests for Airflow workflows,
including mocking operators, validating dependencies, and ensuring reliability in CI/CD
pipelines
• Experience with DBT and modern data pipelines
• Experience with CI/CD tools (Git, Jenkins, Docker)
• Familiarity with Azure or other cloud platforms
Preferred Skills
• Experience with Astronomer / Astro Private Cloud
• Exposure to data platforms such as Snowflake, and APIs
• Experience with monitoring tools such as Splunk or Prometheus
• Knowledge of secrets management using Azure Key Vault
Summary
This role is critical to ensuring reliable platform operations and scalable adoption of the
Airflow-based orchestration platform. The ideal candidate combines strong Airflow
expertise, Kubernetes knowledge, and hands-on development experience to support both
platform stability and developer productivity.
Skills Required
- 4-6 years experience
- Experience with Apache Airflow (3.x or later) in production
- DAG development using operators and advanced orchestration patterns
- Working knowledge of Kubernetes to support Airflow runtime
- Expert-level Python for building and debugging production workflows and libraries
- Experience writing unit, integration, and DAG validation tests (CI/CD)
- Experience with DBT and modern data pipelines
- Experience with CI/CD tools and container workflows (Git, Jenkins, Docker)
- Familiarity with Azure services (Key Vault, Storage, networking)
- Platform operations skills: troubleshoot scheduler, webserver, workers, metadata services
- Experience diagnosing Kubernetes-level issues (pods, networking, storage, RBAC)
- Experience enabling developer onboarding, templates, and self-service for DAG authors
- Experience with Astronomer / Astro Private Cloud
- Exposure to Snowflake and APIs
- Experience with monitoring tools such as Splunk or Prometheus
- Knowledge of secrets management using Azure Key Vault
Jade Global Compensation & Benefits Highlights
The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Jade Global and has not been reviewed or approved by Jade Global.
-
Healthcare Strength — Core medical, dental, and vision coverage appears established with mainstream U.S. carriers, forming a solid baseline of healthcare support. EAPs and tax‑advantaged accounts (FSAs/HSAs) are also cited, indicating options beyond basic insurance.
-
Retirement Support — A 401(k) program with employer match is consistently referenced as part of the package. Availability of traditional and Roth options is noted, supporting long‑term savings flexibility.
-
Parental & Family Support — Parental leave is referenced, and family‑oriented offerings such as backup childcare are highlighted in company materials. These elements can enhance the overall family support experience even when cash pay is not top‑tier.
Jade Global Insights
What We Do
A Trusted Partner for Every Digital Enterprise Bringing Value. Jade Global is a global IT consulting company with two decades of industry experience that helps the world’s leading businesses and organizations build their digital core, optimize their operations, and accelerate revenue growth. We are headquartered in San Jose, California; Jade Global operates with offices in 13 locations across North America, the UK, and Asia. Renowned as a trusted "partner of choice" for businesses in Healthcare & Life Sciences, Hi-tech, Retail, Manufacturing, and Financial Industries, Jade Global has innovated 30+ industry-specific solutions. Whether your focus is harnessing or expanding Gen-AI, AI, and digital capabilities, transforming operating models, or accelerating insightful decision-making, we’re here to help you gain and maintain a competitive edge with efficient, sustainable models. At Jade Global, it’s all about outcomes—your outcomes—and delivering the results you desire, tailored to your unique requirements
Why Work With Us
We are Great Place to Work Certified company and Jade focus on people first approach.
Gallery
.jpg)
