The Role
Designs and operates Azure-based data platforms, including infrastructure as code, Snowflake, Astronomer/Airflow, dbt CI/CD, secure data ingestion, secrets management, and observability. Leads platform reliability, security, automation, documentation, and collaboration with data engineering and architecture teams. Builds production-grade deployment pipelines and establishes operational standards, SLAs, and reliability targets.
Summary Generated by Built In
ROLE OVERVIEW
We are seeking an experienced DevOps Engineer with strong data platform and SRE expertise to drive the
design, implementation, and operational excellence of a modern client Data Platform.
In this high-impact position, you will bridge the gap between infrastructure automation and modern data
architecture. You will lead technical initiatives covering automated provisioning on Microsoft Azure,
orchestrating scalable enterprise data workflows via Astronomer and dbt, and establishing robust
continuous integration/continuous delivery (CI/CD) practices for all data engineering workloads.
PRIMARY RESPONSIBILITIES
Infrastructure as Code: Design, implement, and deploy ARM templates for automated Azure infrastructure
provisioning and environment lifecycle management.
Azure Service Provisioning: Configure and maintain scalable Azure services, including Azure Functions, Event Bus,
and Event Grid for event-driven data flows.
Snowflake Architecture & Security: Create and manage enterprise Snowflake accounts. Maintain role-based
access control (RBAC), virtual warehouses, security policies, and performance tuning.
Workflow Orchestration: Deploy, configure, and operate Astronomer (Apache Airflow) for production-grade
orchestration and scheduling of data pipelines.
dbt Pipeline Automation: Automate deployment pipelines for dbt projects, ensuring strict code quality standards,
modularity, test coverage, and continuous delivery.
Secrets & Security Governance: Centralize and secure credential management using Azure Key Vault (AKV) for
safe DevOps automation and runtime access across environments.
Secure File Transport: Architect and set up SFTP ingestion workflows utilizing a Bastion Host, ensuring secure
landing into Azure Blob Storage containers.
CI/CD Engineering: Build, maintain, and optimize robust CI/CD deployment pipelines (e.g., Azure Repos /
Pipelines) tailored for data engineering workloads.
Platform Observability: Monitor overall system health, data pipeline reliability, and platform performance using
enterprise observability tooling (e.g., Prometheus, Grafana).
Integration Management: Establish seamlessly integrated ecosystems connecting Snowflake with upstream and
downstream systems, specifically dbt and Astronomer.
Architectural Collaboration: Partner closely with Data Engineers, Data Architects, and enterprise stakeholders to
define infrastructure deployment standards, operational SLAs, and reliability targets.
Technical Documentation: Author and maintain comprehensive technical documentation covering infrastructure
designs, CI/CD procedures, runbooks, and DevOps best practices.
Requirements
- 8+ years in a DevOps, SRE, or Data Infrastructure
role within a data-centric enterprise environment.
- Azure Expertise: Strong practical experience with
ARM templates, Azure Resource Manager, Azure
Functions, Event Bus, and Event Grid.
- Airflow / Astronomer: Hands-on experience
deploying and operating Astronomer or Apache
Airflow in production.
- Data CI/CD: Proven track record building CI/CD
pipelines specifically for data workloads (dbt,
Airflow, schema migrations).
- Snowflake Mastery: Deep understanding of
Snowflake RBAC, performance tuning, warehouse
management, and ecosystem integrations.
- Containerization: Solid hands-on experience with
Docker and managing containerized services in
production environments.
- Secrets Security: Demonstrated experience
managing secrets, keys, and certificates securely
via Azure Key Vault (AKV).
- Data Ingestion Architecture: Practical exposure
to secure SFTP-to-Blob integrations using
Bastion host routing.
- Observability: Proficiency with monitoring and
alerting tools such as Prometheus, Grafana, or
cloud-native telemetry.
Nice to Have
- Exposure to dbt Cloud or advanced dbt Core
deployment patterns.
- Familiarity with GitOps workflows and declarative
infrastructure tools.
- Experience working in agile, cross-functional
engineering teams.
- In-depth understanding of enterprise data
governance and security frameworks.
Skills Required
- 8+ years of experience in DevOps, SRE, or data infrastructure roles within a data-centric enterprise environment
- Strong practical experience with ARM templates, Azure Resource Manager, Azure Functions, Azure Event Bus, and Azure Event Grid
- Production experience deploying and operating Astronomer or Apache Airflow
- Experience building CI/CD pipelines for data workloads, including dbt, Airflow, and schema migrations
- Deep understanding of Snowflake RBAC, performance tuning, warehouse management, and ecosystem integrations
- Hands-on experience with Docker and containerized production services
- Experience managing secrets, keys, and certificates with Azure Key Vault
- Practical experience with secure SFTP-to-Azure Blob Storage integrations using Bastion host routing
- Proficiency with Prometheus, Grafana, or cloud-native telemetry tools
- Exposure to dbt Cloud or advanced dbt Core deployment patterns
- Familiarity with GitOps workflows and declarative infrastructure tools
- Experience working in agile, cross-functional engineering teams
- Understanding of enterprise data governance and security frameworks
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
Blackbuck Insights is a global data and AI consultancy providing data engineering services, cloud modernization, AI activation, and platform operations. The company helps enterprises modernize legacy environments, migrate and scale data platforms, build AI-enabled business applications, and establish trusted data foundations for analytics and intelligent decision-making. Its services support organizations seeking reliable, performant, and scalable technology solutions.
