Senior Data Engineer - Corporate Data Platform

Reposted 3 Months Ago
Miami, FL, USA
In-Office
140K-150K Annually
Senior level
Cybersecurity
The Role
Own design, build, and reliability of a cloud-native data lakehouse (Bronze->Silver->Gold). Build scalable ETL/ELT pipelines (ADF, Airflow), optimise Snowflake, develop dbt models, embed data quality/observability (Elementary), manage ADLS Gen2 and Azure serverless components, and drive infra-as-code, CI/CD, and cross-team collaboration.
Summary Generated by Built In

We're looking for a Senior Data Engineer to help build and run WatchGuard's corporate data platform: the foundation that stakeholders across the company and our leadership use to run the business. You'll own the design, build, and reliability of our cloud data lakehouse, from raw ingestion through analytics-ready Gold tables. It brings together data from NetSuite, Salesforce, BambooHR, Marketo, and many other systems across the company. 

This is a deeply technical role, and you'll be expected to think in the architecture of a platform, not just pipeline activities. It's also a business-facing one. You'll work directly with stakeholders across the company to understand their data source and why it's important to the business. You'll also partner closely with our analytics team, who own reporting and analysis on top of the platform you build. 

What You'll Do 

Data Platform & Pipeline Engineering 

  • Design, build, and maintain scalable pipelines using Azure Data Factory and Apache Airflow, moving data from enterprise business systems through the Medallion architecture (Bronze → Silver → Gold), with incremental loads, CDC, and event-driven ingestion where freshness calls for it. 

  • Own data models across every layer, including the Gold layer the analytics team and business users depend on. 

  • Build modular, tested dbt models with consistent naming conventions, documentation, and lineage. 

  • Build and optimize Snowflake objects for performance and cost. 

Business Partnership 

  • Work directly with business stakeholders to understand what data they need, the business case behind it, and how it will be used, before designing anything. 

  • Scope and prioritize new data source requests: what's needed, how fresh, how much history, sensitivity and access, and the effort involved. 

  • Partner with the analytics team on the data models, definitions, and data contracts they build on. 

Data Quality & Observability 

  • Build automated validation into every Medallion layer, including freshness checks, schema drift alerts, and anomaly detection, so issues are caught before they reach consumers. 

  • Define and enforce data contracts between producers and consumers: row counts, null rate thresholds, referential integrity, and value domains. 

  • Build data quality dashboards that give engineering and business stakeholders real-time confidence in platform health and data freshness. 

Azure Cloud & Infrastructure 

  • Manage and optimize Azure Data Lake Storage Gen2: zone and folder structure, lifecycle policies, access tiers, and partitioning. 

  • Build and maintain Azure Functions and Logic Apps for event-driven processing, orchestration triggers, and operational automation. 

  • Manage secrets and environment configuration securely with Azure Key Vault and managed identities, with no hardcoded credentials in pipelines or code. 

  • Help lead our move to infrastructure-as-code for our data platform, provisioning services with Terraform. 

Engineering Practices & Mentorship 

  • Lead code reviews, set and enforce standards, and mentor junior engineers on data engineering best practices. 

  • Build out CI/CD for deployments across Dev, Test, and Prod environments. 

What We're Looking For 

Must-Have 

  • Experience building data platforms that serve business functions such as Finance, Sales, Marketing, or HR, including ingesting data from enterprise applications like NetSuite, Salesforce, BambooHR, and Marketo. 

  • Experience working directly with non-technical stakeholders to scope and prioritize data requirements. 

  • Snowflake 

  • Advanced SQL: window functions, CTEs, and query profiling 

  • Native features such as streams, tasks, Snowpipe, dynamic tables, and row-level security 

  • Virtual warehouse tuning and credit cost optimization 

  • dbt 

  • Writing, testing, and documenting production models 

  • Incremental strategies and snapshots 

  • Data observability: freshness checks, anomaly detection, and schema drift alerting (Elementary or similar) 

  • Data Modeling & Medallion Architecture 

  • Dimensional modeling and hands-on Medallion architecture implementation 

  • Data validation at every layer, not just Gold 

  • Schema evolution and SCD Type 2 dimensions 

  • Azure 

  • Azure Data Factory: pipeline authoring, triggers, parameterization, and linked services 

  • ADLS Gen2: zone design, lifecycle management, and Parquet/Delta partitioning 

  • Azure Key Vault and managed identities 

  • Azure Functions and Logic Apps for event-driven automation 

  • Airflow 

  • DAG authoring, task dependencies, sensors, and connection management 

  • Deployment and monitoring in cloud-hosted environments 

  • Python 

  • Pipeline scripting and REST API integration 

  • Unit testing pipeline logic and transformations 

  • 4+ years of professional data engineering experience, including at least 2 years on Azure cloud data platforms. 

Nice-to-Have 

  • Hands-on experience applying AI within data pipelines and workflows, such as LLM-based data enrichment, classification, or anomaly detection (e.g., Snowflake Cortex or similar). 

  • Terraform experience provisioning Azure infrastructure. 

  • Familiarity with Microsoft Fabric and OneLake as a complementary or future-state platform. 

  • Data mesh or data product thinking, and how it maps to ownership across Medallion layers. 

    Why Work for WatchGuard?

    WatchGuard is a global leader in network security and intelligence, advanced endpoint protection, multi-factor authentication, and secure Wi-Fi. Our award-winning products and services are trusted worldwide by more than 18,000 security resellers and service providers to protect more than 250,000 customers. Our technology keeps our customers ahead of increasingly sophisticated hackers and has fueled record revenues at WatchGuard.

    WatchGuard is headquartered in Seattle, Washington, with team members working remotely and in offices worldwide.

    Our company culture places an intense focus on our customers and employees. From the newest employee to our CEO, you'll find that each person at WatchGuard embodies our Core Values: Accountability, Community, Belonging, Action, Innovation, and Customer-Centric. Learn more about our company culture at www.watchguard.com/wgrd-careers.

    WatchGuard provides equal employment opportunities for all qualified employees, regardless of their race, color, national origin, religion, ancestry, creed, pregnancy, age, sex, sexual orientation (including gender expression or identity), marital status, mental or physical disability, honorably discharged veteran or military status or any other category protected by federal, state or local laws. Our equal employment opportunity (or EEO) policy focuses solely on the talent, hard work, contributions, and actual results achieved by each WatchGuard employee and on the potential of employment candidates to make such contributions. We consider focusing on an employee's protected characteristics rather than on talent, hard work, and actual work results to violate our EEO policy. As an Equal Opportunity Employer, we are committed to a diverse workforce. WatchGuard participates in E-verify.

    WatchGuard is committed to providing reasonable accommodation for qualified individuals with disabilities in our job application procedures. Please let us know if you need assistance or accommodation due to a disability.

     
    Compensation
    The base salary range is $140,000-$150,000 per year for full-time employment, exclusive of benefits. Your base salary will be determined by your individual skills, education, and experience. Hiring at the maximum of the range is not typical in order to allow for future salary growth.
     
    U.S. Benefits
    ·       Comprehensive benefits plan including medical, dental, vision, disability, and life insurance
    ·       Healthcare HSA
    ·       HSA with employer contribution
    ·       10 paid holidays
    ·       10 days of paid annual leave
    ·       9 days of paid sick time
    ·       Paid parental leave
    ·       401(k) with employer match
     
    Other Perks
    ·       Education assistance program
    ·       Dependent Care HSA match
    ·       Adoption assistance
    ·       Fertility care support
    ·       Backup care for family and pets
    ·       A growing network of employee resource groups
    ·       Employee referral program
    ·       Employee Assistance Program

Skills Required

  • Snowflake expertise including advanced SQL, streams, tasks, snowpipe, dynamic tables, row-level security, and warehouse tuning
  • dbt and Elementary experience: production dbt models, testing, documentation, incremental strategies, snapshots, and Elementary observability integration
  • Azure cloud experience: Azure Data Factory, ADLS Gen2, Azure Key Vault, Azure Functions and Logic Apps
  • Airflow experience: DAG authoring, XCom, sensors, connection management, deployment and monitoring
  • Python skills including pipeline scripting, PySpark basics, REST API integration, and unit testing
  • Hands-on implementation of Medallion Architecture (Bronze/Silver/Gold), data validation at each layer, schema evolution handling, and SCD Type 2 management
  • 4+ years professional data engineering experience with at least 2 years on Azure data platforms
  • Experience with Terraform or Bicep for Azure infra provisioning
  • Exposure to Snowflake Cortex, dbt Semantic Layer, or Boomi Data Hub
  • Experience integrating LLM-based quality checks or AI-assisted anomaly detection
  • Familiarity with Microsoft Fabric and OneLake
  • Knowledge of data mesh or data product ownership concepts

WatchGuard Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about WatchGuard and has not been reviewed or approved by WatchGuard.

  • Healthcare Strength — Health coverage is portrayed as comprehensive, including medical, dental, vision, and mental-health support. Feedback suggests plan breadth and quality are a recurring bright spot.
  • Parental & Family Support — Caregiver benefits include paid parental leave, backup care, adoption assistance, fertility coverage, and, in some locales, subsidized childcare. Feedback suggests these supports meaningfully enhance the total package for families.
  • Leave & Time Off Breadth — Generous PTO and holidays are emphasized alongside options like paid sick time and volunteer time. Feedback suggests time off provisions contribute to a favorable work-life balance.

WatchGuard Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Seattle, WA
1,018 Employees
Year Founded: 1996

What We Do

WatchGuard® Technologies, Inc. is a global leader in unified cybersecurity. Our Unified Security Platform® approach is uniquely designed for managed service providers to deliver world-class security that increases their business scale and velocity while also improving operational efficiency. Trusted by more than 17,000 security resellers and service providers to protect more than 250,000 customers, the company’s award-winning products and services span network security and intelligence, advanced endpoint protection, multi-factor authentication, and secure Wi-Fi. Together, they offer five critical elements of a security platform: comprehensive security, shared knowledge, clarity & control, operational alignment, and automation. The company is headquartered in Seattle, Washington, with offices throughout North America, Europe, Asia Pacific, and Latin America. To learn more, visit WatchGuard.com.

Similar Jobs

Enverus Logo Enverus

Consultant

Big Data • Information Technology • Software • Analytics • Energy
In-Office or Remote
2 Locations
1800 Employees
60K-90K Annually

Enverus Logo Enverus

Staff Product Designer

Big Data • Information Technology • Software • Analytics • Energy
In-Office or Remote
2 Locations
1800 Employees
90K-95K Annually

Wells Fargo Logo Wells Fargo

Personal Banker Poinciana

Fintech • Financial Services
Hybrid
Kissimmee, FL, USA
205000 Employees

Wells Fargo Logo Wells Fargo

Operations Coordinator

Fintech • Financial Services
Hybrid
Orlando, FL, USA
205000 Employees

Similar Companies Hiring

Copia Automation Thumbnail
Cybersecurity • Industrial
New York, New York
50 Employees
SEON Thumbnail
Artificial Intelligence • Cybersecurity
Budapest, Budapest
415 Employees
NODA AI Thumbnail
Artificial Intelligence • Information Technology • Software • Cybersecurity • Defense • Defense Technology
Austin, TX
54 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account