Data Engineering Manager

Reposted 19 Days Ago
Be an Early Applicant
Hiring Remotely in Punehu, Northland, NZL
Remote
50K-130K Annually
Senior level
Information Technology • Software • Database
The Role
The Data Engineering Manager will lead teams in designing large-scale data pipelines, ensuring data governance, quality, and performance while implementing CI/CD best practices.
Summary Generated by Built In
About Nexus

At Nexus, we help organizations turn complex data into clear, actionable insight — so the hard work behind artificial intelligence, analytics, and cloud infrastructure doesn’t slow innovation down… it accelerates it.

We’re a team of builders, problem-solvers, and collaborators who believe in moving fast, learning continuously, and doing great work together. Our role is to handle the heavy lifting of modern data platforms, governance, and cloud transformation so our clients can focus on making confident, strategic decisions that move their businesses forward.

We’re proud of the culture we’re building across the U.S. and India — one rooted in curiosity, ownership, collaboration, and care — and we’re excited to keep growing with people who want to do meaningful work alongside genuinely great teammates.

The Data Engineering Manager will lead distributed teams responsible for designing, modernizing, and operating large-scale data pipelines on the NexusOne platform — an open-source-based data and AI control plane for regulated enterprise environments.

This leader combines hands-on technical depth with strategic delivery management, ensuring that complex data workloads are refactored, migrated, and optimized using modern, composable frameworks.
The role requires strong architectural intuition, proven leadership, and fluency in modern data-engineering technologies.

Core Responsibilities
  • Lead and mentor teams of Big Data Developers, Data Engineers, and Platform Specialists to deliver scalable data solutions.

  • Define and enforce standards for data quality, governance, performance, and security.

  • Oversee the design and migration of data pipelines, orchestration frameworks, and ingestion flows to the NexusOne platform.

  • Collaborate with Platform and Solution Architects to ensure alignment with the “North Star” architecture.

  • Implement CI/CD practices, code reviews, and deployment automation for all data workloads.

  • Develop reusable frameworks, patterns, and best practices to accelerate platform adoption.

  • Drive continuous improvement through performance optimization, automation, and observability.

  • Engage with stakeholders across engineering, architecture, and operations to align priorities and ensure on-time delivery.

Must-Have Core Skills
  • Distributed Data Systems: Deep expertise in Apache Spark (core, SQL, streaming) and Airflow orchestration.

  • Open-Source Data Stack: Hands-on with Iceberg, Trino/Presto, Hive, NiFi, and Kafka.

  • Data Modeling & Transformation: Strong command of SQL, DBT, and schema-on-read design principles.

  • Programming & Scripting: Proficiency in Python, Scala, and Java for data pipeline development.

  • Infrastructure & Automation: Practical experience with Kubernetes, Terraform, Helm, GitLab CI/Jenkins, and Linux-based environments.

  • Governance & Security: Familiarity with Ranger, DataHub, RBAC, and enterprise IAM/SSO integration.

  • Data Quality & Testing: Working knowledge of Great Expectations or similar validation frameworks.

  • Delivery Leadership: Proven ability to manage distributed engineering teams in Agile/DevOps settings.

Ideal Background
  • 8–12 years of experience in data engineering or platform modernization, including 3+ years leading technical teams.

  • Strong foundation in open-source and hybrid-cloud data ecosystems.

  • Demonstrated success leading migration or modernization programs at enterprise scale.

  • Excellent communication and stakeholder-management skills; capable of bridging executive vision and technical execution.

Success Criteria
  • Delivery of high-performing, production-ready data pipelines on the NexusOne platform.

  • Consistent adherence to governance, quality, and performance SLAs.

  • Adoption of standardized frameworks and automation across engineering teams.

  • Measurable improvement in pipeline reliability, cost efficiency, and developer productivity.

  • High engagement, retention, and growth within the data-engineering team.

Why You’ll Love Working at Nexus

At Nexus, we value people who want to grow — and support each other while doing so.

You can expect:

  • A collaborative team culture built on curiosity and respect

  • Challenging work where your contributions clearly matter

  • A leadership team that invests in learning and development

  • The opportunity to work at the intersection of cloud, data, and AI innovation

Ready to Apply?

If this role sounds like a great fit — or even close to one — we’d love to hear from you. We know that no candidate checks every single box, and we’re excited to meet people who bring curiosity, talent, and a desire to build meaningful work together.

Top Skills

Airflow
Spark
Dbt
Gitlab Ci
Helm
Hive
Iceberg
Java
Jenkins
Kafka
Kubernetes
Linux
Nifi
Presto
Python
Scala
SQL
Terraform
Trino
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Atlanta, GA
80 Employees
Year Founded: 2018

What We Do

Nexus Cognitive takes enterprises from data to outcomes at unprecedented speed and scale. We’ve revolutionized the way enterprises get value from their data with a composable, agnostic framework that enables you to rapidly build new solutions with modular, pre-integrated data components. Built with open standards, we give you the freedom to work with the data, systems, and toolsets of your choice, while our universal data catalog provides robust governance to ensure compliance and cut risks. Through close customer collaboration, we design solutions that connect data pipelines and increase data access from on-prem to multi-cloud, with complete visibility across the data ecosystem. Cut data complexity, get AI-ready, and prove ROI in weeks, not months with the fully managed data framework and outcomes from Nexus Cognitive.

Similar Jobs

Easy Apply
Remote
New Zealand
880 Employees

Halter Logo Halter

Account Manager

Greentech • Hardware • Internet of Things • Machine Learning • Software • Business Intelligence • Agriculture
Easy Apply
Remote
Northland, NZL
350 Employees

Luxor Technology Logo Luxor Technology

Platform Engineer

Blockchain • Hardware • Software • Energy • Cryptocurrency • Big Data Analytics
Remote
6 Locations
100 Employees
Remote
New Zealand
4366 Employees

Similar Companies Hiring

Milestone Systems Thumbnail
Software • Security • Other • Big Data Analytics • Artificial Intelligence • Analytics
Lake Oswego, OR
1500 Employees
Fairly Even Thumbnail
Software • Sales • Robotics • Other • Hospitality • Hardware
New York, NY
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account