Data Platform Engineer

Posted 3 Days Ago
Be an Early Applicant
Hiring Remotely in Punehu, Northland, NZL
Remote
Senior level
Information Technology • Software • Database
The Role
Install, configure, maintain, upgrade, and support data platform clusters across cloud and on-premises environments. Manage Kubernetes-based deployments, open-source data technologies, monitoring, on-call operations, troubleshooting, performance optimization, security, documentation, and automation using Python and Terraform. Collaborate with engineering and DevOps teams, resolve critical production issues, and mentor junior team members while supporting scalable data solutions.
Summary Generated by Built In
About Nexus

You don't have an AI story if you don't have your data story. That's where NexusOne comes in.


We're the converged data platform for the AI era — composable by design, built on an open-source foundation, and AI-native from the ground up. One identity, one governance envelope, one operational layer across every mainframe, data lake, warehouse, and streaming system in the business. For the first time, enterprises can bring their existing stack along instead of rebuilding it — and still give AI agents full context across the estate.


What we stand for is simple: sovereign data, interoperable systems, decoupled intelligence — delivered the way modern software should be. No rip-and-replace. No multi-year transformation. Our CEO Anu Jain puts it well: we turn the "ball of yarn" of data integrations into a unified engine — less like assembling car parts, more like buying the car ready to drive. 85+ open-source tools pre-integrated. AI-native automations that deploy and self-heal the stack without human toil. Forward-deployed engineers who build shoulder-to-shoulder with customer teams — hands on keyboards, not just on decks.


It's working, and fast. We're tripling revenue year over year, backed by Insight Partners, and running in production in environments most vendors won't touch. Our platform processes credit risk data for 90%+ of US small businesses — 40M+ — every month. Intent signals for 300M+ subscribers monthly for Africa's largest telco. The data and AI layer for a Top 3 US bank.


We're 100+ people across the US and India, headquartered in Atlanta. We think big, move fast, and don't mistake activity for progress. We hire people who'd rather ship the rocket than brief someone on it.

Check out this podcast of Anu talking about our solution here: https://www.youtube.com/watch?v=g8g50sv5GhQ

We are currently searching for a 100% Hands-on Data Platform Engineer to join our high-performing product team in Pune. As a Data Engineer, you will play a crucial role in providing technical support, resolving complex issues, and maintaining the stability and security of our customers' environments. If you are passionate about Data products running on AWS/Azure/On Prem, and thrive in a fast-paced environment, this opportunity is for you. The ideal candidate will be a proactive problem solver with expertise in Kubernetes platform/strong python/terraform Automation skills and meticulous attention to detail. This person will be intellectually curious with a relentless desire to learn the latest modern data architecture platforms and patterns.

What You are and will work on:

  • Install, configure, and support NX1 product clusters in cloud (AWS, Azure, GCP) and on-premises environments, ensuring seamless integration and functionality using Kubernetes, Spark, NiFI, Kafka, Airflow, Trino, Hive, Iceberg, Jupyter, yarn, Impala, Ranger and Hbase ensuring robust data protection and compliance.

  • Maintain, patch, and upgrade existing NX1 product setups in a 24 x 7 environments, ensuring minimal downtime and adherence to best practices.

  • Configure Datadog/Grafana agents and develop dashboards to monitor and alert operations teams

  • Manage daily operations with oncall rotations of Nexusone products and cloud-based technologies using open-source Linux-based data technologies.

  • Evaluate and optimize complex distributed production deployments, identify bottlenecks, and recommend performance enhancements.

  • Develop and maintain technical documentation, including administration of runbooks and knowledge base articles, to support operational excellence and knowledge sharing.

  • Work in an agile team and Participate in an on-call rotation, providing expert-level support and troubleshooting for critical issues.

  • Lead and mentor junior team members, fostering a culture of continuous learning and improvement. Collaborate with cross-functional teams, including data engineers, solution architects, and DevOps, to design and implement scalable data solutions.

  • Stay current with emerging technologies and industry trends, applying this knowledge to improve the CDP environment and drive innovation.

General expectation:

  • Minimum of 5 years of experience in installing and administering Data Platform (Cloudera, Databricks, snowflake) or using open-source tools, with a proven track record of managing large-scale deployments.

  • Hands-on experience with python/terraform automation skills for open-source Linux-based data technologies.

  • Proven ability to build and support solutions across major cloud platforms (AWS, Azure, GCP), leveraging cloud-native tools and open source for optimal performance.

  • Experience integrating Azure Active Directory with FreeIPA and other directory services such as LDAP, enhancing security and user management.

  • Up-to-date knowledge of the Hadoop Big Data ecosystem, staying current with the latest technologies and best practices.

  • Excellent troubleshooting skills, with a thorough understanding of capacity planning, identifying bottlenecks, and optimizing memory utilization, CPU usage, OS performance, storage, and network configurations.

  • In-depth understanding of both on-premise and cloud network architectures, ensuring seamless integration and efficient data flow.

  • Strong analytical and problem-solving abilities, capable of diagnosing and resolving complex technical issues efficiently.

Nice to have: Cloudera/Databricks/Snowflake Administrator certification is a plus.
Prior experience as a support or development engineer with a focus on Data, Analytics, and AI.

Why You’ll Love Working at Nexus

At Nexus, we value people who want to grow — and support each other while doing so.

You can expect:

  • A collaborative team culture built on curiosity and respect

  • Challenging work where your contributions clearly matter

  • A leadership team that invests in learning and development

  • The opportunity to work at the intersection of cloud, data, and AI innovation

Ready to Apply?

If this role sounds like a great fit — or even close to one — we’d love to hear from you. We know that no candidate checks every single box, and we’re excited to meet people who bring curiosity, talent, and a desire to build meaningful work together.

Skills Required

  • Minimum 5 years of experience installing and administering data platforms such as Cloudera, Databricks, Snowflake, or equivalent open-source technologies
  • Hands-on Python and Terraform automation experience
  • Experience supporting large-scale data platform deployments
  • Experience with AWS, Azure, and GCP cloud platforms
  • Experience integrating Azure Active Directory with FreeIPA and LDAP directory services
  • Knowledge of the Hadoop big data ecosystem
  • Strong troubleshooting skills involving capacity planning, bottleneck analysis, memory, CPU, operating system, storage, and network performance
  • Understanding of on-premises and cloud network architectures
  • Strong analytical and problem-solving abilities
  • Cloudera, Databricks, or Snowflake administrator certification
  • Prior support or development engineering experience focused on data, analytics, and AI
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Addison, TX
80 Employees
Year Founded: 2018

What We Do

Nexus Cognitive takes enterprises from data to outcomes at unprecedented speed and scale. We’ve revolutionized the way enterprises get value from their data with a composable, agnostic framework that enables you to rapidly build new solutions with modular, pre-integrated data components. Built with open standards, we give you the freedom to work with the data, systems, and toolsets of your choice, while our universal data catalog provides robust governance to ensure compliance and cut risks. Through close customer collaboration, we design solutions that connect data pipelines and increase data access from on-prem to multi-cloud, with complete visibility across the data ecosystem. Cut data complexity, get AI-ready, and prove ROI in weeks, not months with the fully managed data framework and outcomes from Nexus Cognitive.

Similar Jobs

Atlassian Logo Atlassian

Site Reliability Engineer

Cloud • Information Technology • Productivity • Security • Software • App development • Automation
In-Office or Remote
4 Locations
11000 Employees

Circle (circle.so) Logo Circle (circle.so)

Lead Engineer, AI Platform

Artificial Intelligence • Consumer Web • Digital Media • Information Technology • Social Impact • Software
In-Office or Remote
55 Locations
250 Employees

Atlassian Logo Atlassian

Chief Technology Officer

Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Remote
2 Locations
11000 Employees

Halter Logo Halter

Product Specialist

Greentech • Hardware • Internet of Things • Machine Learning • Software • Business Intelligence • Agriculture
Remote
New Zealand
350 Employees

Similar Companies Hiring

Revel Thumbnail
Aerospace • Hardware • Robotics • Software
Marina Del Rey, California
70 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
33 Employees
RapidScale Thumbnail
Cloud • Information Technology • Consulting
Raleigh, NC
600 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account