Staff Software Engineer, OpenLineage - Data Observability

Posted 15 Days Ago
Be an Early Applicant
New York, NY
Hybrid
234K-300K Annually
Mid level
Artificial Intelligence • Cloud • Software • Cybersecurity
We are building the monitoring and security platform for developers, IT ops teams and business users in the cloud age.
The Role
As a Staff Engineer for OpenLineage at Datadog, you will lead the development of OpenLineage integrations, design the event intake system, participate in the OpenLineage community, and manage issue remediation while collaborating with cross-functional teams to enhance data observability tools.
Summary Generated by Built In

About the Role
We are seeking a hands-on technical leader to drive our OpenLineage integrations and data intake group. This role combines internal development responsibilities with active work in and with the OpenLineage community plus collaboration with our Data Observability product teams.
Data Observability is building tools for data teams of all sizes to visualize, monitor, and understand their critical data pipeline, jobs, and datasets. We're a fast moving organization that operates as a startup within Datadog. We build impactful features quickly with customers in a tight feedback loop while keeping an eye on reliability, scaling, and future customer needs.
As a Staff Engineer, you will drive and collaborate on projects both inside and outside the product group and in the OpenLineage community. You will contribute to and make key technical and product decisions across the teams while elevating the engineering excellence of the other team members.
A t Datadog, we value our office culture - the relationships and collaboration it builds and the creativity it brings. We operate as a hybrid workplace to ensure our Datadogs can create a work-life harmony that best fits them.
Key Responsibilities

  • Lead the development and implementation of OpenLineage integrations within our organization (30% of time)
  • Design, architect, and expand usage of the OpenLineage event intake for easy customer onboarding to the Datadog Data Observability platform(30% of time)
  • Actively participate in the OpenLineage community, contributing code, documentation, and expertise (20-30% of time)
  • Manage the remediation of OpenLineage issues affecting Datadog customers
  • Collaborate with cross-functional teams to ensure seamless integration of OpenLineage practices
  • Represent our organization in the broader open source community, particularly in OpenLineage-related forums, events, and the Datadog blog


Qualifications

  • Strong technical background in data engineering, with a focus on data lineage and governance
  • Proven experience contributing to open source projects, preferably in the data space
  • Excellent coding skills, with proficiency in languages commonly used in data engineering (e.g., Python, Java, Scala)
  • Strong communication skills, both written and verbal, with the ability to explain complex technical concepts to diverse audiences
  • Ability to balance internal development work with external community engagement
  • You have a BS/MS/PhD in a Computer Science, Engineering or related scientific field or equivalent experience


Nice to haves

  • Deep understanding of OpenLineage and related data lineage concepts
  • Experience in community management or developer relations is a plus


Ideal Candidate
The ideal candidate will be a passionate advocate for open source and data lineage, with a track record of meaningful contributions to relevant projects. They should be comfortable leading technical work across multiple teams, advocating for the most impactful changes for customers, and nurturing relationships with the OpenLineage community of developers.
Benefits and Growth

  • Continuous career development and pathing opportunities for internal mobility
  • Intradepartmental mentor and buddy program for in-house networking
  • An inclusive company culture, ability to join our Community Guilds (Datadog employee resource groups)
  • New hire stock equity (RSUs) and employee stock purchase plan
  • Free global mental health benefit through Spring Health
  • Generous global benefits


Benefits and Growth listed above may vary based on the country of your employment and the nature of your employment with Datadog.
Datadog offers a competitive salary and equity package, and may include variable compensation. Actual compensation is based on factors such as the candidate's skills, qualifications, and experience. In addition, Datadog offers a wide range of best in class, comprehensive and inclusive employee benefits for this role including healthcare, dental, parental planning, and mental health benefits, a 401(k) plan and match, paid time off, fitness reimbursements, and a discounted employee stock purchase plan.
The reasonably estimated yearly salary for this role at Datadog is:
$234,000 - $300,000 USD
About Datadog:
Datadog (NASDAQ: DDOG) is a global SaaS business, delivering a rare combination of growth and profitability. We are on a mission to break down silos and solve complexity in the cloud age by enabling digital transformation, cloud migration, and infrastructure monitoring of our customers' entire technology stacks. Built by engineers, for engineers, Datadog is used by organizations of all sizes across a wide range of industries. Together, we champion professional development, diversity of thought, innovation, and work excellence to empower continuous growth. Join the pack and become part of a collaborative, pragmatic, and thoughtful people-first community where we solve tough problems, take smart risks, and celebrate one another. Learn more about #DatadogLife on Instagram , LinkedIn, and Datadog Learning Center.
Equal Opportunity at Datadog:
Datadog is an Affirmative Action and Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. Here are our Candidate Legal Notices for your reference.
Your Privacy:
Any information you submit to Datadog as part of your application will be processed in accordance with Datadog's Applicant and Candidate Privacy Notice .

Top Skills

Java
Python
Scala

What the Team is Saying

Kyvaune
Josh
Darcy
Mia
Mike
LJ
Stephanie
Ian
Maura
The Company
HQ: New York, NY
5,000 Employees
Hybrid Workplace
Year Founded: 2010

What We Do

Datadog (NASDAQ: DDOG) is a global SaaS business, delivering a rare combination of growth and profitability. We are on a mission to break down silos and solve complexity in the cloud age by enabling digital transformation, cloud migration, and infrastructure monitoring of our customers' entire technology stacks. Built by engineers, for engineers, Datadog is used by organizations of all sizes across a wide range of industries. Together, we champion professional development, diversity of thought, innovation, and work excellence to empower continuous growth. Join the pack and become part of a collaborative, pragmatic, and thoughtful people-first community where we solve tough problems, take smart risks, and celebrate one another.

Why Work With Us

At Datadog, we learn from and celebrate each other daily - each win is a team win. Datadogs solve tough problems, innovate pragmatically, and grow together. We promote from within, provide mentorship and opportunities for career development, and support our colleagues in the process. Best of all? We truly love what we do.

Gallery

Gallery
Gallery
Gallery
Gallery
Gallery
Gallery
Gallery
Gallery
Gallery
Gallery

Datadog Offices

Hybrid Workspace

Employees engage in a combination of remote and on-site work.

We operate as a hybrid workplace to ensure our Datadogs can create a work-life harmony that best fits them and their team.

Typical time on-site: 3 days a week
HQNew York, NY
SG
New South Wales
Amsterdam, NL
Boston, MA
Denver, CO
Dublin, IE
Hanyang, KR
Lisbon, PT
Madrid, ES
Paris, FR
San Francisco, CA
Tokyo, JP
Learn more

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account