Senior Software Engineer - Analytics Data Platform Lakehouse

Posted 21 Days Ago
Easy Apply
New York, NY, USA
Hybrid
130K-300K Annually
Senior level
Artificial Intelligence • Cloud • Security • Software • Cybersecurity
We are building the monitoring and security platform for developers, IT ops teams and business users in the cloud age.
The Role
Design, build, and operate lakehouse platform components, drive open table format adoption, and collaborate on data architecture management.
Summary Generated by Built In

Analytics Data Platform Lakehouse team builds and operates the foundations that power data engineers, applied AI, and product teams—managing millions of tables on their behalf and simplifying operations from maintenance and observability to governance, for both internal and customer-facing use cases. If you're excited by the intersection of petabyte data processing scale, open-source query engines, and building platforms with real product stakes, this is the team for you.


At Datadog, we place value in our office culture - the relationships and collaboration it builds and the creativity it brings to the table. We operate as a hybrid workplace to ensure our Datadogs can create a work-life harmony that best fits them.


What You’ll Do: 

  • Design, build, and operate core components of our lakehouse platform, including Apache Iceberg table management (data compaction, data layout optimization, materialized view scheduling…) and Iceberg catalog
  • Drive adoption of open table formats across internal teams, owning the integration of Trino, Spark and other query engines (DuckDB, Puppygraph…) with our Iceberg-based lakehouse at petabyte scale
  • Build observability for managed iceberg tables, to identify query performance bottlenecks, cost drivers and contribute fixes back to upstream open-source projects (Iceberg, Trino, Spark, Open Lineage) where relevant
  • Build self-serve tooling and abstractions that allow data engineering teams to reliably run thousands of pipelines per day against our lakehouse
  • Collaborate with data engineers, analysts, and infrastructure teams to define the roadmap for our lakehouse architecture and shape how Datadog manages analytic data at scale

Who You Are: 

  • You have a BS/MS/PhD in Computer Science, Engineering, or a related field, or equivalent professional experience
  • You have deep, production-grade experience with one or more of Apache Iceberg, Trino, or Apache Spark, ideally demonstrated through significant open-source contributions: merged PRs, committer status, or PMC membership on projects 
  • You have built or operated large-scale distributed data systems
  • You have a solid grasp of query planning, columnar file formats (Parquet, ORC), and table format internals (snapshots, manifests, partition evolution)
  • You are fluent in Java, Scala or Go and comfortable with Python for pipeline tooling
  • You have experience deploying and running data infrastructure on Kubernetes in cloud environments

Datadog values people from all walks of life. We understand not everyone will meet all the above qualifications on day one. That's okay. If you’re passionate about technology and want to grow your skills, we encourage you to apply.

#LI-LB1

Datadog offers a competitive salary and equity package, and may include variable compensation. Actual compensation is based on factors such as the candidate's skills, qualifications, and experience. In addition, Datadog offers a wide range of best in class, comprehensive and inclusive employee benefits for this role including healthcare, dental, parental planning, and mental health benefits, a 401(k) plan and match, paid time off, fitness reimbursements, and a discounted employee stock purchase plan.

The reasonably estimated yearly salary for this role at Datadog is:
$130,000$300,000 USD

About Datadog: 

Datadog is the leading observability and security platform for the AI era, providing businesses with unified visibility across the technology stack to manage complexity at scale. It brings applications, infrastructure, data, models, and security into one place, using AI to detect and resolve issues before they impact customers. Trusted globally by Fortune 500 companies and high-growth AI leaders, Datadog enables businesses to move faster with clarity and confidence. Learn more about #DatadogLife on Instagram, LinkedIn, and Datadog Learning Center.

Equal Opportunity at Datadog:

Datadog is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and other characteristics protected by law. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. Here are our Candidate Legal Notices for your reference. 

Datadog endeavors to make our Careers Page accessible to all users. If you would like to contact us regarding the accessibility of our website or need assistance completing the application process, please complete this form. This form is for accommodation requests only and cannot be used to inquire about the status of applications. 

Privacy and AI Guidelines:

Any information you submit to Datadog as part of your application will be processed in accordance with Datadog’s Applicant and Candidate Privacy Notice. For information on our AI policy, please visit Interviewing at Datadog AI Guidelines.

Skills Required

  • BS/MS/PhD in Computer Science, Engineering, or related field
  • Deep experience with Apache Iceberg, Trino, or Apache Spark
  • Experience with large-scale distributed data systems
  • Grasp of query planning and columnar file formats
  • Fluency in Java, Scala or Go; comfortable with Python
  • Experience deploying data infrastructure on Kubernetes

What the Team is Saying

Othmane
Angel
Emu
Tay
Norma
Sarah
LJ
Tammy
Olivia

Datadog Compensation & Benefits Highlights

  • Healthcare Strength Medical, dental, and vision coverage paired with dedicated mental‑health access (including free annual sessions for employees and dependents) and gender‑affirming care indicates robust healthcare support. Fitness reimbursements further reinforce preventative wellness.
  • Parental & Family Support Fully paid, gender‑neutral parental leave alongside family‑forming support (adoption, fertility, preservation, surrogacy) and childcare assistance shows strong backing for growing families. Pet‑related assistance in eligible offices expands family‑oriented offerings.
  • Equity Value & Accessibility An employee stock purchase plan with a discount and RSUs for many roles broaden access to ownership. This equity mix enhances total rewards beyond base pay.

Datadog Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: New York, NY
6,500 Employees
Year Founded: 2010

What We Do

Datadog (NASDAQ: DDOG) is a global SaaS business, delivering a rare combination of growth and profitability. We are on a mission to break down silos and solve complexity in the cloud age by enabling digital transformation, cloud migration, and infrastructure monitoring of our customers' entire technology stacks. Built by engineers, for engineers, Datadog is used by organizations of all sizes across a wide range of industries. Together, we champion professional development, diversity of thought, innovation, and work excellence to empower continuous growth. Join the pack and become part of a collaborative, pragmatic, and thoughtful people-first community where we solve tough problems, take smart risks, and celebrate one another.

Why Work With Us

At Datadog, we learn from and celebrate each other daily - each win is a team win. Datadogs solve tough problems, innovate pragmatically, and grow together. We promote from within, provide mentorship and opportunities for career development, and support our colleagues in the process. Best of all? We truly love what we do.

Gallery

Gallery
Gallery
Gallery
Gallery
Gallery
Gallery
Gallery
Gallery
Gallery

Datadog Offices

Hybrid Workspace

Employees engage in a combination of remote and on-site work.

We operate as a hybrid workplace to ensure our Datadogs can create a work-life harmony that best fits them and their team.

Typical time on-site: 3 days a week
HQNew York, NY
New South Wales
Company Office Image
MX
Amsterdam, NL
Bengaluru, IN
Company Office Image
Boston, MA
Denver, CO
Dublin, IE
Hanyang, KR
Lisbon, PT
United Kingdom
Madrid, ES
Company Office Image
Paris Office
San Francisco, CA
Singapore Office
Tokyo, JP
Learn more

Similar Jobs

Datadog Logo Datadog

Staff Software Engineer

Artificial Intelligence • Cloud • Security • Software • Cybersecurity
Easy Apply
Remote or Hybrid
2 Locations
6500 Employees
234K-300K Annually

Datadog Logo Datadog

Product Marketing Manager

Artificial Intelligence • Cloud • Security • Software • Cybersecurity
Easy Apply
Hybrid
2 Locations
6500 Employees
123K-164K Annually

Datadog Logo Datadog

Director, User Research - Product Design

Artificial Intelligence • Cloud • Security • Software • Cybersecurity
Easy Apply
Hybrid
New York, NY, USA
6500 Employees
220K-320K Annually

Datadog Logo Datadog

Cloud Security Engineer

Artificial Intelligence • Cloud • Security • Software • Cybersecurity
Easy Apply
Hybrid
New York, NY, USA
6500 Employees
187K-240K Annually

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account