Senior Data Engineer (P50) — Reliability Process Group (RPG)

Posted 2 Hours Ago
Be an Early Applicant
Hiring Remotely in Bengaluru, Bengaluru Urban, Karnataka, IND
In-Office or Remote
Senior level
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Atlassian provides tools to help every team unleash their full potential.
The Role
Own and enhance scalable batch and incremental data pipelines supporting reliability metrics, incident reporting, PIRs, and SLOs. Design data models and marts using Databricks, dbt, and modern table formats; implement automated data quality, anomaly detection, and alerting; optimize SQL, Spark, and dbt performance and costs; enable Tableau and executive reporting; maintain engineering standards, CI/CD, documentation, and mentorship.
Summary Generated by Built In
Data and observability are central to engineering reliability at Atlassian. The Reliability Process Group (RPG) builds and manages the foundational data infrastructure, ingestion pipelines, and analytics surfaces that track incident posture, Post-Incident Reviews (PIRs), service level objectives (SLOs), and reliability metrics across the company (e.g., Reliability Watch, MSR reporting, AutoHOT).
We are looking for a Senior Data Engineer (P50) to take end-to-end ownership of our data pipelines and analytical data products. In this role, you will design robust batch and incremental ETL/ELT pipelines, implement automated Data Quality (DQ) frameworks, optimize query performance at scale, and deliver trusted datasets powering executive and team-level reliability reporting.
  • End-to-End Pipeline & System Ownership: Design, build, optimize, and maintain scalable data pipelines (batch & incremental) ingesting data from Jira/JSM, OpsGenie, internal incident services, and telemetry stores.
  • Data Modeling & Architecture: Design and evolve reliable data models and marts (e.g., Incident Context Enriched, PIR SLAs, Hot Reviews) using modern table formats, dbt, and Databricks.
  • Data Quality & Pipeline Hygiene: Establish automated Data Quality (DQ) checks, anomaly detection, threshold monitoring, and P1/P2 alerting to prevent data drift and pipeline failures.
  • Analytics & Visualization Enablement: Partner with cross-functional teams and leadership to deliver performant, aggregation-ready datasets for dashboards (Tableau, internal tools) and executive reliability reporting.
  • Performance & Cost Optimization: Profile and optimize SQL/Spark/dbt queries, leverage incremental loading, and improve partitioning strategies across Databricks and Socrates datasets.
  • Engineering Standards & Mentorship: Champion best practices in code reviews, CI/CD pipelines (Bitbucket Pipelines), testing, runbooks, and mentor peers across data engineering practices.

At Atlassian, we strive to design equitable, explainable, and competitive compensation programs. We follow consistent hiring practices and account for each candidate's skills, knowledge, and experience when setting base pay within the range.
This role may also be eligible for benefits, bonuses, commissions, and equity.
Minimum Requirements:
  • 5+ years of experience in a Data Engineering role with proven success building and operating production data platforms at scale.
  • Strong programming & scripting skills in Python, with a solid grasp of software engineering fundamentals (OOP, testing, modular code, CI/CD).
  • Expert SQL & data modeling skills, including dimensional modeling, query tuning, partition management, and schema design.
  • Hands-on experience with modern Big Data ecosystems & orchestration: Databricks / Apache Spark, dbt, and workflow schedulers (e.g., Airflow / Bitbucket Pipelines).
  • Cloud Infrastructure experience: Familiarity with AWS or GCP data services and storage primitives.
  • Data Quality & Observability mindset: Experience writing automated data validation checks, monitoring pipeline health, and configuring alert thresholds.
  • Strong communication & stakeholder skills: Ability to navigate ambiguity, translate business/reliability requirements into technical specifications, and document system architecture.

Preferred / Nice-to-Have Qualifications:
  • Experience with internal Atlassian data infrastructure (Socrates pipelines, Compass, Teamwork Graph, Jira/OpsGenie APIs).
  • Experience with BI and visualization tools (e.g., Tableau workbook optimization, custom SQL extracts, incremental refreshes).
  • Experience with table formats such as Delta Lake or Apache Iceberg.
  • Background in Site Reliability Engineering (SRE), incident management data, or telemetry/observability domains.

Skills Required

  • 5+ years of experience in data engineering, building and operating production data platforms at scale
  • Strong Python programming and scripting skills
  • Software engineering fundamentals including object-oriented programming, testing, modular code, and CI/CD
  • Expert SQL and data modeling skills, including dimensional modeling, query tuning, partition management, and schema design
  • Hands-on experience with Databricks and Apache Spark
  • Experience with dbt
  • Experience with workflow schedulers such as Airflow or Bitbucket Pipelines
  • Familiarity with AWS or GCP data services and storage primitives
  • Experience writing automated data validation checks, monitoring pipeline health, and configuring alert thresholds
  • Strong communication and stakeholder management skills, including translating requirements into technical specifications and documenting architecture
  • Experience with Atlassian data infrastructure, Socrates pipelines, Compass, Teamwork Graph, or Jira/OpsGenie APIs
  • Experience with BI and visualization tools such as Tableau
  • Experience with Delta Lake or Apache Iceberg
  • Background in SRE, incident management data, telemetry, or observability

What the Team is Saying

Tiffany
Gautam
Tygrr
Ashleigh
Jensen
Javier
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: San Francisco, CA
11,000 Employees
Year Founded: 2012

What We Do

Atlassian creates teamwork solutions for high-performing teams. Our portfolio of collaboration and work management software products includes Jira, Confluence, Trello, Loom and Rovo. More than 300,000 businesses worldwide rely on Atlassian’s technology, including 80 percent of Fortune 500 companies. Our solutions support various business teams and they help organizations plan, track, and deliver their biggest ideas together.

Why Work With Us

At Atlassian, we believe we can accomplish so much more together than apart — which is why everything from our tooling — to our distributed workforce — to how our teams are structured is rooted in collaboration. Come join us and help unleash the potential of every team.

Gallery

Gallery
Gallery
Gallery
Gallery
Gallery
Gallery
Gallery
Gallery
Gallery
Gallery

Atlassian Teams

Team
Product + Tech
Team
Data Science
About our Teams

Atlassian Offices

Remote Workspace

Employees work remotely.

Atlassians have flexibility in where they work to support their family, personal goals, and other priorities. Our approach to distributed work allows us to tap into talent beyond our office locations, and to reimagine how work gets done.

Typical time on-site: None
HQSan Francisco, CA
Australia
Japan
Canada
Netherlands
Amsterdam, NL
Austin, TX
Austin, TX
Bellevue, WA
India
Boston, Massachusetts
Boston, MA
Chicago, IL
Poland
Mountain View, CA
Company Office Image
New York, NY
Australia
Learn more

Similar Jobs

Atlassian Logo Atlassian

Sales Development Representative

Cloud • Information Technology • Productivity • Security • Software • App development • Automation
In-Office or Remote
Bengaluru, Bengaluru Urban, Karnataka, IND
11000 Employees

Atlassian Logo Atlassian

Senior Engineering Manager

Cloud • Information Technology • Productivity • Security • Software • App development • Automation
In-Office or Remote
Bengaluru, Bengaluru Urban, Karnataka, IND
11000 Employees

Atlassian Logo Atlassian

Technical Program Manager

Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Remote
India
11000 Employees

Atlassian Logo Atlassian

Security Testing Engineer - Penetration Tester

Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Remote
India
11000 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account