We have an opening for a Staff Software Engineer on our Infrastructure Team, with specific focus on Observability - both internal and customer-facing. This is an opportunity to join a mission-critical engineering team that is driving the productivity and reliability of Temporal’s developers and core platforms, respectively. We are a passionate team of talented developers who truly care about our mission and enjoy working deeply across the entire Temporal ecosystem to be a force multiplier across the organization.
Team Highlights
Core observability tech stack: Clickhouse, Prometheus, Grafana, Loki, Thanos, Kubernetes, Temporal.
Our recent observability project had the biggest impact to Temporal margins of any engineering effort in company history while also unlocking unprecedented operator capabilities.
“Observability is the beating heart of our ability to deliver a mission critical service” -Preeti Somal, Executive VP of R&D.
Build:
Lead the end-to-end Software Development Lifecycle: goals & requirements solicitation, design & review, implementation, operationalization & deployment, support & maintenance.
Lead feature design, review with stakeholders, iterate to incorporate feedback and drive consensus.
Clearly document design choices and operational knowledge to successfully deploy and manage the software you develop.
Provide appropriate test and production readiness coverage for unit, integration, and performance of your feature ownership area.
Own:
Set a high bar for technical excellence and take pride in the software you develop.
Design and build multi-component, distributed systems that operate at scale.
Investigate issues with a methodical approach to identify a root cause.
Understand performance and reliability implications of design options at scale. Make related tradeoffs.
Participate in the team’s on-call rotation.
Learn:
Expert-level knowledge of architecture and services of assigned domain. Strong command over all aspects of the Temporal ecosystem. This role provides a strong opportunity for diverse technical exposure!
Investigate and understand ways to best leverage Temporal’s own software to power our mission.
Deeply understand the needs of Temporal internal developers and external customers, and leverage that knowledge for product development and feature design.
Collaborate:
Lead and mentor fellow team members.
Participate in design reviews and contribute to design of other features.
Share design principles for building reliable systems at scale.
User-first mindset. You’re excited by the opportunity to empower others through tooling, and enjoy deeply internalizing user goals and use cases to build effective solutions.
Motivated by impact. You are driven by a desire to make positive things happen.
Strong opinions about tools and technology that are equally balanced by a pragmatic drive for impact.
Ability to work in a self-directed manner in a fast-paced environment.
Excellent collaboration and communication skills.
Skills & Technologies
Demonstrated ability to develop horizontally scalable, resilient, and high performance distributed systems in a production environment.
Experience designing, implementing, deploying, and supporting large scale, geographically distributed observability and/or high throughput data streaming/processing pipelines, or similar.
Expert in one or more high-level programming languages, preferably Go.
Expert-level Kubernetes skills.
Expert-level query development skills, preferably SQL.
Hands-on experience with one or more cloud providers, preferably AWS, or GCP.
Thorough understanding of computer architecture, operating systems, and networking.
Familiarity with best practices regarding monitoring, instrumenting, and configuring infrastructure.
Temporal Technologies is an Equal Opportunity Employer. Temporal Technologies does not discriminate on the basis of race, religion, color, sex, gender identity, sexual orientation, age, non-disqualifying physical or mental disability, national origin, veteran status, or any other basis covered by appropriate law. All employment is decided on the basis of qualifications, merit, and business need. We embrace and celebrate differences and diversity.
Temporal is committed to providing access, equal opportunity, and reasonable accommodation for individuals with disabilities in employment, its services, programs, and activities. If you need to request a reasonable accommodation, please let your Recruiter know so we can assist.
Skills Required
- Demonstrated ability to develop horizontally scalable, resilient, high-performance distributed systems in production
- Experience designing, implementing, deploying, and supporting large-scale geographically distributed observability or high-throughput data streaming and processing pipelines
- Expert proficiency in one or more high-level programming languages
- Expert-level Kubernetes skills
- Expert-level query development skills
- Hands-on experience with one or more cloud providers
- Thorough understanding of computer architecture, operating systems, and networking
- Familiarity with monitoring, instrumentation, and infrastructure configuration best practices
- Excellent collaboration and communication skills
- Ability to work independently in a fast-paced environment
- Expertise in Go
- Expertise in SQL
- Experience with AWS or GCP
Temporal Technologies Compensation & Benefits Highlights
The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Temporal Technologies and has not been reviewed or approved by Temporal Technologies.
-
Healthcare Strength — Healthcare coverage is described as 100% employer-paid for medical, dental, and vision, with AD&D, short- and long-term disability, and life insurance included. Feedback suggests this breadth and cost coverage is a strong differentiator for a remote-first employer.
-
Leave & Time Off Breadth — Time off includes unlimited PTO alongside 12 standard holidays and 2 floating holidays. Feedback suggests this structure supports rest and recharge across teams.
-
Wellbeing & Lifestyle Benefits — Wellbeing and remote-work support include a home office stipend, internet reimbursement, WFH meals, Calm app access, a lifestyle spending account, and learning/professional membership budgets. Feedback suggests these perks enhance overall total rewards beyond base pay.
Temporal Technologies Insights
What We Do
Temporal develops and distributes the world's leading open source durable execution system. We make code fault tolerant, durable and simple. Innovative companies like Datadog, Glovo, Indeed, Netflix, Qualtrics, Remitly, Snap and Yum! Brands build their services and applications with Temporal to make them reliable to run, productive to enhance and easy to troubleshoot and repair. More than a decade in the making, Temporal is powered by veterans behind some of the industry's most loved systems technologies, programming frameworks and open source communities as well as investors like Amplify Partners, Sequoia Capital and Index Ventures.
