Senior Software Engineer II - Streaming and Durability

Posted Yesterday
Be an Early Applicant
Boston, MA, USA
In-Office
176K-196K Annually
Senior level
Real Estate • Software • PropTech
At Compass, our mission is to help everyone find their place in the world.
The Role
Design, operate, and scale Compass's database, cache, and streaming fleet (Postgres, Redis/ValKey, DynamoDB, Kafka/MSK). Build multi-tenant isolation and SDKs, run fleet-scale upgrades with zero downtime, improve observability, and partner with product teams to migrate workloads and resolve high-impact production incidents.
Summary Generated by Built In

At Compass, our mission is to help everyone find their place in the world. Founded in 2012, we’re revolutionizing the real estate industry with our end-to-end platform that empowers residential real estate agents to deliver exceptional service to seller and buyer clients.

About Compass International Holdings (CIH)

Compass International Holdings (CIH) is the largest residential real estate platform in the world, established by the January 2026 merger of Compass and Anywhere Real Estate. By bringing together the technology, brands, and agent networks that power residential real estate transactions across the United States and globally. CIH's mission is to help everyone find their place in the world — and to build the single software platform for all real estate activity, at a scale and complexity few technology companies ever operate at.

About the Role

Every transaction, every listing view, every agent interaction at Compass touches a database, a cache, or a streaming pipeline owned by the Streaming & Durability team. This team is responsible for the foundational data layer: the systems that have to be fast, correct, and isolated across thousands of tenants, every single time.

We don't just keep the lights on. We're solving hard, unsolved problems: how do you enforce tenant-level data isolation across a fleet of shared PostgreSQL clusters and Redis/Valkey caches without sacrificing latency? How do you upgrade 50+ production databases with zero downtime while application teams ship features on top of them? How do you build SDKs that make the safe path the easy path for hundreds of engineers who never think about infrastructure?

As a Senior Engineer, you'll own answers to those questions. You'll design systems that quietly protect millions of records, ship tooling that engineers across the company reach for by default, and operate infrastructure where the cost of getting it wrong is measured in trust,  not just latency.

Responsibilities

- Design and operate the database and caching fleet (RDS/Aurora PostgreSQL, ElastiCache Redis/ValKey, DynamoDB) that underpins Compass's core products, making decisions about replication, failover, capacity, and engine strategy that affect every team in the company.

- Build multi-tenant data isolation into Compass's data layer from the ground up, shipping SDKs in Go, Java, and Python that enforce tenant-safe access patterns so product engineers can move fast without risking cross-tenant data exposure.

- Own production database upgrades at fleet scale, coordinating engine version bumps and Terraform state mutations across hundreds of clusters with zero customer-facing impact.

- Build and scale Kafka/MSK streaming infrastructure, the connective tissue between Compass services, including topic architecture, consumer patterns, and blue/green deployment strategies.

- Develop deep observability into the data layer, including SLI dashboards, tenant-dimensioned telemetry, and real-time performance insights that let the team (and the company) understand system behavior before customers do.

- Partner directly with product and platform teams to assess database readiness for scaling events, migrate workloads onto golden-path infrastructure, and resolve the hardest production incidents in the stack.


Basic Qualifications

- 5+ years of experience building and operating distributed systems, with depth in at least one major managed database (PostgreSQL or similar) at production scale in AWS.

- You've built shared tooling (SDKs, client libraries, platform APIs), and you understand what it takes to make infrastructure accessible and safe for engineers who aren't infrastructure specialists.

- You think in trade-offs, not absolutes. You can articulate why you'd choose a soft application-enforced boundary over a hard infrastructure lock and when that calculus changes.

- You write Go (or can ramp quickly) and you're comfortable in Terraform, Kubernetes, and IAM-heavy AWS environments.

- You've led cross-team operational programs ,including change management, migration coordination, and rollback planning, where the blast radius of a mistake extends well beyond your own team.

Preferred Qualifications

- You've worked on multi-tenant isolation problems such as key prefixing, row-level security, and RBAC/ACL models and have opinions about where application-layer enforcement breaks down.

- You've operated Kafka/MSK at scale and dealt with the hard parts: consumer lag, partition rebalancing, cross-account IAM auth.

- You've built or contributed to observability platforms, specifically for database and cache monitoring.


Compensation: The base pay range for this position is $176,000-$196,100; however, base pay offered may vary depending on job-related knowledge, skills, and experience. Bonuses and restricted stock units may be provided as part of the compensation package, in addition to a full range of benefits. Base pay is based on market location. Minimum wage for the position will always be met.


Perks that You Need to Know About:

Participation in our incentive programs (which may include eligible cash, equity, or commissions). Plus paid vacation, holidays, sick time, parental leave, and recharge leave; medical, tele-health, dental and vision benefits; 401(k) plan; flexible spending accounts (FSAs); commuter program; life and disability insurance; Maven (a support system for new parents); Carrot (fertility benefits); UrbanSitter (caregiver referral network); Employee Assistance Program; and pet insurance.

 
Do your best work, be your authentic self.
At Compass, we believe that everyone deserves to find their place in the world — a place where they feel like they belong, where they can be their authentic selves, where they can thrive.  Our collaborative, energetic culture is grounded in our Compass Entrepreneurship Principles and our commitment to diversity, equity, inclusion, growth and mobility. As an equal opportunity employer, we offer competitive compensation packages, robust benefits and professional growth opportunities aimed at helping to improve our employees' lives and careers.

Notice for California Applicants

Los Angeles County Fair Chance Notice

Skills Required

  • 5+ years building and operating distributed systems with depth in at least one managed database (PostgreSQL or similar) at production scale in AWS.
  • Experience building shared tooling (SDKs, client libraries, platform APIs) to make infrastructure accessible and safe.
  • Ability to reason about trade-offs between application-enforced boundaries and infrastructure locks.
  • Proficient in Go (or able to ramp quickly) and comfortable with Terraform, Kubernetes, and IAM-heavy AWS environments.
  • Led cross-team operational programs including change management, migration coordination, and rollback planning with broad blast radius.
  • Experience with multi-tenant isolation patterns (key prefixing, row-level security, RBAC/ACL models).
  • Operated Kafka/MSK at scale and handled consumer lag, partition rebalancing, and cross-account IAM auth.
  • Built or contributed to observability platforms, specifically for database and cache monitoring.

Compass Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Compass and has not been reviewed or approved by Compass.

  • Healthcare Strength Medical, dental, and vision coverage are described as comprehensive, with some noting fully paid dependent coverage and solid plan options. Wellness resources and assistance programs further support overall health needs.
  • Parental & Family Support Paid parental leave is characterized as generous for both birthing and non-birthing parents, supporting time at home. Company policies also reference family medical leave.
  • Retirement Support A 401(k) with company match alongside an employee stock purchase plan and equity grants adds long-term financial value. These elements broaden total rewards beyond base pay.

Compass Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: New York, NY
4,000 Employees
Year Founded: 2012

What We Do

A real estate company with a purpose; we are building the first modern real estate platform, pairing the industry’s top talent with technology to make the search and sell experience intelligent and seamless.

Why Work With Us

We are a tech company reinventing the space. To lead the industry requires the smartest tools built by the brightest minds across engineering, design, and strategy. Through our proprietary platform, Compass is changing how agents and clients navigate the process of finding or selling a home. Join our team today!

Similar Jobs

Liberty Mutual Insurance Logo Liberty Mutual Insurance

Claims Specialist II - Rideshare Commercial Auto - Attorney Represented Bodily Injury Claims Adjuster

Artificial Intelligence • Fintech • Insurance • Marketing Tech • Software • Analytics
Hybrid
9 Locations
40000 Employees
61K-113K Annually

Nexthink Logo Nexthink

Senior Technology Alliances Manager

Artificial Intelligence • Big Data • Cloud • Information Technology • Machine Learning • Software
Remote or Hybrid
Boston, MA, USA
1200 Employees

Bestow Logo Bestow

Operations Manager

Big Data • Fintech • Information Technology • Insurance • Software
Remote or Hybrid
US
160 Employees
160K-185K Annually

Cox Enterprises Logo Cox Enterprises

Remarketing Specialist, Meridian Remarketing - Central/West

Artificial Intelligence • Automotive • Greentech • Information Technology • Machine Learning • Software • Cybersecurity
Remote or Hybrid
United States
50000 Employees
92K-154K Annually

Similar Companies Hiring

Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account