Staff Software Engineer, Data Platform

Posted 13 Hours Ago
Be an Early Applicant
Austin, TX, USA
Hybrid
Senior level
Big Data • Real Estate • Software
Realtor.com® is an open real estate marketplace built for everyone.
The Role
Design, build, and operate shared data-platform capabilities for ingestion, streaming, replication, orchestration, transformation, and developer self-service. The role owns Kafka/MSK, Airflow, dbt, Snowflake, connectors, schemas, observability, security, reliability, and platform APIs. It also mentors engineers, supports incident response, documents paved paths, and develops AI-assisted workflows for onboarding, diagnostics, schema validation, and operational automation.
Summary Generated by Built In

Description

Recognized as the No. 1 site trusted by real estate professionals, Realtor.com® has been at the forefront of online real estate for over 25 years, connecting buyers, sellers, and renters with trusted insights and expert guidance to find their perfect home. Through its robust suite of tools, Realtor.com® not only makes a significant impact on the real estate industry at large, but for consumers, navigating the biggest purchase they will make in their life, by providing a user experience that is easy to use, easy to understand, and most of all, easy to make decisions.
 
Join us on our mission to empower more people to find their way home by breaking barriers to entry, making the right connections, and building confidence through expert guidance.
 
Staff Software Engineer, Data Ingestion Platform
 
About the Role
 
We are excited to welcome a hands-on Staff Software Engineer to our Data Movement and Transformation team within the Data organization! In this role, you will help design and operate the paved-path platform that empowers product engineering, analytics, data science, and business teams to move and transform data seamlessly and reliably across Realtor.com.
 
Our team champions foundational capabilities spanning real-time streaming, batch ingestion, data replication, orchestration, transformation, schemas, connectors, platform libraries, observability, and developer self-service. We are looking for a collaborative engineer who thrives across platform infrastructure and developer-facing tooling, takes pride in production outcomes, and makes it effortless for teams to onboard and operate data workflows.
 
Team platform charter
 
We are dedicated to building managed, highly reusable paths for:
  • Real-time and batch data ingestion through Prism/Data Collector and related APIs.
  • Kafka-based streaming on AWS Managed Streaming for Apache Kafka (MSK), including topics, producers, consumers, Kafka Connect, KSQL, and streaming integrations.
  • Data contracts and schema governance using Avro and Schema Registry, including compatibility, validation, and lineage metadata.
  • External-system replication and integration through Fivetran and Kafka Connect, including secure connection management and operational support.
  • Scheduled and batch workflows through Apache Airflow on AWS Managed Workflows for Apache Airflow (MWAA).
  • Data transformation and modeling through dbt, including integration with Airflow, Snowflake, and the data catalog.
  • Snowflake lakehouse access patterns, data exports, reusable toolsets, and platform libraries.
  • Observability, alerting, incident response, pipeline health checks, and self-service troubleshooting across ingestion, streaming, connectors, Airflow, dbt, and Snowflake.
  • Documentation, onboarding, paved paths, reference implementations, and developer experiences that help teams adopt the platform without bespoke support
We focus on crafting and operating shared capabilities and reference tooling. Rather than building each team's custom producer, consumer, connector, or dbt model directly, we delight in empowering teams with the platform, guardrails, templates, libraries, and guidance they need to build safely and efficiently!
 
What You'll Do
Platform engineering
  • Design, build, and operate scalable ingestion, streaming, replication, orchestration, and transformation capabilities used by many teams.
  • Develop and improve platform APIs, services, libraries, templates, and paved paths for streaming, batch, bulk, and external data ingestion
  • Build and maintain ingestion APIs and client libraries in TypeScript, Kotlin, and Python, supporting streaming, batch, bulk, and external data-ingestion use cases.
  • Operate and evolve Kafka/MSK infrastructure, including topics, partitions, replication, retention, throughput, consumer groups, access controls, and upgrades.
  • Support Kafka Connect and sink integrations for systems such as Snowflake, S3, New Relic, and Elasticsearch; improve connector reliability, provisioning, and troubleshooting.
  • Build and maintain Schema Registry and Avro-based data contract workflows, including schema validation, compatibility, versioning, and safe evolution.
  • Build and maintain KSQL or equivalent near-real-time transformation patterns where appropriate.
  • Improve Airflow/MWAA orchestration patterns, DAG templates, scheduling, backfills, retries, dependency management, and operational reliability.
  • Improve dbt platform capabilities, including project conventions, macros, testing, materializations, restricted-data patterns, and Airflow integration.
  • Develop reusable TypeScript, Python, and/or Kotlin libraries and reference implementations for producing, consuming, validating, and moving data.
  • Contribute to Snowflake integration patterns, data exports, toolsets, and secure access paths without taking ownership of stakeholder-specific data modeling.
Reliability, security, and operations
  • Take pride in ensuring delivery, quality, availability, low latency, cost efficiency, and operational reliability for our platform capabilities.
  • Instrument systems with actionable metrics, logs, traces, alerts, runbooks, and service-level objectives.
  • Diagnose data issues across the full path from source to serialization, topic, connector, and Snowflake destination.
  • Participate in incident response, root-cause analysis, post-incident improvements, and production support rotations.
  • Apply least-privilege access, environment separation, secrets management, auditability, and secure-by-default platform design.
  • Improve platform health monitoring and standardize operational workflows across Fivetran, Kafka/MSK, Airflow, dbt, connectors, and Snowflake.
  • Balance reliability, delivery speed, developer experience, operational simplicity, and cost when making architecture decisions.
Developer experience and enablement
  • Create clear onboarding paths, templates, examples, documentation, and diagnostics that help teams self-serve.
  • Partner closely with internal users to understand their ingestion and transformation needs and guide them to the appropriate platform path.
  • Improve discoverability, lineage, data contracts, and metadata through integration with the data catalog.
  • Clearly communicate technical requirements, tradeoffs, operating boundaries, and migration plans to engineers and stakeholders.
  • Inspire and mentor fellow engineers, raising the technical bar through constructive design reviews, code reviews, pairing, and knowledge sharing.
AI-assisted engineering and agentic automation
  • Create practical agentic workflows that automate repetitive platform and developer-support work, such as onboarding, schema validation, DAG and dbt scaffolding, connector checks, pipeline diagnostics, incident triage, and documentation updates.
  • Build reusable AI skills, tools, and workflows that interact with platform APIs, repositories, tickets, observability systems, and documentation while preserving appropriate access controls.
  • Design grounded AI experiences that use authoritative platform knowledge, return structured findings, cite or link to source documentation, and escalate safely when confidence is low.
  • Develop agents that can reason across pipeline boundaries, correlate evidence, identify likely failure points, and produce concise remediation guidance or actionable tickets.
  • Add automated checks and evaluation harnesses for agent behavior, including correctness, safety, permissions, tool-use reliability, hallucination resistance, and regression testing.
  • Use AI to improve engineering throughput without weakening review, change-management, production-safety, or data-governance controls.
  • Contribute reusable patterns for prompt/context design, tool calling, workflow orchestration, human approval, audit logging, and continuous improvement of AI-enabled platform operations.
What You'll Bring
  • 8+ years of experience building backend infrastructure, APIs, distributed systems, data platforms, or developer tooling; equivalent experience is acceptable.
  • Bachelor's degree or equivalent experience.
  • Strong experience with event-driven systems and Kafka, including topics, partitions, consumer groups, delivery semantics, schema evolution, and operational troubleshooting.
  • Hands-on experience with AWS and infrastructure supporting data platforms; experience with MSK, MWAA, IAM, networking, monitoring, and managed services is highly valuable.
  • Experience operating one or more of Fivetran, Kafka Connect, Airflow, dbt, Snowflake, Schema Registry, KSQL, or comparable platforms in production.
  • Strong understanding of data ingestion, replication, orchestration, transformation, data contracts, lineage, observability, and pipeline reliability.
  • Proficiency in TypeScript/JavaScript, Python, Java, Kotlin, or another production backend language; the ability to work across more than one language is preferred.
  • Experience designing and supporting APIs, libraries, infrastructure automation, CI/CD, infrastructure as code, and deployment automation.
  • Familiarity with Avro or another schema and serialization system, data quality controls, compatibility management, and event-driven design.
  • Demonstrated ability to debug complex failures across distributed systems and communicate the diagnosis clearly.
  • Strong security instincts, including least privilege, secrets management, environment isolation, audit trails, and safe handling of restricted data.
  • Ability to document technical requirements and operating procedures so that other teams can successfully use the platform.
  • Ability to lead initiatives, make sound tradeoffs, and work effectively with product engineering, analytics, data science, security, and infrastructure partners.
  • Practical experience creating AI-assisted developer workflows, agentic automation, reusable AI skills, or tool-using LLM applications.
  • Understanding of AI safety and reliability practices, including grounded retrieval, permissions, human-in-the-loop approvals, observability, evaluation, and controlled production rollout.
  • Experience with Kafka/MSK upgrades, capacity planning, performance tuning, or multi-environment operations.
  • Experience building self-service platform products, internal developer platforms, or paved paths.
  • Experience with data observability, lineage, data contracts, incident automation, or support-ticket automation.
  • Experience with one or more of TypeScript, Python, and Kotlin client libraries or SDKs.
Working style
  • Enthusiastically own outcomes end to end, from design through implementation, testing, deployment, documentation, and operational support.
  • Prefer reusable platform capabilities over one-off solutions.
  • Enjoy collaborating directly with end-users to understand and support their requirements and use cases.
  • Make tradeoffs explicit and optimize for reliability, security, simplicity, and user impact.
  • Collaborate openly, ask clarifying questions early, and communicate risks before they become incidents.
  • Treat production safety and data governance as requirements, not afterthoughts.
How We Work:
 
We balance creativity and innovation on a foundation of in-person collaboration. For most roles, our employees work four or more days in our offices, where they have the opportunity to collaborate in-person, adding richness to our culture and knitting us closer together.
 
How We Reward You:
 
Realtor.com is committed to investing in the health and wellbeing of our employees and their families. Our benefits programs include, but are not limited to:
  • Inclusive and Competitive medical, Rx, dental, and vision coverage
  • Family forming benefits
  • 13 Paid Holidays
  • Flexible Time Off
  • 8 hours of paid Volunteer Time off
  • Immediate eligibility into Company 401(k) plan with 3.5% company match
  • Tuition Reimbursement program for degreed and non-degreed programs
  • 1:1 personalized Financial Planning Sessions
  • Student Debt Retirement Savings Match program
  • Free snacks and refreshments in each office location
Do the best work of your life at Realtor.com®
Here, you’ll partner with a diverse team of experts as you use leading-edge tech to empower everyone to meet a crucial goal: finding their way home. And you’ll find your way home too. At Realtor.com®, you’ll bring your full self to work as you innovate with speed, serve our consumers, and champion your teammates. In return, we’ll provide you with a warm, welcoming, and inclusive culture; intellectual challenges; and the development opportunities you need to grow.
 
Diversity is important to us, therefore, Realtor.com® is an Equal Opportunity Employer regardless of age, color, national origin, race, religion, creed, gender, sex, sexual orientation, gender identity and/or expression, marital status, status as a disabled veteran and/or veteran of the Vietnam Era or any other characteristic protected by federal, state or local law. In addition, Realtor.com® will provide reasonable accommodations for otherwise qualified disabled individuals.

Skills Required

  • 8+ years of experience building backend infrastructure, APIs, distributed systems, data platforms, or developer tooling, or equivalent experience
  • Bachelor's degree or equivalent experience
  • Strong experience with event-driven systems and Kafka, including topics, partitions, consumer groups, delivery semantics, schema evolution, and operational troubleshooting
  • Hands-on AWS experience supporting data platforms; MSK, MWAA, IAM, networking, monitoring, and managed services experience is valuable
  • Production experience operating Fivetran, Kafka Connect, Airflow, dbt, Snowflake, Schema Registry, KSQL, or comparable platforms
  • Strong understanding of data ingestion, replication, orchestration, transformation, data contracts, lineage, observability, and pipeline reliability
  • Proficiency in TypeScript, JavaScript, Python, Java, Kotlin, or another production backend language
  • Experience designing and supporting APIs, libraries, infrastructure automation, CI/CD, infrastructure as code, and deployment automation
  • Familiarity with Avro or another schema and serialization system, data quality controls, compatibility management, and event-driven design
  • Ability to debug complex distributed-system failures and communicate diagnoses clearly
  • Strong security practices including least privilege, secrets management, environment isolation, audit trails, and restricted-data handling
  • Ability to document technical requirements and operating procedures
  • Ability to lead initiatives, make tradeoffs, and collaborate with engineering, analytics, data science, security, and infrastructure partners
  • Practical experience creating AI-assisted developer workflows, agentic automation, reusable AI skills, or tool-using LLM applications
  • Understanding of AI safety and reliability practices including grounded retrieval, permissions, human approvals, observability, evaluation, and controlled rollout
  • Experience with Kafka/MSK upgrades, capacity planning, performance tuning, or multi-environment operations
  • Experience building self-service platform products, internal developer platforms, or paved paths
  • Experience with data observability, lineage, data contracts, incident automation, or support-ticket automation
  • Experience with TypeScript, Python, or Kotlin client libraries or SDKs

What the Team is Saying

Realtor.com Compensation & Benefits Highlights

  • Healthcare Strength — Healthcare is described as comprehensive, including medical, dental, and vision coverage alongside mental-health resources, telemedicine, reproductive care, and gender-affirming and fertility/family-building benefits. This breadth is consistently positioned as a core strength of the package.
  • Parental & Family Support — Policies include up to 20 weeks of paid parental leave for primary caregivers, plus backup child and adult care, lactation support, adoption assistance, and family-support tools. These offerings are presented as a standout element of the total rewards.
  • Leave & Time Off Breadth — Paid time off is portrayed as generous or flexible, with paid holidays and sick leave noted across materials. This flexibility is highlighted as contributing to better work-life balance.

Realtor.com Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Austin, TX
1,400 Employees
Year Founded: 1995

What We Do

For years, millions of home shoppers have turned to realtor.com® to find their dream home. Operated by Move, Inc., realtor.com® offers a comprehensive list of for-sale properties, as well as the information and tools to make informed real estate decisions. Today, more than ever, realtor.com® is The Home of Home Search℠. Realtor.com® also offers homeowners a bevy of useful tools and resources through the My Home℠ dashboard. My Home℠ dashboard allows property owners to manage their home like the important investment it is by tracking their home’s value over time, researching and managing home improvements, and scouting other similar properties in the neighborhood.

Why Work With Us

The way home begins with you. With a diverse team of experts alongside you, you’ll help us reach new heights at the forefront of the digital real estate space. Bring your extensive knowledge and deep expertise and collaborate with other passionate visionaries to lead our industry and revolutionize the way people find home, in every form.

Gallery

Gallery
Gallery
Gallery
Gallery
Gallery
Gallery
Gallery
Gallery
Gallery
Gallery
Gallery

Realtor.com Offices

Hybrid Workspace

Employees engage in a combination of remote and on-site work.

Enjoy the flexibility of our hybrid policy—simply choose whichever three days a week work best for you to come into any of our offices.

Typical time on-site: 3 days a week
Company Office Image
HQAustin, TX
Company Office Image
New York, NY
Company Office Image
Scottsdale, AZ
Learn more

Similar Jobs

Realtor.com Logo Realtor.com

Senior Software Engineer

Big Data • Real Estate • Software
Hybrid
Austin, TX, USA
1400 Employees

Realtor.com Logo Realtor.com

Pricing Analyst

Big Data • Real Estate • Software
Hybrid
Austin, TX, USA
1400 Employees

Realtor.com Logo Realtor.com

Analytics Engineer

Big Data • Real Estate • Software
Hybrid
Austin, TX, USA
1400 Employees

Realtor.com Logo Realtor.com

Lead Product Manager

Big Data • Real Estate • Software
Hybrid
Austin, TX, USA
1400 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account