Senior Software Engineer - AI Automation

Posted 3 Days Ago
Be an Early Applicant
San Jose, CA, USA
In-Office
141K-361K Annually
Senior level
News + Entertainment
The Role
Design and maintain automated test frameworks for APIs and data pipelines, containerized quality checks, CI/CD workflows, and infrastructure as code. Use agentic AI to create tests, triage failures, and debug production issues. Build retrieval pipelines, MCP integrations, evaluations, observability, safeguards, and reusable engineering patterns for reliable AI automation and end-to-end testing.
Summary Generated by Built In
Teamwork makes the stream work.
Roku is changing how the world watches TV

Roku is the #1 TV streaming platform in the U.S., Canada, and Mexico, and we've set our sights on powering every television in the world. Roku pioneered streaming to the TV. Our mission is to be the TV streaming platform that connects the entire TV ecosystem. We connect consumers to the content they love, enable content publishers to build and monetize large audiences, and provide advertisers unique capabilities to engage consumers.

From your first day at Roku, you'll make a valuable - and valued - contribution. We're a fast-growing public company where no one is a bystander. We offer you the opportunity to delight millions of TV streamers around the world while gaining meaningful experience across a variety of disciplines.


About the role

With more than 100 million people using our products globally, we’ve become well-known for products that “just work” right out of the box and integrate almost by magic. That doesn’t happen by accident, which is why we are committed to making sure our products aren’t just intuitive; they’re obvious. Our goal is to help people find what they want and make it easier for people to stream. We do this with state-of-the-art technology and engineering, keeping the customer at the center of everything we do.

We're looking for a hands-on, systems-oriented Senior Software Engineer in Test (Sr. SDET) to join our Browse and Discovery Team. You'll own quality for the APIs and data pipelines — the automated test frameworks, containerized quality checks, CI/CD workflows, and infrastructure as code that let the rest of the organization ship with confidence.

You'll do that work with agentic AI as your default mode of working: driving agents to write and maintain integration tests, keep suites healthy, triage failures, and debug production issues, and building the tools, harnesses, and evaluations that make those workflows trustworthy. This is a role for someone who treats agent design as an engineering discipline — grounding agents in the right context, integrating them with the systems they act on, proving them reliable through rigorous automation and evaluation, and turning what works into the reusable components and paved paths other teams at Roku build on.

For California Only - The estimated annual base salary for this position is between $141,300 - $360,700. Compensation packages are based on factors unique to each candidate, including but not limited to skill set, certifications, and specific geographical location. This role is eligible for health insurance, equity awards, life insurance, disability benefits, parental leave, wellness benefits, and paid time off.


How will I use AI at Roku?

At Roku, we don't just use AI; we work with it. AI agents and smart tools help power drafts, analysis, and repetitive workflows, while our people bring direction, judgment, and accountability. We're looking for curious, adaptable builders who can show how they've used AI for automation to move faster, raise the bar, and scale their impact.

We value your AI skills if you have built fluency across the agentic engineering toolchain — coding harnesses like Claude Code or Cursor, MCP servers, custom skills, or agent frameworks. And you can describe projects where you shipped real work with these tools. You know how to drive an agent, verify its output, and ramp on an unfamiliar codebase with an agent helping you.


What you'll be doing
  • Design and develop automated test frameworks for APIs and data pipelines, and containerize automated quality checks for complex orchestrated services.
  • Use agentic AI workflows day to day — authoring and maintaining integration tests, keeping test suites healthy, triaging failures, and debugging production issues.
  • Build the context and retrieval pipelines that ground these agents in the right code, schemas, telemetry, and business logic, and keep them aligned as those sources evolve.
  • Implement tool-calling and MCP-style integrations so agents can safely act on the systems around them — test runners, CI, ticketing, logs, and data services.
  • Build and maintain CI/CD workflows and infrastructure as code using Terraform or CloudFormation, so deployments and test execution are repeatable and auditable.
  • Establish evaluation, observability, and monitoring for the signals that matter here: test reliability and flake rate, mean time to triage, agent task success rate, latency, and cost.
  • Build safeguards that improve production readiness and reliability — controlled rollouts, drift detection, and mechanisms that prevent error amplification in multi-step agent workflows.
  • Create reusable templates, modular components, and paved-path patterns that accelerate adoption across teams, and partner with development, data engineering, and product teams to improve end-to-end testing and release processes.
 We're excited if you have
  • 5+ years of experience in software testing and automation, software engineering, or adjacent domains, with strong software engineering fundamentals and the ability to build production-grade systems.
  • Expertise in Python or Java with familiarity in the other; experience with C/C++ or another systems language is a plus.
  • Experience designing test plans, test cases, and automated test frameworks for APIs, services, and data pipelines.
  • Hands-on experience with LLM-based systems, including prompt design, retrieval, tool use, memory handling, and agent orchestration patterns.
  • Experience building and maintaining retrieval and context pipelines, agent frameworks, and MCP servers or equivalent function-calling architectures.
  • Experience with CI/CD tooling such as GitLab runners, GitHub Actions, Jenkins, or Travis CI.
  • Experience with cloud platforms — AWS (preferred), GCP, or Azure — REST APIs, and containerization and orchestration tools such as Docker and Kubernetes.
  • Experience with infrastructure as code: Terraform or CloudFormation.
  • Working knowledge of Linux and Bash scripting.
  • Experience with observability, evaluation, experimentation, and feedback loops for AI systems in production, including monitoring tools such as DataDog, Prometheus, or Grafana.
  • Ability to work independently, manage ambiguity, move quickly, and deliver incrementally in a fast-paced environment.
  • Strong analytical and problem-solving skills, excellent communication and collaboration skills, and sound engineering judgment.
  • Bachelor's or master's degree in Computer Science, Computer Engineering, Electrical Engineering, Data Science, or a related technical field — or equivalent engineering experience.
#LI-BD1
What's Roku's approach to hybrid working?

Roku fosters an inclusive and collaborative environment where teams generally work in the office Monday through Thursday. Fridays are generally flexible for remote work, except for employees whose specific roles or assigned office location require five days' a week attendance.


What are some of the benefits?

Roku is committed to offering a diverse range of benefits as part of our compensation package to support our employees and their families. Our comprehensive benefits include global access to mental health and financial wellness support and resources. Local benefits include statutory and voluntary benefits which may include healthcare (medical, dental, and vision), life, accident, disability, commuter, and retirement options (401(k)/pension). Employees are supported in taking time off, in accordance with local leave policies and other personal needs to support their evolving work and life needs. It's important to note that not every benefit is available in all locations or for every role. For details specific to your location, please consult with your recruiter.


Accommodations

Roku welcomes applicants of all backgrounds and provides reasonable accommodations and adjustments in accordance with applicable law. If you require reasonable accommodation at any point in the hiring process, please direct your inquiries to [email protected].


What should I know about Roku's culture?

Roku is a great place for people who want to work in a fast-paced environment where everyone is focused on the company's success rather than their own. We try to surround ourselves with people who are great at their jobs, who are easy to work with, and who keep their egos in check. We appreciate a sense of humor. We believe a fewer number of very talented folks can do more for less cost than a larger number of less talented teams. We're independent thinkers with big ideas who act boldly, move fast and accomplish extraordinary things through collaboration and trust. In short, at Roku you'll be part of a company that's changing how the world watches TV. 

We have a unique culture that we are proud of. We think of ourselves primarily as problem-solvers, which itself is a two-part idea. We come up with the solution, but the solution isn't real until it is built and delivered to the customer. That penchant for action gives us a pragmatic approach to innovation, one that has served us well since 2002. 

To learn more about Roku, our global footprint, and how we've grown, visit https://www.weareroku.com/factsheet.

By providing your information, you acknowledge that you want Roku to contact you about job roles, that you have read Roku's Applicant Privacy Notice, and understand that Roku will use your information as described in that notice. If you do not wish to receive any communications from Roku regarding this role or similar roles in the future, you may unsubscribe at any time by emailing [email protected].

Skills Required

  • 5+ years of experience in software testing and automation, software engineering, or adjacent domains
  • Strong software engineering fundamentals and ability to build production-grade systems
  • Expertise in Python or Java, with familiarity in the other
  • Experience designing test plans, test cases, and automated test frameworks for APIs, services, and data pipelines
  • Hands-on experience with LLM-based systems, including prompt design, retrieval, tool use, memory handling, and agent orchestration
  • Experience building and maintaining retrieval and context pipelines, agent frameworks, and MCP servers or equivalent function-calling architectures
  • Experience with CI/CD tooling such as GitLab Runners, GitHub Actions, Jenkins, or Travis CI
  • Experience with AWS, GCP, or Azure
  • Experience with REST APIs, Docker, and Kubernetes
  • Experience with infrastructure as code using Terraform or CloudFormation
  • Working knowledge of Linux and Bash scripting
  • Experience with observability, evaluation, experimentation, and production feedback loops for AI systems
  • Experience with monitoring tools such as DataDog, Prometheus, or Grafana
  • Ability to work independently, manage ambiguity, move quickly, and deliver incrementally
  • Strong analytical and problem-solving skills, communication and collaboration skills, and sound engineering judgment
  • Bachelor’s or master’s degree in Computer Science, Computer Engineering, Electrical Engineering, Data Science, or a related technical field, or equivalent engineering experience
  • Experience with C/C++ or another systems language

Roku Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Roku and has not been reviewed or approved by Roku.

  • Fair & Transparent Compensation Pay is positioned as competitive across many roles, with frequent emphasis on strong base and total compensation relative to market expectations. Fair-pay perception appears comparatively stronger than overall satisfaction with the broader rewards package.
  • Healthcare Strength Healthcare coverage is framed as a standout, with sizable employer premium contributions that can reduce employee premiums significantly depending on plan choice. Preventive care and mental-health support are also described as part of the core offering.
  • Leave & Time Off Breadth Time-off offerings are presented as broad, including paid holidays, PTO, and multiple leave categories such as bereavement and family-related leave. Self-managed or “unlimited” PTO is also described for many salaried roles, supporting flexibility in taking time off.

Roku Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: San Jose, CA
2,724 Employees
Year Founded: 2002

What We Do

Roku pioneered streaming to the TV. We connect users to the streaming content they love, enable content publishers to build and monetize large audiences, and provide advertisers with unique capabilities to engage consumers. Roku streaming players and Roku TV™ models are available around the world through direct retail sales and licensing arrangements with TV OEMs and service operators.

Similar Jobs

In-Office
2 Locations
72000 Employees
149K-246K Annually

Sprinter Health Logo Sprinter Health

Software Engineer

Artificial Intelligence • Healthtech • Logistics • Social Impact • Software • Telehealth
Hybrid
San Francisco, CA, USA
500 Employees
185K-230K Annually
In-Office
San Francisco, CA, USA
72000 Employees
149K-246K Annually
In-Office
2 Locations
72000 Employees
149K-246K Annually

Similar Companies Hiring

TIDAL Thumbnail
Software • News + Entertainment • Mobile • Information Technology • Music • Consumer Web
New York, NY
450 Employees
Sandbox VR Thumbnail
Events • Gaming • News + Entertainment • Retail • Virtual Reality
Tsim Sha Tsui East, Kowloon
650 Employees
Hedra Thumbnail
Software • News + Entertainment • Marketing Tech • Generative AI • Enterprise Web • Digital Media • Consumer Web
San Francisco, CA
14 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account