Sr Software Development Engineer in Test - AI-First Development

Posted 8 Hours Ago
Hiring Remotely in United States
Remote
Senior level
Healthtech • Travel
The Role
Design and own AI-agent-driven test workflows and the automated verification framework. Build test context, select models and tooling, validate AI-generated code and tests, operate test automation across UI/API/mobile/data, ensure security and compliance, mentor teams, and continuously improve agent orchestration and observability.
Summary Generated by Built In

Job Description:

Position Overview

The primary responsibility of the Senior Software Development Engineer in Test (AI-First Development) is to design, orchestrate, and validate the automated verification systems that gate every change shipped through the AI-First Software Development Lifecycle (SDLC). This role operates within an AI-First SDLC in which AI agents serve as primary producers of code, configuration, and test artifacts, while the Senior Software Development Engineer in Test (SDET) provides test strategy, context engineering, human-in-the-loop governance, and final accountability for the quality of delivered software.

The Senior SDET is an experienced quality engineer or test automation engineer who has adopted modern AI-assisted development tools as a core part of their daily workflow and is prepared to grow into deeper agent orchestration, context engineering, and verification responsibilities.

All duties are to be performed in accordance with departmental and Las Vegas Sands Corp.’s policies, practices, and procedures. All Las Vegas Sands Corp. Team Members are expected to conduct and carry themselves in a professional manner at all times. Team Members are required to observe the company’s standards, work requirements and rules of conduct.

Essential Duties & Responsibilities

  • Test Strategy, Agent Workflow Design, and Orchestration

    • Design, build, and maintain AI agent workflows that produce unit, integration, end-to-end, performance, and security test suites from specifications and intent documents.

    • Decompose acceptance criteria and technical contracts into discrete, verifiable test scenarios that AI agents can execute effectively within defined boundaries.

    • Select and configure appropriate AI models, agent frameworks, and test-generation tooling for each workflow based on risk level, coverage requirements, and cost considerations.

    • Construct and maintain test context that provides agents with test patterns, fixture strategies, data classification rules, and domain information needed to produce correct and consistent test outputs.

    • Contribute to the testing toolchain, including reusable test skills, automation hooks, and project memory files that provide persistent context across agent sessions. Authoring of advanced toolchain components may be developed on the job.

    • Systematically capture defect patterns, escape modes, and verification failures from each development cycle and encode them back into shared context, test skills, and agent configurations so that subsequent work becomes more reliable.

    • Participate in collaborative refinement sessions to align on acceptance criteria, technical contracts, and test context packages before agent execution begins.

  • Verification and Quality Assurance

    • Operate the multi-layer Verification Framework on every pull request, with primary ownership of the automated testing layer, validating functional correctness, security posture, performance characteristics, code quality, and regulatory compliance.

    • Apply human oversight at governance checkpoints appropriate to the risk level of each workflow, including pre-execution review, in-flight observation, and post-execution audit.

    • Review, test, and approve AI-generated code and test suites, ensuring they meet Sands testing standards, architectural guidelines, and security requirements before promotion to production.

    • Verify that AI-generated tests exercise specified intent rather than mirroring implementation, and reject suites that pass without actually exercising the behavior the specification asked for.

    • Support independent QA verification after merge, contributing to system, integration, and regression testing in production-like environments and partnering with the QA Lead on User Acceptance Testing coordination where applicable.

    • Support agent observability practices that track test behavior, flakiness signals, coverage trends, and defect escape rates across workflows.

  • Test Engineering and Architecture

    • Architect and deliver scalable test automation frameworks across web, API, mobile, and data layers using AI-First methodologies as the primary development approach.

    • Define test data strategies, test environment patterns, and verification contracts that serve as foundational context for agent-driven test generation.

    • Collaborate with cross-functional teams including engineering, product, infrastructure, and security to translate business requirements into executable verification workflows.

    • Coordinate with QA and engineering teams across global locations to ensure consistency in testing standards and verification practices.

    • Write, debug, and refactor test code directly when agent outputs require manual intervention or when designing novel test approaches.

    • Ensure delivered test automation meets enterprise standards for reliability, maintainability, observability, and operational readiness.

  • Continuous Improvement and Mentorship

    • Evaluate emerging AI models, agent frameworks, and test automation tools to continuously improve verification effectiveness and output quality.

    • Mentor team members on AI-assisted testing practices, context engineering techniques, and verification methodologies.

    • Document test patterns, prompt and context libraries, and lessons learned to build institutional knowledge.

    • Participate in collaborative construction sessions, guiding agent execution in real time and coaching team members on effective test orchestration techniques.

  • Perform job duties in a safe manner.

  • Attend work as scheduled on a consistent and regular basis.

  • Perform other related duties as assigned.

Minimum Qualifications

  • At least 21 years of age.

  • Proof of authorization to work in the United States.

  • Bachelor's degree in Computer Science, Software Engineering, or a related field, or equivalent professional experience.

  • Must be able to obtain and maintain any certification or license, as required by law or policy. 

  • 5+ years of professional software development or test automation experience, including time in senior or lead positions where the candidate owned the design and delivery of non-trivial verification systems.

  • Demonstrated daily use, over the past 6 months or more, of at least one modern AI-assisted development tool such as Claude Code, Cursor, GitHub Copilot, or Windsurf, with the ability to speak concretely about effective usage patterns and failure modes.

  • Strong foundational knowledge in at least one major programming ecosystem (such as .NET/C#, JavaScript/TypeScript, Python, Java, or Go) and hands-on experience with at least one modern test automation framework (such as Playwright, Cypress, REST Assured, pytest, or comparable). Familiarity with additional layers (UI, API, integration) is a plus.

  • Experience deploying and operating test automation on at least one major cloud platform (Azure, AWS, or GCP). Azure experience is a plus given the LVS footprint but is not required.

  • Working knowledge of DevOps practices and CI/CD pipelines, including familiarity with how automated test gates fit into a build pipeline.

  • Demonstrated experience conducting thorough code reviews, identifying defects in both human- and AI-generated outputs, and providing constructive technical feedback.

  • Excellent written and verbal communication skills, with the ability to articulate technical decisions and trade-offs to both technical and non-technical stakeholders.

  • Strong interpersonal skills with the ability to communicate effectively and interact appropriately with management, other Team Members and outside contacts of different backgrounds and levels of experience.

Preferred Qualifications

  • Practical experience constructing structured context for LLMs, including prompt design, RAG pipelines, context window optimization, project memory files (such as CLAUDE.md or AGENTS.md), and integration with MCP servers. Familiarity with tactical context management techniques such as plan mode, context editing, and multi-session splitting.

  • Experience authoring reusable skills, configuring automation hooks, building custom MCP servers, or otherwise assembling agent toolchains that enable repeatable, production-grade test workflows.

  • Exposure to one or more specialized testing approaches such as performance and load testing (K6, JMeter, Gatling), contract testing, mutation testing, or chaos engineering. Proficiency in any one is a plus; depth across all is not expected.

  • Knowledge of secure testing practices, OWASP guidelines, and SAST/DAST/SCA tooling, and experience working within a regulated industry such as gaming, finance, healthcare, or hospitality. Understanding of data privacy and responsible AI principles.

  • Working knowledge of relational or non-relational databases sufficient to model test data, design verification queries, and reason about query performance.

Physical Requirements

Must be able to:

  • Physically access assigned workspace areas with or without reasonable accommodation.

  • Work remotely as necessary.

  • Work indoors and be exposed to various environmental factors such as, but not limited to, CRT, noise, and dust.

  • Utilize laptop and standard keyboard to perform essential functions of the job.

Skills Required

  • At least 21 years of age.
  • Proof of authorization to work in the United States.
  • Bachelor's degree in Computer Science, Software Engineering, or related field, or equivalent experience.
  • Ability to obtain and maintain any required certification or license.
  • 5+ years professional software development or test automation experience, including senior/lead responsibility for verification systems.
  • Daily use (past 6+ months) of at least one modern AI-assisted development tool (e.g., Claude Code, Cursor, GitHub Copilot, Windsurf).
  • Strong knowledge in at least one programming ecosystem (.NET/C#, JavaScript/TypeScript, Python, Java, or Go).
  • Hands-on experience with at least one modern test automation framework (e.g., Playwright, Cypress, REST Assured, pytest).
  • Experience deploying and operating test automation on a major cloud platform (Azure, AWS, or GCP).
  • Working knowledge of DevOps practices and CI/CD pipelines and how automated test gates integrate with builds.
  • Proven experience conducting thorough code reviews and identifying defects in human- and AI-generated outputs.
  • Excellent written and verbal communication skills.
  • Strong interpersonal skills for cross-functional collaboration.
  • Practical experience designing structured LLM context, prompt design, RAG pipelines, and project memory files (preferred).
  • Experience authoring reusable agent skills, automation hooks, or custom MCP/server integrations (preferred).
  • Exposure to performance/load testing tools (K6, JMeter, Gatling), contract/mutation/chaos testing (preferred).
  • Knowledge of secure testing practices, OWASP, SAST/DAST/SCA tooling, and regulated-industry experience (preferred).
  • Working knowledge of relational or non-relational databases for test data modelling and verification queries (preferred).
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Las Vegas, Nevada
947 Employees

What We Do

Founded in 1990, Las Vegas Sands is the preeminent developer and operator of world-class integrated resorts that drive valuable business and leisure tourism in the regions where we operate. Featuring an array of richly diverse and compelling offerings under one roof, our integrated resorts blend luxury hotels and state-of-the-art meeting and convention facilities with a variety of amenities such as gaming, celebrity chef restaurants, high-end shopping and an action-packed schedule of concerts, shows, exhibits and other attractions. Sands has a 30-year track record of successfully developing and operating some of the largest and most complex business and leisure properties in the world, generating significant economic benefits for our host regions and enhancing their stature as global tourism and business capitals. Our integrated resorts propel continuous positive impact through tourism, jobs and community investments that make our regions great places to live, work and visit. Sands is dedicated to being a good corporate citizen, anchored by the core tenets of serving people, planet and communities. We deliver a great working environment for our team members worldwide, drive social impact through the Sands Cares community engagement and charitable giving program and lead in environmental performance through the award-winning Sands ECO360 global sustainability program. Sands is not just a developer. We are developers of positive impact.

Similar Jobs

Circle Logo Circle

Senior Analyst, AML Know Your Customer

Blockchain • Fintech • Payments • Financial Services • Cryptocurrency • Web3
In-Office or Remote
23 Locations
1050 Employees
98K-128K Annually

Xero Logo Xero

Associate Enterprise Partner Success Manager

Cloud • Fintech • Information Technology • Machine Learning • Software
Remote or Hybrid
Florida, USA
4500 Employees

Xero Logo Xero

Associate Enterprise Partner Success Manager

Cloud • Fintech • Information Technology • Machine Learning • Software
Remote or Hybrid
North Carolina, USA
4500 Employees

Xero Logo Xero

Associate Enterprise Partner Success Manager

Cloud • Fintech • Information Technology • Machine Learning • Software
Remote or Hybrid
Georgia, USA
4500 Employees

Similar Companies Hiring

Sailor Health Thumbnail
Healthtech • Social Impact • Telehealth
New York City, NY
20 Employees
PRIMA Thumbnail
Travel • Software • Marketing Tech • Hospitality • eCommerce
US
15 Employees
Granted Thumbnail
Mobile • Insurance • Healthtech • Financial Services • Artificial Intelligence
New York, New York
23 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account