Senior Principal AI Test Automation Engineer

Posted 21 Hours Ago
Be an Early Applicant
San Jose, CA, USA
In-Office
Senior level
Artificial Intelligence • Hardware • Internet of Things • Machine Learning • Semiconductor • Automation • Manufacturing
The Role
Designs and leads production-grade test automation for complex digital and mixed-signal engineering and production environments. Builds CI/CD pipelines, hardware and instrument integrations, AI-assisted workflows, validation gates, observability, diagnostics, recovery processes, and reproducible containerized execution environments. Establishes reliable release criteria and mentors engineers while ensuring automation produces traceable, evidence-based results.
Summary Generated by Built In
Job Summary & Responsibilities

Advantest is seeking a Senior Principal AI Test Automation Engineer to
design and deliver reliable automation for complex engineering and production
test environments.


This role combines advanced test engineering, software automation, CI/CD, and
AI-enabled workflows. You will build repeatable systems that validate, execute,
monitor, and diagnose technical workloads across laboratory and production
environments.


We are looking for a hands-on technical leader who understands both physical
test systems and modern software architecture.


Key Responsibilities
- Architect production-grade test automation and CI/CD pipelines.
- Automate build, validation, execution, artifact collection, analysis, and
release gating.
- Integrate AI-generated recommendations into controlled engineering
workflows.
- Define validation and approval gates before automated actions interact
with hardware.
- Build structured interfaces between AI systems, test software, instruments,
and data services.
- Develop failure classification, diagnostics, recovery, and escalation
processes.
- Create reproducible execution environments using containers and version
controlled configurations.
- Establish observability, regression testing, and evidence-based release
criteria.
- Mentor engineers and set technical standards for automation and
production readiness.

Preferred Qualifications

Required Qualifications
- Extensive experience developing automation for advanced test or
measurement systems.
- Strong digital and mixed-signal test-engineering experience.
- Proven ownership of CI/CD systems using Jenkins, GitLab CI, or similar
platforms.
- Strong understanding of test programs, specifications, patterns,
instruments, limits, characterization, and result data.
- Strong Python and software-architecture skills.
- Experience with typed APIs, structured schemas, automated testing, and
version control.
- Experience integrating software with hardware, instruments, or laboratory
environments.
- Ability to lead architecture decisions and solve ambiguous technical
problems at Senior Principal level.
- Strong communication and cross-functional collaboration skills.


Preferred Qualifications
- Experience integrating AI or machine-learning capabilities into engineering
systems.
- Familiarity with AI agents, structured actions, evaluation gates, or human
approval workflows.
- Experience with containerized applications, automated characterization,
and multi-version execution environments.
- Experience working in secure or intellectual-property-sensitive
environments.
- Familiarity with Java or other hardware-control and test-development
languages.

What Success Looks Like
During the first year, you will:
- Deliver a trusted and repeatable automated test-execution pipeline.
- Establish clear validation, observability, and failure-diagnosis standards.
- Integrate AI-assisted recommendations into controlled and measurable
workflows.
- Reduce manual processes and convert expert knowledge into reusable
automation.
- Build a foundation that can support future projects through configuration
rather than one-off development.

Ideal Candidate
You are a deeply technical test engineer who also thinks like a software
architect. You understand that automation must produce reliable evidence—not
simply a successful pipeline result.

You can connect AI capabilities to real engineering environments while
maintaining validation, traceability, safety controls, and expert oversight. 

Skills Required

  • Extensive experience developing automation for advanced test or measurement systems
  • Strong digital and mixed-signal test-engineering experience
  • Proven ownership of CI/CD systems using Jenkins, GitLab CI, or similar platforms
  • Strong understanding of test programs, specifications, patterns, instruments, limits, characterization, and result data
  • Strong Python and software-architecture skills
  • Experience with typed APIs, structured schemas, automated testing, and version control
  • Experience integrating software with hardware, instruments, or laboratory environments
  • Ability to lead architecture decisions and solve ambiguous technical problems at Senior Principal level
  • Strong communication and cross-functional collaboration skills
  • Experience integrating AI or machine-learning capabilities into engineering systems
  • Familiarity with AI agents, structured actions, evaluation gates, or human approval workflows
  • Experience with containerized applications, automated characterization, and multi-version execution environments
  • Experience working in secure or intellectual-property-sensitive environments
  • Familiarity with Java or other hardware-control and test-development languages
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Tokyo
2,006 Employees
Year Founded: 1954

What We Do

For over a half-century, Advantest has been designing innovative electronic measuring equipment and semiconductor test systems essential to the development and manufacture of advanced computer and telecommunications products. On April 1, 2012, Advantest completed its integration of Verigy Ltd. Additional Information about Advantest can be found at www.advantest.com.

Similar Jobs

Shield AI Logo Shield AI

Director, Enterprise Strategy and Operations (R5626)

Aerospace • Artificial Intelligence • Machine Learning • Robotics • Software
In-Office or Remote
4 Locations
190K-290K Annually

ServiceNow Logo ServiceNow

Product Manager

Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Hybrid
Santa Clara, CA, USA
29000 Employees
127K-222K Annually

Samsara Logo Samsara

Principal Product Manager

Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Easy Apply
Remote or Hybrid
United States
4000 Employees
137K-245K Annually

The Aerospace Corporation Logo The Aerospace Corporation

US-FTZ Import Manager - Trade Compliance

Aerospace • Artificial Intelligence • Cloud • Machine Learning • Software • Cybersecurity • Defense
Hybrid
3 Locations
4600 Employees
138K-172K Annually

Similar Companies Hiring

Revel Thumbnail
Aerospace • Hardware • Robotics • Software
Marina Del Rey, California
60 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
30 Employees
Vega Thumbnail
Artificial Intelligence • Automotive • Insurance • Transportation
US
43 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account