Senior Manager, Generative AI Test Engineering

Reposted 3 Days Ago
Be an Early Applicant
Mountain View, CA
In-Office
198K-297K Annually
Senior level
Software
The Role
Manage the Generative AI Test Engineering team, developing testing strategies for AI models, and collaborating with research teams for model evaluation.
Summary Generated by Built In

Lab Summary:

We focus on developing speech recognition, advanced speech personalization, and state-of-the-art natural language understanding technology. We are dedicated to creating an advanced AI platform that handles seamless conversations across a variety of devices, as well as democratizing AI by allowing developers and IoT manufacturers to add new capabilities to Bixby.  

Position Summary:

We’re seeking a Senior Manager for our Generative AI Test Engineering team–which will join our Quality Insights team. You will be responsible for managing a small team and for designing and implementing testing strategies and frameworks to evaluate the performance, accuracy, robustness, and safety of AI models and systems. You will collaborate closely with research teams to understand new model capabilities and translate them into robust testing plans and scenario. You will drive development and maintenance of automated testing frameworks and tools for efficient AI validation and system-level testing.

Position Responsibilities:

  • Lead of small team of Data Scientists and QA Engineers
  • Act as a player/coach and utilize test results data to guide product development, identify opportunities, predict challenges, and inform strategic decisions
  • Measure product success through metrics, identifying areas for improvement, and effectively communicating insights to stakeholders
  • Work closely with other functions, such as engineering, product, design, and others

Required Skills:

  • Bachelor’s degree in Computer Science, Computer Engineering, or equivalent combination of education, training, and experience
  • 12+ years of professional software development testing experience, including test automation frameworks and tools building
  • 2+ years of people management experience
  • Experience with LLMOps, model monitoring, or ML observability platforms
  • Proficiency in Python, SQL, and data visualization tools for model analytics
  • Strong knowledge of QA methodologies, test automation, and CI/CD integration
  • Experience as a mentor, tech lead or leading an engineering team

Special Attributes:

  • Hands-on experience with LangChain, OpenAI API, Hugging Face models, or RAG pipelines
  • Knowledge of cloud platforms (AWS/GCP/Azure) for data workflows and ML deployment
  • Familiarity with human-in-the-loop QA or AI-assisted testing workflows
Our total rewards programs are designed to motivate and engage exceptional talent. The base pay range for roles at this level is listed below, but may be higher or lower in other states due to geographic differentials in the labor market. Within the base pay range, individual rates depend on a number of factors—including the role’s function and location as well as the individual’s knowledge, skills, experience, education and training. This is part of our comprehensive compensation package with annual bonus eligibility and generous benefits to help you live life well.
Base Pay Range
$197,800$296,600 USD

Additional Information

Disclosure of Trade Secrets

Samsung has a strict policy on trade secrets. In applying to Samsung and progressing through the recruitment process, you must not disclose any trade secrets of a current or previous employer.

Essential Job Functions

This position will be performed in an office setting. The position will require the incumbent to sit and stand at a desk, communicate in person and by telephone, and frequently operate standard office equipment, such as telephones and computers.

Samsung Research America is committed to complying with all Federal, State and local laws related to the employment of qualified individuals with disabilities. If you are an individual with a disability and would like to request a reasonable accommodation as part of the employment selection process, please contact the recruiter or email [email protected].

Equal Employment Opportunity

At Samsung, we believe that innovation and growth are driven by an inclusive culture and a diverse workforce. We aim to create a global team where everyone belongs and has equal opportunities, inspiring our talent to be their true selves. Together, we are building a better tomorrow for our customers, partners, and communities.

Samsung Research America is committed to employing a diverse workforce, and  provide Equal Employment Opportunity for all individuals regardless of race, color, religion, gender, age, national origin, marital status, sexual orientation, gender identity, status as a protected veteran, genetic information, status as a qualified individual with a disability, or any other characteristic protected by law.

For more information regarding protection from discrimination under Federal law for applicants and employees, please refer to this link: Pay Transparency

Top Skills

AWS
Azure
GCP
Hugging Face
Langchain
Openai Api
Python
SQL
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Mountain View, CA
455 Employees
Year Founded: 1988

What We Do

Founded in October 1988, Samsung Research America (SRA) builds upon Samsung’s 40-year history in the Bay Area. Headquartered in Silicon Valley, with offices across the United States and Canada, SRA is engaged in researching emerging technology to create new businesses and developing core technology to enhance the competitiveness of Samsung products. We also play a key role in providing the infrastructure to support Samsung’s open innovation and university collaboration activities.

Similar Jobs

ServiceNow Logo ServiceNow

Customer Success Executive - Manufacturing

Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Remote or Hybrid
Santa Clara, CA, USA
27000 Employees
189K-331K Annually

ServiceNow Logo ServiceNow

Global Industries & Solutions Strategic Initiatives Sr Manager

Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Remote or Hybrid
Santa Clara, CA, USA
27000 Employees
163K-285K Annually

ServiceNow Logo ServiceNow

Change Management Specialist - Finance

Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Remote or Hybrid
San Diego, CA, USA
27000 Employees
122K-213K Annually

ServiceNow Logo ServiceNow

Software Engineer

Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Remote or Hybrid
San Diego, CA, USA
27000 Employees
127K-215K Annually

Similar Companies Hiring

Standard Template Labs Thumbnail
Software • Information Technology • Artificial Intelligence
New York, NY
10 Employees
PRIMA Thumbnail
Travel • Software • Marketing Tech • Hospitality • eCommerce
US
15 Employees
Scotch Thumbnail
Software • Retail • Payments • Fintech • eCommerce • Artificial Intelligence • Analytics
US
25 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account