Senior Quality Engineer, AI and Automation

Posted 2 Days Ago
Be an Early Applicant
Hiring Remotely in Guadalajara, Jalisco, MEX
Remote
Senior level
Artificial Intelligence • Big Data • Machine Learning • Software
The Role
Lead quality strategy for AI-enabled products by designing scalable automated test frameworks, validating AI-generated outputs and agentic workflows, integrating tests into CI/CD, defining quality metrics, identifying risks, and mentoring engineers to improve cross-team quality practices.
Summary Generated by Built In

C3 AI (NYSE: AI), is the Enterprise AI application software company. C3 AI delivers a family of fully integrated products including the C3 Agentic AI Platform, an end-to-end platform for developing, deploying, and operating enterprise AI applications, C3 AI applications, a portfolio of industry-specific SaaS enterprise AI applications that enable the digital transformation of organizations globally, and C3 Generative AI, a suite of domain-specific generative AI offerings for the enterprise. Learn more at: C3 AI

C3 AI is looking for a Senior Quality Engineer, AI and Automation to define and drive the quality strategy for our next generation of AI-enabled products and platforms. In this role, you will design and build scalable automated test frameworks, develop novel approaches for validating AI-generated outputs and agentic workflows, and establish the metrics that keep our products reliable at enterprise scale. You will work at the intersection of software quality engineering and applied AI, ensuring that quality is engineered into every stage of the development lifecycle.

This is a great role for an experienced quality engineer who is passionate about AI and automation and wants to operate with a high degree of autonomy on complex, high-visibility initiatives. You will influence quality strategy across multiple teams, provide technical leadership and mentorship, and partner closely with software engineering, product, and AI stakeholders to raise the bar on how enterprise AI is tested and delivered.

Responsibilities
  • Define and execute quality strategies for AI-enabled products and platforms.
  • Design, develop, and maintain scalable, automated test frameworks across UI, API, and end-to-end testing.
  • Create test plans covering functional, integration, end-to-end, performance, and reliability testing.
  • Develop automated validation approaches for AI-generated outputs and agentic workflows, including accuracy, reliability, consistency, and safety.
  • Establish quality metrics and dashboards to measure product health and AI system effectiveness.
  • Integrate automated tests into CI/CD pipelines and build automated quality gates for AI workflows.
  • Identify quality risks early and drive resolution strategies across complex systems.
  • Evaluate and implement AI-powered testing tools and methodologies.
  • Mentor engineers, promote quality engineering best practices, and drive continuous improvement initiatives across the organization.
Qualifications
  • Bachelor's degree in Computer Science, Software Engineering, Computer Engineering, or a related field.
  • 5+ years of experience in Quality Engineering, Test Automation, SDET, or Software Engineering roles.
  • Strong programming experience in Java, Python, or a similar object-oriented language.
  • Hands-on experience developing and maintaining automated test frameworks, with UI, API, and end-to-end automation testing.
  • Experience with modern test automation tools such as Playwright, Selenium, Cypress, or equivalent.
  • Experience integrating automated tests into CI/CD pipelines and working with Git.
  • Strong understanding of the software development lifecycle, Agile methodologies, and quality engineering best practices.
  • Demonstrated ability to analyze complex systems, architect test frameworks, and identify quality risks.
  • Excellent written and verbal communication skills.
Preferred Qualifications
  • Experience testing AI-powered applications, machine learning systems, LLMs, or AI agents.
  • Experience designing evaluation strategies for AI outputs, including accuracy, reliability, consistency, and safety.
  • Familiarity with AI evaluation frameworks such as DeepEval, LangSmith, Ragas, or similar tools.
  • Experience validating Retrieval-Augmented Generation (RAG) systems and knowledge of prompt engineering and AI model evaluation techniques.
  • Experience building automated quality gates for AI workflows and AI-assisted test generation.
  • Experience with cloud platforms such as AWS, Azure, or GCP, containerized environments, and observability and monitoring tools.
  • Experience mentoring engineers and driving quality initiatives across teams.

C3 AI provides a competitive compensation package and excellent benefits.

C3 AI is proud to be an Equal Opportunity and Affirmative Action Employer. We do not discriminate on the basis of any legally protected characteristics, including disabled and veteran status. 

Skills Required

  • Bachelor's degree in Computer Science, Software Engineering, Computer Engineering, or related field.
  • 5+ years experience in Quality Engineering, Test Automation, SDET, or Software Engineering roles.
  • Strong programming experience in Java, Python, or a similar object-oriented language.
  • Hands-on experience developing and maintaining automated test frameworks with UI, API, and end-to-end automation testing.
  • Experience with modern test automation tools such as Playwright, Selenium, Cypress, or equivalent.
  • Experience integrating automated tests into CI/CD pipelines and working with Git.
  • Strong understanding of the software development lifecycle, Agile methodologies, and quality engineering best practices.
  • Demonstrated ability to analyze complex systems, architect test frameworks, and identify quality risks.
  • Excellent written and verbal communication skills.
  • Experience testing AI-powered applications, machine learning systems, LLMs, or AI agents.
  • Experience designing evaluation strategies for AI outputs including accuracy, reliability, consistency, and safety.
  • Familiarity with AI evaluation frameworks such as DeepEval, LangSmith, Ragas, or similar tools.
  • Experience validating Retrieval-Augmented Generation (RAG) systems and prompt engineering.
  • Experience building automated quality gates for AI workflows and AI-assisted test generation.
  • Experience with cloud platforms (AWS, Azure, GCP), containerized environments, and observability/monitoring tools.
  • Experience mentoring engineers and driving quality initiatives across teams.

C3 AI Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about C3 AI and has not been reviewed or approved by C3 AI.

  • Fair & Transparent Compensation Pay is considered competitive to above average for many roles, and compensation stands out more positively than several other aspects of the company. High-end packages are available in certain roles and levels, indicating the ability to pay at or above market when needed.
  • Career-Linked Recognition & Rewards The company funds an online master’s program that confers a $25,000 completion bonus, a guaranteed 15% raise, and a stock grant. Ongoing internal training and small course-completion bonuses further tie rewards to development milestones.
  • Wellbeing & Lifestyle Benefits Daily catered lunches, stocked snacks, a free gym membership at the Redwood City HQ, and commuter benefits provide tangible day-to-day perks. Business-travel health coverage and other on-site amenities enhance the workplace experience for those regularly in office.

C3 AI Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Redwood City, CA
923 Employees
Year Founded: 2009

What We Do

C3 AI is the leading Enterprise AI software provider for accelerating digital transformation. Digital transformation is about leveraging big data and the internet of things to improve performance of assets and predict shortfalls before they happen — all through artificial intelligence and machine learning. Get ahead of supply chain delays before they affect your delivery deadlines. Predict maintenance needs to increase asset uptime, replacing or repairing parts before failure. Reduce energy costs and track sustainability goals in real time, improving building operations and reducing greenhouse gas emissions. Connect disparate health record systems to optimize patient visits and decrease waitlist time. At the core of all C3 AI products is a proprietary, model-driven AI architecture that dramatically enhances data science and application development. The C3 AI Platform allows customers to develop, deploy, and operate large-scale AI, predictive analytics, and IoT applications. And a broad portfolio of turnkey AI applications allows for even faster development and deployment. From reliability and readiness to supply chain optimization and energy management, C3 AI has deep industry expertise to get your enterprise started on its digital transformation.

Similar Jobs

Perficient Logo Perficient

Automation Engineer

Information Technology
In-Office or Remote
6 Locations
3295 Employees

Mondelēz International Logo Mondelēz International

Business Development Candy

Big Data • Food • Hardware • Machine Learning • Retail • Automation • Manufacturing
Remote or Hybrid
Guadalajara, Jalisco, MEX
90000 Employees

Mondelēz International Logo Mondelēz International

Developer, Product Development

Big Data • Food • Hardware • Machine Learning • Retail • Automation • Manufacturing
Remote or Hybrid
7 Locations
90000 Employees

Samsara Logo Samsara

Mid-market Account Executive

Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Easy Apply
Remote or Hybrid
México
4000 Employees
20K-100K Annually

Similar Companies Hiring

Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account