Lead Software Development Engineer in Test - AI

Posted 8 Days Ago
Be an Early Applicant
Hiring Remotely in India
Remote
Senior level
Information Technology • Internet of Things • Marketing Tech
The Role
Lead QA for AI products: define QA strategy, architect large-scale reusable automation frameworks, design tests for RAG, hallucination, drift, and bias, influence cross-functional teams, coach and upskill engineers, and own the AI verticals quality roadmap to improve scalability and reliability.
Summary Generated by Built In

About HighLevel:
HighLevel is an AI-powered business operating system that gives agencies, entrepreneurs and SMBs the infrastructure to build, automate and scale. Today, HighLevel supports SMBs across 150+ countries, fueling community-driven growth rooted in real customer outcomes.
To date, businesses operating on HighLevel have generated over $7 billion in ecosystem value, demonstrating the impact of shared infrastructure at scale. By centralizing conversations, automation and intelligence into one system, we help businesses move faster, reduce complexity and execute efficiently.
Behind the platform, HighLevel powers more than 4 billion API hits and 2.5 billion message events daily. With 250 terabytes of distributed data, 250+ microservices and over 1 million domain names supported, our architecture is built for performance, resilience and long-term scalability.
Our People
With over 2,000 team members across 10+ countries, HighLevel operates as a global, remote-first organization built for speed and ownership. We value initiative, clarity and execution, creating space for ambitious people to build systems that support millions of businesses worldwide. Here, innovation thrives, ideas are celebrated and people come first, no matter where they call home.
Our Impact
Every month, HighLevel enables more than 1.5 billion messages, 200 million leads and 20 million conversations for the more than 1 million businesses we support. Behind those numbers are real people building independence, expanding opportunity and creating measurable impact. We’re proud to be a part of that.

Learn more about us on our YouTube Channel or Blog Posts.

About the Role:

    We are looking for a Lead Software Development Engineer in Test with deep expertise in AI tools and model testing. This role requires an individual who can define overall QA strategy, architect automation frameworks, and drive organisation-wide quality initiatives for our AI products. You will own the quality charter for the AI vertical, influence cross-functional teams, and play a key role in shaping the AI quality roadmap.

Requirements:

  • 7+ years of overall experience in QA/SDET roles
  • Deep expertise in AI tools & model testing, responsible for designing scalable test approaches for RAG, hallucination, drift, and bias
  • Proven experience in architecting large-scale, reusable, cross-platform automation frameworks
  • Strong leadership skills to coach and upskill an entire team, set best practices, and build a talent pipeline
  • Ability to influence cross-functional teams and participate in architecture discussions
  • Strong problem-solving skills with the ability to own decisions on test strategy, tools, frameworks, and AI testing methodologies

Responsibilities:

  • Define overall QA strategy and architect large-scale, reusable, cross-platform automation frameworks
  • Drive organization-wide quality initiatives and own the quality charter for the AI vertical
  • Possess deep expertise in AI tools & model testing, responsible for designing scalable test approaches for RAG, hallucination, drift, and bias
  • Own decisions on test strategy, tools, frameworks, and AI testing methodologies
  • Coach and upskill the entire team, set best practices, and build talent pipeline
  • Influence cross-functional teams, participate in architecture discussions, and align testing with business strategy
  • Responsible for end-to-end quality strategy at the product/vertical level
  • Shape AI quality roadmap, reduce organization-wide risk, and improve scalability and reliability

Bonus Points:

  • Experience with CI/CD pipelines and cloud platforms (AWS/GCP/Azure).
  • Familiarity with MLOps pipelines and monitoring AI systems.
  • Exposure to performance and scalability testing of AI workloads.

EEO Statement:

The company is an Equal Opportunity Employer. As an employer subject to affirmative action regulations, we invite you to voluntarily provide the following demographic information. This information is used solely for compliance with government recordkeeping, reporting, and other legal requirements. Providing this information is voluntary and refusal to do so will not affect your application status. This data will be kept separate from your application and will not be used in the hiring decision.
We encourage you to review our Privacy Policy before submitting your application

Skills Required

  • 7+ years of overall experience in QA/SDET roles
  • Deep expertise in AI tools and model testing (design scalable test approaches for RAG, hallucination, drift, and bias)
  • Proven experience architecting large-scale, reusable, cross-platform automation frameworks
  • Strong leadership skills to coach and upskill teams, set best practices, and build a talent pipeline
  • Ability to influence cross-functional teams and participate in architecture discussions
  • Strong problem-solving skills and ownership of test strategy, tools, frameworks, and AI testing methodologies
  • Experience with CI/CD pipelines and cloud platforms (AWS/GCP/Azure)
  • Familiarity with MLOps pipelines and monitoring AI systems
  • Exposure to performance and scalability testing of AI workloads

HighLevel Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about HighLevel and has not been reviewed or approved by HighLevel.

  • Healthcare Strength Employer materials highlight employer-paid medical and vision for employees, with mental health support and short‑term disability included. Feedback suggests health coverage is a relative bright spot that can raise overall satisfaction even when base pay is not top‑tier.
  • Leave & Time Off Breadth Flexible PTO, paid family leave, and paid holidays are emphasized alongside a remote‑first setup. Feedback suggests this time‑off approach supports work–life balance and is frequently cited as part of the value proposition.
  • Retirement Support A company‑matched 401(k) is presented as part of the core package. Feedback suggests retirement support contributes meaningful long‑term value and helps offset tradeoffs in cash compensation.

HighLevel Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Dallas, OR
974 Employees
Year Founded: 2018

What We Do

https://www.gohighlevel.com/quick-links One white-labeled marketing app to rule them all. HighLevel is everything your business needs to succeed! Capture leads using our landing pages, surveys, forms, calendars, inbound phone system & more! Automatically message leads via voicemail, forced calls, SMS, emails, FB Messenger & more! Use our built in tools to collect payments, schedule appointments, and track analytics

Similar Jobs

Micron Technology Logo Micron Technology

Test Equipment Engineer

Artificial Intelligence • Hardware • Information Technology • Machine Learning
Remote
Gujarat, IND
45000 Employees

Micron Technology Logo Micron Technology

Test Equipment Engineer

Artificial Intelligence • Hardware • Information Technology • Machine Learning
Remote
Gujarat, IND
45000 Employees

Micron Technology Logo Micron Technology

Automation Engineer

Artificial Intelligence • Hardware • Information Technology • Machine Learning
Remote
Gujarat, IND
45000 Employees
120K-150K Annually

Mondelēz International Logo Mondelēz International

S4HANA Internal Control CCM and CCT, Analyst

Big Data • Food • Hardware • Machine Learning • Retail • Automation • Manufacturing
Remote or Hybrid
2 Locations
90000 Employees

Similar Companies Hiring

Standard Template Labs Thumbnail
Artificial Intelligence • Information Technology • Software
New York, NY
25 Employees
PRIMA Thumbnail
Travel • Software • Marketing Tech • Hospitality • eCommerce
US
15 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account