Senior Quality Engineer - AI Proactive Defense

Posted Yesterday
Be an Early Applicant
Bengaluru, Bengaluru Urban, Karnataka
In-Office
Senior level
Security • Software • Cybersecurity
The Role
The Senior Quality Engineer will develop testing strategies and frameworks to ensure the reliability and performance of AI systems. Responsibilities include manual and automated testing, creating validation frameworks, and collaborating with developers on quality gates.
Summary Generated by Built In

At Arctic Wolf, we're redefining the cybersecurity landscape. With our employee Pack members, spread out globally, committed to setting new industry standards. Our accomplishments speak for themselves, from our recognition in the Forbes Cloud 100, CNBC Disruptor 50, Fortune Future 50, and Fortune Cyber 60 to winning the 2024 CRN Products of the Year award. We’re proud to be named a Leader in the IDC MarketScape for Worldwide Managed Detection and Response Services and earning a Customers' Choice distinction from Gartner Peer Insights. Our Aurora Platform also received CRN’s Products of the Year award in the inaugural Security Operations Platform category. Join a company that’s not only leading, but also shaping, the future of security operations.

Our mission is to end cyber risk. This is a unique opportunity to lead a high-impact, highly technical team in a fast-growing company recognized on the Deloitte Fast 500, with a track record of doubling in size, revenue, and customer base year over year.

About the Role

We are looking for a Senior Quality Engineer to ensure the reliability, safety, and performance of the next generation of agentic AI frameworks powering Arctic Wolf’s AI Proactive Defence platform.

In this role, you’ll design and implement comprehensive quality strategies — combining manual and automated testing — to validate intelligent agents that reason, act, and collaborate autonomously. You’ll work closely with developers, data scientists, and product teams to verify AI-driven orchestration, multi-agent workflows, and LLM integrations in production-grade environments.

Key Responsibilities

  • Design and implement end-to-end quality strategies for agentic AI systems, balancing manual exploratory testing with automation frameworks.
  • Develop and maintain validation frameworks for multi-agent orchestration logic — ensuring correctness in planning, decision-making, and adaptive behaviours.
  • Develop and run manual and automated test pipelines to validate end-to-end functionality, data flow, and system reliability across AI services.
  • Perform exploratory testing of AI reasoning, tool usage, and agent collaboration workflows to uncover edge cases and emergent behaviours.
  • Automate test coverage for APIs, microservices, and orchestration components using modern testing tools and frameworks.
  • Create observability and monitoring solutions to assess agent accuracy, latency, and behavioural consistency.
  • Collaborate with AI and backend developers to embed quality gates and automated checks into CI/CD pipelines.
  • Evaluate and integrate testing tools for AI-specific workflows (prompt validation, response benchmarking, output scoring).
  • Champion best practices for reproducibility, versioning, and manual/automated validation of AI model behaviours.
  • Contribute to cross-team initiatives — R&D demos, hackathons, and innovation sprints.

About You

  • 5+ years of experience in Quality Engineering, SDET, or Software Testing (manual and automated) in distributed or AI-driven systems.
  • Strong experience designing and executing both manual exploratory tests and automated test frameworks.
  • Proficient in Python, Java, or Go for developing test automation scripts and frameworks.
  • Have worked on distributed systems and microservices architecture (preferred)
  • Hands-on experience with API testing, microservices validation, and CI/CD integration (GitHub Actions, Jenkins, etc.).
  • Experience with AI technologies and frameworks that enable intelligent agents, automation, and contextual reasoning.
  • Familiarity with cloud-native testing (AWS, GCP, or Azure) and containerized environments (Docker, Kubernetes).
  • Experience with observability tools (Grafana, Prometheus) to validate performance and system health.
  • Strong analytical, debugging, and communication skills; able to translate complex AI behaviours into clear, testable criteria.
  • Passionate about ensuring quality and trustworthiness in intelligent, autonomous systems.

You have a history of delivering successful projects, as well as some lessons learned from failures. Even if you haven’t worked with all our specific technologies, you bring a diverse knowledge base that you use to help the team solve complex technical problems. You’ll receive all the security training you need during our onboarding process and through additional training on the job.

Nice to Have

  • Exposure to cybersecurity, SOC operations, or threat detection systems.
  • Experience validating machine learning models, data pipelines, or AI evaluation metrics.
  • Knowledge of ML Ops tools (MLflow, Kubeflow) and AI-specific test harnesses.
  • Contributions to open-source testing, QA, or AI projects.

Our Values  

Arctic Wolf recognizes that success comes from delighting our customers, so we work together to ensure that happens every day. We believe in diversity and inclusion, and truly value the unique qualities and unique perspectives all employees bring to the organization. And we appreciate that—by protecting people’s and organizations’ sensitive data and seeking to end cyber risk— we get to work in an industry that is fundamental to the greater good.  

We celebrate unique perspectives by creating a platform for all voices to be heard through our Pack Unity program. We encourage all employees to join or create a new alliance. See more about our Pack Unity here.   

We also believe and practice corporate responsibility, and have recently joined the Pledge 1% Movement, ensuring that we continue to give back to our community. We know that through our mission to End Cyber Risk we will continue to engage and give back to our communities.  

All wolves receive compelling compensation and benefits packages, including:  

Equity for all employees 

Flexible annual leave, paid holidays and volunteer days 

Training and career development programs 

Comprehensive private benefits plan including medical insurance for you and your family, life insurance (3x compensation), and personal accident insurance. 

Fertility support and paid parental leave 

Arctic Wolf is an Equal Opportunity Employer and considers applicants for employment without regard to race, color, religion, sex, orientation, national origin, age, disability, genetics, or any other basis forbidden under federal, provincial, or local law. Arctic Wolf is committed to fostering a welcoming, accessible, respectful, and inclusive environment ensuring equal access and participation for people with disabilities. As such, we strive to make our entire employee experience as accessible as possible and provide accommodations as required for candidates and employees with disabilities and/or other specific needs where possible. Please let us know if you require any accommodations by emailing [email protected]. 

On-Camera Policy

To support a fair, transparent, and engaging interview experience, candidates interviewing remotely are expected to be on camera during all video interviews.
Being on camera fosters authentic connection, improves communication, and allows for full engagement from both candidates and interviewers.
We understand that technical, bandwidth, or location-related challenges may occasionally prevent video use. If this applies, candidates are required to notify us in advance so we can explore appropriate accommodations.

Security Requirements

Conducts duties and responsibilities in accordance with AWN’s Information Security policies, standards, processes, and controls to protect the confidentiality, integrity, and availability of AWN business information (in accordance with our employee handbook and corporate policies).
Background checks are required for this position.
This position may require access to information protected under U.S. export control laws and regulations, including the Export Administration Regulations (“EAR”). Please note that, if applicable, an offer for employment will be conditioned on authorization to receive software or technology controlled under these laws and regulations

Top Skills

AWS
Azure
Ci/Cd
Docker
GCP
Github Actions
Go
Grafana
Java
Jenkins
Kubernetes
Prometheus
Python
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Eden Prairie, MN
810 Employees
Year Founded: 2012

What We Do

The cybersecurity industry has an effectiveness problem. Every year new technologies, vendors, and solutions emerge, and yet despite this constant innovation we continue to see high profile breaches in the headlines. All organizations know they need better security, but the dizzying array of options leave resource-constrained IT and security leaders wondering how to proceed. At Arctic Wolf, our mission is to End Cyber Risk through effective security operations. To achieve this, we believe that organizations must do three key things:

Similar Jobs

Remote or Hybrid
Bengaluru, Bengaluru Urban, Karnataka, IND
670 Employees

Capital One Logo Capital One

Senior Software Engineer

Fintech • Machine Learning • Payments • Software • Financial Services
Hybrid
Bengaluru, Bengaluru Urban, Karnataka, IND
55000 Employees

Capital One Logo Capital One

Principal Associate- Recruiting

Fintech • Machine Learning • Payments • Software • Financial Services
Hybrid
Bengaluru, Bengaluru Urban, Karnataka, IND
55000 Employees

Capital One Logo Capital One

Software Engineer

Fintech • Machine Learning • Payments • Software • Financial Services
Hybrid
Bengaluru, Bengaluru Urban, Karnataka, IND
55000 Employees

Similar Companies Hiring

Standard Template Labs Thumbnail
Software • Information Technology • Artificial Intelligence
New York, NY
10 Employees
PRIMA Thumbnail
Travel • Software • Marketing Tech • Hospitality • eCommerce
US
15 Employees
Scotch Thumbnail
Software • Retail • Payments • Fintech • eCommerce • Artificial Intelligence • Analytics
US
25 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account