Senior Quality Engineer - AutoSOC

Posted 17 Days Ago
Be an Early Applicant
Bengaluru, Bengaluru Urban, Karnataka, IND
In-Office
Senior level
Security • Software • Cybersecurity
The Role
Design, build, and extend automated test frameworks and CI/CD tooling for a high-scale security operations platform. Develop testing pipelines for API, performance, fuzzing, and GenAI/LLM model validation, including evaluation of accuracy, latency, bias, hallucination, and reliability. Collaborate with engineers to review test strategies and deploy services in cloud environments.
Summary Generated by Built In

About the Role 
The Arctic Wolf security operations platform ingests and processes upwards of 600 billion events a day from a wide variety of on-premise devices and cloud platforms. The security pipeline is a distributed system of loosely-coupled microservices that constitute our Realtime analysis and threat detection systems. These services distil the incoming events into actionable intelligence that our Concierge Security Teams use to protect customers. 

We are looking for experienced quality engineers to join our pack and work with us to build and expand the capabilities of our testing platform.  

 

You Will: 

  • Create and extend software frameworks and tools to run, monitor, and report on automated tests. Have experience building and maintaining Automation frameworks and CI/CD pipeline. 

  • Review testing strategies, approaches, and test plans and provide insight to development teams. 

  • Architect, design and build software to automate a variety of testing methods (e.g. API validation, performance/load testing, fuzzing, etc.) 

  • Develop and maintain test frameworks for GenAI-based and AI/ML applications, including model validation, LLM prompt-response consistency, hallucination detection, and regression testing for AI inference APIs. 

  • Implement evaluation pipelines to test LLM accuracy, latency, bias, toxicity, and reliability. 

  • Work as part of a team of highly skilled software professionals. 

  • Continuously learn and expand your technical horizons 

  • Our Technology Stack: Selenium, Playwright, Docker, Kubernetes, AWS (Bedrock, Lambda, SQS, S3, etc.), LangChain, LLM evaluation frameworks (e.g., Ragas), OpenAPI, Postgres, Linux. 

 

You: 

  • Are excited to work at the intersection of AIML, Big Data and the Cybersecurity problem space 

  • Have 5+ years of experience shipping quality software 

  • Love driving high software quality 

  • Have experience deploying services on cloud computing platforms (e.g, AWS, Azure, GCP) 

  • Are an expert using common tools for executing functional, load and fuzz testing (e.g. Locust, CATS) 

  • Have worked on distributed systems and microservices architecture (preferred) 

 

About Arctic Wolf 
At Arctic Wolf, we’re cultivating a collaborative and productive work environment that welcomes a diversity of backgrounds, cultures, and ideas to make our teams even stronger as we grow globally. We’ve been named one of the 50 Most Innovative Companies in the world for 2022 (Fast Company)—and the 2nd Most Innovative Security Company. We have won countless awards for our excellence in security operations and remain dedicated to providing an industry-leading customer and employee experience including: 
 

Top Workday USA (2021-2024) 

Great Place to Work (2022-2024) & Best Workplaces for Women (2024) in Canada 

Best Workplaces in Tech & For Women in the UK (2023) 

Top Company by Kununu in Germany (2024) 

 

Our Values 
Arctic Wolf recognizes that success comes from delighting our customers, so we work together to ensure that happens every day. We believe in diversity and inclusion and truly value the unique qualities and unique perspectives all employees bring to the organization. And we appreciate that—by protecting people’s and organizations’ sensitive data and seeking to end cyber risk— we get to work in an industry that is fundamental to the greater good. 
We celebrate unique perspectives by creating a platform for all voices to be heard through our Pack Unity program. We encourage all employees to join or create a new alliance. See more about our Pack Unity here. Arctic Wolf is an Equal Opportunity Employer and considers applicants for employment without regard to race, colour, religion, sex, orientation, national origin, age, disability, genetics, or any other basis forbidden under federal, provincial, or local law. Arctic Wolf is committed to fostering a welcoming, accessible, respectful, and inclusive environment ensuring equal access and participation for people with disabilities. As such, we strive to make our entire employee experience as accessible as possible and provide accommodations as required for candidates and employees with disabilities and/or other specific needs where possible. Please let us know if you require any accommodations by emailing [email protected]. 

 

On-Camera Policy
To support a fair, transparent, and engaging interview experience, candidates interviewing remotely are expected to be on camera during all video interviews.
 Being on camera fosters authentic connection, improves communication, and allows for full engagement from both candidates and interviewers.
 We understand that technical, bandwidth, or location-related challenges may occasionally prevent video use. If this applies, candidates are required to notify us in advance so we can explore appropriate accommodations.

Security Requirements 
Conducts duties and responsibilities in accordance with AWN’s Information Security policies, standards, processes, and controls to protect the confidentiality, integrity and availability of AWN business information (in accordance with our employee handbook and corporate policies). 

Background checks are required for this position. 


Skills Required

  • 5+ years experience shipping quality software
  • Experience building and maintaining automation frameworks and CI/CD pipelines
  • Experience deploying services on cloud platforms (AWS, Azure, GCP)
  • Expertise in functional, load and fuzz testing tools (e.g., Locust, CATS)
  • Experience testing AI/ML and GenAI applications, including LLM evaluation and model validation
  • Experience with distributed systems and microservices architecture
  • Proficiency with Selenium and Playwright
  • Experience with Docker and Kubernetes
  • Familiarity with AWS services (Bedrock, Lambda, SQS, S3)
  • Familiarity with LangChain and LLM evaluation frameworks (e.g., Ragas)
  • Experience with OpenAPI, Postgres, and Linux

Arctic Wolf Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Arctic Wolf and has not been reviewed or approved by Arctic Wolf.

  • Strong & Reliable Incentives Incentive plans in sales roles are seen as strong when targets are met, with on‑target earnings positioned as competitive. This dynamic helps explain notably higher satisfaction in sales relative to other functions.
  • Equity Value & Accessibility Equity is included for all employees across offers, broadening ownership beyond limited groups. Broad access to equity can provide meaningful upside tied to company performance.
  • Leave & Time Off Breadth Flexible paid time off and dedicated volunteer time off are core parts of the package. These options expand avenues for time away beyond standard vacation and holidays.

Arctic Wolf Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Eden Prairie, CA
810 Employees
Year Founded: 2012

What We Do

The cybersecurity industry has an effectiveness problem. Every year new technologies, vendors, and solutions emerge, and yet despite this constant innovation we continue to see high profile breaches in the headlines. All organizations know they need better security, but the dizzying array of options leave resource-constrained IT and security leaders wondering how to proceed. At Arctic Wolf, our mission is to End Cyber Risk through effective security operations. To achieve this, we believe that organizations must do three key things:

Similar Jobs

Hybrid
Bengaluru, Bengaluru Urban, Karnataka, IND
289097 Employees
Remote or Hybrid
2 Locations
289097 Employees

CrowdStrike Logo CrowdStrike

MSSP Alliance Manager

Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Hybrid
Bangalore, Bengaluru Urban, Karnataka, IND
11000 Employees

LogicMonitor Logo LogicMonitor

Contract Management Analyst

Artificial Intelligence • Cloud • Information Technology • Machine Learning • Software
Easy Apply
Hybrid
2 Locations
1100 Employees

Similar Companies Hiring

Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account