Principal AI/ML Engineer

Posted 9 Hours Ago
Be an Early Applicant
Pune, Maharashtra
Hybrid
Expert/Leader
Artificial Intelligence • Cloud • Information Technology • Sales • Security • Software • Cybersecurity
Take Command of your Career
The Role
Lead the integration of Large Language Models into cybersecurity products, overseeing architecture, MLOps, and data science applications to enhance AI security features.
Summary Generated by Built In
Principal LLM Engineer
Join Rapid7: Secure the Future with AI
Are you ready to lead the charge in integrating cutting-edge Large Language Models (LLMs) into world-class Cyber Security products?
Rapid7 is looking for a Principal LLM Engineer with a rare combination of deep Data Science expertise, mastery of production MLOps, and 13+ years of experience. You won't just build models; you'll architect the AI systems that protect our customers from the world's most sophisticated threats. This is a role for a proven leader who turns breakthrough research into scalable, high-impact security solutions.
What You'll Be Doing: Technical Leadership
As a Principal Engineer, you will define and execute the technical strategy across three critical domains:
1. LLM & AI System Architecture
You'll design and build the next generation of AI-powered security features.
  • LLM Orchestration: Architect complex security applications using frameworks like LangChain and LangGraph to connect LLMs with our data and tools.
  • RAG Pipelines: Build and optimise high-performance Retrieval-Augmented Generation (RAG) systems using Vector DBs to give our AI the context it needs from vast security datasets.
  • Model Optimisation: Implement efficient adaptation techniques (LoRA/PEFT) and run rigorous evaluation using tools like Promptfoo/HELM to ensure model accuracy and safety.
  • Governance & Safety: Design and enforce security Guardrails and governance policies for all LLM deployments.

2. Security-Focused MLOps & Production
You'll ensure our AI is always live, stable, and fighting threats.
  • Real-Time Monitoring: Establish comprehensive monitoring with Prometheus/Grafana/CloudWatch and lead our response to production incidents (PagerDuty, On-call).
  • Model Life Cycle: Master the MLOps pipeline, from model versioning (MLflow/SageMaker) to automating Drift Detection & Retraining.
  • Infrastructure: Use Terraform and Docker/Kubernetes to deploy scalable microservices and APIs.
  • Cloud Security Integration: Leverage AWS Bedrock/SageMaker/Lambda and ensure all deployments adhere to the highest standards of Cloud Security (IAM, VPC, Secrets).
  • CI/CD: Drive continuous deployment for our AI systems using tools like GitHub Actions/Jenkins.

3. Data Science & Security Foundation
Your background will enable you to solve complex security problems with data.
  • Deep Learning: Apply expertise in NLP, CNN, RNN, etc. to analyse security data (logs, network traffic, etc.).
  • Security Models: Drive the development of Malware Detection models, User behavioural models, and Malware behaviour-based Models.
  • Data Engineering: Lead initiatives in Data Acquisition, Feature Engineering, and transformation across services like S3, DynamoDB, and Redshift.
  • Explainable AI (XAI): Use SHAP/LIME to ensure transparency and explainability in security decisions made by AI.

What You'll Bring
  • 13+ years of professional experience in Data Science, with a significant focus on LLMs/NLP and production MLOps.
  • Advanced degree (Master's or PhD) in Computer Science, Data Science, or a related field, or equivalent practical experience.
  • A proven track record of taking complex ML/LLM projects from concept to highly available production systems.
  • Familiarity with Cost Optimisation (FinOps) for cloud resources.

If you thrive on solving the hardest problems in AI and applying that power to make the world a safer place, we want to hear from you!

Top Skills

Aws Bedrock
Cloudwatch
Docker
DynamoDB
Github Actions
Grafana
Helm
Jenkins
Kubernetes
Lambda
Langchain
Langgraph
Large Language Models
Lime
Lora
Mlflow
Mlops
Pagerduty
Peft
Prometheus
Promptfoo
Redshift
S3
Sagemaker
Shap
Terraform
Vector Db

What the Team is Saying

Priya
Sammi
Tara
John
Grace
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Boston, MA
2,400 Employees
Year Founded: 2000

What We Do

At Rapid7, our vision is to create a secure digital world for our customers, our industry, and our communities. We do this by harnessing our collective expertise and passion to challenge what’s possible and drive extraordinary impact. We’re building a dynamic and collaborative workplace where new ideas are welcome.

Protecting 11,000+ customers against bad actors and threats means we’re continuing to push the envelope - just like we’ve been doing for the past 20 years. If you’re ready to solve some of the toughest challenges in cybersecurity, we’re ready to help you take command of your career.

Join us.

Why Work With Us

With our products, research, and open source communities, we’re building a secure digital future for everyone. This means constantly learning and evolving in an industry that’s anything but stagnant. You’ll be faced with tough challenges, and given the support to find creative solutions that drive our business, and your career forward.

Gallery

Gallery
Gallery
Gallery
Gallery
Gallery
Gallery
Gallery
Gallery
Gallery
Gallery

Rapid7 Offices

Hybrid Workspace

Employees engage in a combination of remote and on-site work.

Our default working model is hybrid, with employees working three days per week in the office. This approach underpins our commitment to flexibility and adaptability while supporting our dedication to development, teamwork and customer purpose.

Typical time on-site: 3 days a week
Company Office Image
HQBoston
Singapore - Regional Headquarters
Company Office Image
Arlington
Company Office Image
Austin, TX
Company Office Image
Belfast, GB
Dublin
Galway
Melbourne
Tokyo
Munich
Company Office Image
Prague
India
Company Office Image
Reding, UK
Company Office Image
Tampa, FL
Tel Aviv
Learn more

Similar Jobs

Rapid7 Logo Rapid7

Senior CloudOps Engineer

Artificial Intelligence • Cloud • Information Technology • Sales • Security • Software • Cybersecurity
Hybrid
Pune, Maharashtra, IND

Rapid7 Logo Rapid7

Freshservice Administrator

Artificial Intelligence • Cloud • Information Technology • Sales • Security • Software • Cybersecurity
Hybrid
Pune, Maharashtra, IND

Rapid7 Logo Rapid7

Manager, Enterprise Applications

Artificial Intelligence • Cloud • Information Technology • Sales • Security • Software • Cybersecurity
Remote or Hybrid
Pune, Maharashtra, IND

Rapid7 Logo Rapid7

Software Quality Engineer II

Artificial Intelligence • Cloud • Information Technology • Sales • Security • Software • Cybersecurity
Hybrid
Pune, Maharashtra, IND

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account