Manager, AI Ops Site Reliability Engineer

Posted Yesterday
Be an Early Applicant
Chortiatis, GRC
Hybrid
Mid level
Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
We’re in relentless pursuit of breakthroughs that change patients’ lives.
The Role
Designs and evaluates AI agents for site reliability and infrastructure operations. Responsibilities include creating agent workflows, prompts, retrieval and decision logic; building evaluation harnesses with ground-truth datasets and quality metrics; establishing reasoning guardrails; converting operational knowledge into retrievable context; and measuring improvements in toil and MTTR. The role partners with SRE, operations, platform, and AI teams to deploy reliable agent-assisted workflows.
Summary Generated by Built In
ROLE SUMMARY
The CISO Infrastructure & Cloud Services organization delivers excellence in the pursuit of breakthroughs that change patients' lives through industry-leading infrastructure operations performance. We ensure optimal performance of global application hosting and network services that power Pfizer's business processes. We strive to revolutionize service dependability by applying advanced analytics to drive predictive detection, identifying potential issues with our services and intervening before they disrupt our business. We place data at the heart of what we do and apply a relentless focus on continuous improvement to enable Pfizer's business processes and patient outcomes.
We are seeking an Manager, AI Ops Site Reliability Engineer to own how our operations agents think and how well they perform, within Hosting SRE Operations, based in Greece. In this role, you design the agent workflows, prompts and context, build the evaluation harness that proves accuracy against our own estate, and partner with our existing domain experts to convert their operational know-how into reliable, measurable agent behavior. You bring depth in AI and evaluation; our domain specialists bring the deep OS, Storage, Data Protection, Database and HCI knowledge - together you turn classic operations into trustworthy AI operations.
ROLE RESPONSIBILITIES
  • Design agent workflows for intake and investigation: the prompts, context and retrieval, tool selection and decision logic that determine how the agent classifies, enriches and reasons about incidents.
  • Build and own the evaluation harness: ground-truth datasets drawn from historical incidents, accuracy, precision and recall metrics, regression tests, and hallucination and error detection - so every change to an agent is measured before it ships.
  • Define the reasoning guardrails: what an agent may conclude and propose, how confident it must be, and when it must defer to a human - the quality side of the approval gate.
  • Turn tacit operational knowledge into machine-usable context: work with the existing domain experts to convert their runbooks and past investigations into retrievable knowledge the agent can cite.
  • Run the transformation on Operational workflows: take a classic operational process, redesign it with the domain owner as an agent-assisted flow, pilot it, and measure toil and MTTR reduction.
  • Continuously tune agent quality against production results, feeding misses back into prompts, context and the evaluation sets.
  • Collaborate with SRE, Ops, Platform teams, AI Ops Platform Engineers, AI Ops Site Reliability Engineers, and other stakeholders to align operational requirements, platform capabilities, automation strategies, and execution priorities

QUALIFICATIONS
  • Bachelor's degree in a technical field or equivalent practical experience.
  • 4 years+ in software, data or ML/AI engineering, including hands-on delivery of LLM or agent-based applications in production.
  • Demonstrated prompt and context engineering, and experience building structured evaluations for AI systems (ground-truth sets, metrics, regression testing; LLM-as-judge a plus).
  • Working knowledge of agent frameworks and tooling (for example Amazon Bedrock AgentCore or LangGraph) and RAG / knowledge-base design, with strong Python.
  • IT operations literacy to design realistic operational workflows and judge the plausibility of agent output. You do not need to be a domain administrator - you will partner with domain experts who are.
  • Strong analytical and communication skills to work with SREs, extract knowledge and present accuracy results credibly. Familiarity with ServiceNow, Dynatrace or observability data is a plus.
  • Demonstrated experience in an agile work environment possessing qualities such as a collaborative mindset, adaptability to change, and a proactive problem-solving approach.

NON-STANDARD WORK SCHEDULE, TRAVEL OR ENVIRONMENT REQUIREMENTS
  • Periodic international and domestic travel required (less than 10%)

Please apply by sending your CV in English.
Work Location Assignment: Hybrid
Purpose
Breakthroughs that change patients' lives... At Pfizer we are a patient centric company, guided by our four values: courage, joy, equity and excellence. Our breakthrough culture lends itself to our dedication to transforming millions of lives.
Digital Transformation Strategy
One bold way we are achieving our purpose is through our company wide digital transformation strategy. We are leading the way in adopting new data, modelling and automated solutions to further digitize and accelerate drug discovery and development with the aim of enhancing health outcomes and the patient experience.
Flexibility
We aim to create a trusting, flexible workplace culture which encourages employees to achieve work life harmony, attracts talent and enables everyone to be their best working self. Let's start the conversation!
Equal Employment Opportunity
We believe that a diverse and inclusive workforce is crucial to building a successful business. As an employer, Pfizer is committed to celebrating this, in all its forms - allowing for us to be as diverse as the patients and communities we serve. Together, we continue to build a culture that encourages, supports and empowers our employees.
Disability Inclusion
Our mission is unleashing the power of all our people and we are proud to be a disability inclusive employer, ensuring equal employment opportunities for all candidates. We encourage you to put your best self forward with the knowledge and trust that we will make any reasonable adjustments to support your application and future career. Your journey with Pfizer starts here!
Pfizer endeavors to make www.pfizer.com/careers accessible to all users. If you would like to contact us regarding the accessibility of our website or need assistance completing the application process and/or interviewing, please email [email protected]. This is to be used solely for accommodation requests with respect to the accessibility of our website, online application process and/or interviewing. Requests for any other reason will not be returned.
To learn more about acceptable and prohibited uses of AI during the recruitment process, please review our candidate AI-use guidelines available on Pfizer Careers .
Information & Business Tech
#BI-Hybrid

Skills Required

  • Bachelor's degree in a technical field or equivalent practical experience
  • At least 4 years of experience in software, data, or ML/AI engineering
  • Hands-on delivery of LLM or agent-based applications in production
  • Prompt and context engineering experience
  • Experience building structured AI evaluations, including ground-truth datasets, metrics, and regression testing
  • Working knowledge of agent frameworks, RAG, knowledge-base design, and Python
  • IT operations literacy for designing realistic operational workflows and evaluating agent output
  • Strong analytical and communication skills
  • Experience working in an agile environment with collaboration, adaptability, and proactive problem-solving
  • Experience with LLM-as-judge evaluation
  • Familiarity with ServiceNow, Dynatrace, or observability data

What the Team is Saying

Daniel
Anna
Esteban
Pfizer

Pfizer Compensation & Benefits Highlights

  • Healthcare Strength Health coverage is described as comprehensive, spanning medical, dental, vision, and robust mental‑health benefits, with eligible Pfizer medications available at no cost in U.S. plans. Family‑building support and transgender‑inclusive care are explicitly included, alongside wellbeing resources such as a reimbursement wallet and telehealth options.
  • Retirement Support Retirement programs feature a 401(k) with company matching plus an additional Retirement Savings Contribution, complemented by company‑subsidized life, short‑term disability, and long‑term disability insurance. Materials also reference subsidized retiree medical coverage for eligible groups.
  • Leave & Time Off Breadth Paid vacation, holidays, personal days, and paid parental and caregiver leave are consistently highlighted in current U.S. summaries and job postings. Options like buying extra vacation days and transition‑back support strengthen the time‑off offering.

Pfizer Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: New York, NY
121,990 Employees
Year Founded: 1848

What We Do

Our purpose ensures that patients remain at the center of all we do. We live our purpose by sourcing the best science in the world; partnering with others in the healthcare system to improve access to our medicines; using digital technologies to enhance our drug discovery and development, as well as patient outcomes; and leading the conversation to advocate for pro-innovation/pro-patient policies.

Why Work With Us

We are the inventors, the problem solvers, the big thinkers — those who surmount any hurdle to deliver breakthrough medicines to the people who are counting on them the most.

Gallery

Gallery
Gallery
Gallery
Gallery
Gallery

Pfizer Offices

Hybrid Workspace

Employees engage in a combination of remote and on-site work.

Typical time on-site: 2.5 days a week
Company Office Image
HQHudson Yards
Provincia de Buenos Aires
Andover, MA
Athens, GR
Chennai, IN
Collegeville, PA
Durham, NC
Groton, CT
Madison, NJ
Madrid, ES
Mumbai, Maharashtra
Rochester, MI
San Diego, CA
Seattle, WA
Company Office Image
Tampa, FL
Center for Digital Innovation
Learn more

Similar Jobs

Pfizer Logo Pfizer

Site Reliability Engineer

Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
Hybrid
Chortiatis, GRC
121990 Employees

Pfizer Logo Pfizer

Sr. Associate Payroll and Time & Attendance EMEA (12 months fixed term)

Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
Hybrid
Chortiatis, GRC
121990 Employees

Pfizer Logo Pfizer

Site Reliability Engineer

Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
Hybrid
Chortiatis, GRC
121990 Employees

Pfizer Logo Pfizer

Site Reliability Engineer

Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
Hybrid
Chortiatis, GRC
121990 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account