Sr. Technical Analyst, Agentic AI

At Johnson & Johnson, we believe health is everything. Our strength in healthcare innovation empowers us to build a world where complex diseases are prevented, treated, and cured, where treatments are smarter and less invasive, and solutions are personal. Through our expertise in Innovative Medicine and MedTech, we are uniquely positioned to innovate across the full spectrum of healthcare solutions today to deliver the breakthroughs of tomorrow, and profoundly impact health for humanity. Learn more at jnj.com

As guided by Our Credo, Johnson & Johnson is responsible to our employees who work with us throughout the world.  We provide an inclusive work environment where each person is considered as an individual.  At Johnson & Johnson, we respect the diversity and dignity of our employees and recognize their merit.

Job Function:

Technology Product & Platform Management

Job Sub Function:

Technical Product Management

Job Category:

Scientific/Technology

All Job Posting Locations:

Raritan, New Jersey, United States of America

Job Description:

We are searching for the best talent for a Sr. Technical Analyst, Agentic AI to be located in Raritan, NJ

MedTech R&D IT – Data and AI, Lead Analyst – Agentic AI (Document Generation & Cognitive Search)

Position Summary

We are seeking a Product Lead Analyst with deep expertise in agentic AI systems to drive the design, delivery, and continuous improvement of autonomous document-generation and cognitive-search platforms. This role operates at the intersection of product analysis, AI/ML solution delivery, and enterprise content workflows. The ideal candidate is an agentic AI expert who understands how to orchestrate large language models, retrieval-augmented generation pipelines, and multi-step reasoning agents to produce consistent, traceable, review-ready outputs at scale.

Agentic Document Generation

·         Own the product backlog and roadmap for agentic document-generation solutions that autonomously draft technical, regulatory, and compliance documents from source evidence

·         Design and refine reusable prompt templates, agent workflows, and orchestration logic that drive source-document ingestion, multi-step reasoning, and output composition with full section-level traceability

·         Define acceptance criteria ensuring generated drafts are consistent, citation-accurate, and traceable to source documents for human expert review and approval

·         Collaborate with domain stakeholders to onboard new document-generation use cases, validate output quality, and expand platform coverage

Agentic Cognitive Search

·         Own the product backlog for agentic cognitive-search platforms that go beyond keyword lookup – interpreting intent, reasoning across documents, and synthesizing cited answers

·         Define and validate natural-language query experiences where every statement in the synthesized answer is cited to its source document

·         Manage requirements for modular search capabilities including evidence retrieval, lifecycle intelligence, and domain-specific search agents

·         Ensure role-based access governance so synthesized answers respect the permissions held on underlying source documents

Product Analysis & Delivery Execution

·         Drive end-to-end delivery of agentic AI features including sprint planning, release readiness, and go/no-go criteria

·         Translate business requirements into user stories, detailed specifications, and acceptance criteria for engineering teams building agent pipelines

·         Coordinate cross-team dependencies, conduct change-impact analysis, and manage risk/milestone tracking across multiple agentic workstreams

AI/ML Platform Operations & Quality

·         Monitor output quality of AI-generated content and search answers; define feedback loops, guardrails, and continuous-improvement metrics

·         Support incident and problem management for agent orchestration, LLM performance, retrieval accuracy, and hallucination detection

·         Contribute to observability improvements including citation-accuracy scoring, traceability audits, prompt-performance benchmarking, and agent-step telemetry

Compliance & Governance

·         Ensure agentic AI outputs adhere to applicable quality-system, validation, and regulatory requirements

·         Maintain audit-ready traceability artifacts demonstrating every generated section is linked to its source evidence

·         Support responsible-AI practices including bias monitoring, content safety, and ethical use of generative models

Stakeholder Engagement & Expansion

·         Collaborate with business, regulatory, clinical, quality, and engineering teams to expand agentic platform adoption

·         Drive onboarding of new document-generation and cognitive-search use cases across business units

Technical Skills & Domain Knowledge

·         Agentic AI & Orchestration: Multi-agent frameworks (LangGraph, CrewAI, AutoGen, or equivalent), tool-use patterns, chain-of-thought reasoning, planning/reflection loops, agent memory and state management

·         LLM & NLP: Large Language Models (GPT, Claude, open-source), prompt engineering, fine-tuning, Retrieval-Augmented Generation (RAG), semantic chunking, embedding models

·         Search & Retrieval: Vector databases (Pinecone, Weaviate, OpenSearch), semantic search, hybrid search (BM25 + vector), re-ranking, knowledge graphs

·         Cloud & Infrastructure: AWS (Bedrock, S3, Lambda, Step Functions, SageMaker), or equivalent cloud AI services; API design and integration patterns

·         Document & Content Platforms: PLM systems (e.g., Windchill), document management, content extraction/parsing, regulatory submission workflows

·         Evaluation & Observability: LLM evaluation frameworks (RAGAS, DeepEval, or equivalent), tracing (LangSmith, Arize), hallucination detection, citation validation

Qualifications

Required:

·         5–8+ years in product/business analysis within technology, Life Sciences, or regulated environments

·         Demonstrable expertise in agentic AI systems – designing, deploying, or managing multi-step autonomous AI workflows

·         Hands-on experience with LLMs, RAG pipelines, prompt engineering, and at least one agentic framework (LangGraph, CrewAI, AutoGen, or equivalent)

·         Strong understanding of semantic search, vector databases, and retrieval strategies

·         Proven ability to translate complex AI/ML capabilities into clear business requirements, user stories, and acceptance criteria

·         Experience with AI evaluation and quality metrics (hallucination rate, citation accuracy, retrieval precision/recall)

Preferred:

·         Experience with document-generation or intelligent document processing (IDP) solutions

·         Familiarity with PLM systems, enterprise content management, or regulated document workflows

·         Background in AWS cloud services (Bedrock, SageMaker, Step Functions, Agentcore) or similar cloud AI platforms

·         Knowledge of responsible AI practices, model governance, and AI safety frameworks

·         Certification or training in AI/ML (AWS ML Specialty, Stanford AI courses, or equivalent)

Success Metrics (First 6–12 Months)

·         Successful onboarding of at least one new agentic document-generation use case with full traceability validation

·         On-time delivery of agentic AI features aligned to sprint cadence with zero critical-severity escapes

·         Measurable improvement in citation accuracy, retrieval precision, and document-quality scores for generated outputs

·         Positive stakeholder feedback on cognitive-search relevance and synthesized answer quality

·         Contribution to platform adoption growth and measurable reduction in manual document-authoring effort

#LI-Hybrid

#JNJTECH

Johnson & Johnson is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, age, national origin, disability, protected veteran status or other characteristics protected by federal, state or local law. We actively seek qualified candidates who are protected veterans and individuals with disabilities as defined under VEVRAA and Section 503 of the Rehabilitation Act. 

Johnson & Johnson is committed to providing an interview process that is inclusive of our applicants’ needs. If you are an individual with a disability and would like to request an accommodation, external applicants please contact us via https://www.jnj.com/contact-us/careers , internal employees contact AskGS to be directed to your accommodation resource.

Required Skills:

Preferred Skills:

Agile Product Development, Analytical Reasoning, Coaching, Collaboration, Competitive Landscape Analysis, Critical Thinking, Customer Alignment, Demand Forecasting, Human-Computer Interaction (HCI), Organizing, Product Development, Product Improvements, Product Strategies, Requirements Analysis, Research and Development, Software Development Life Cycle (SDLC), Software Development Management, Stakeholder Management, Technical Credibility, Technical Writing, Technologically Savvy

The anticipated base pay range for this position is :

$94,000 - $151,800

Additional Description for Pay Transparency:

Subject to the terms of their respective plans, employees and/or eligible dependents are eligible to participate in the following Company sponsored employee benefit programs: medical, dental, vision, life insurance, short- and long-term disability, business accident insurance, and group legal insurance. Subject to the terms of their respective plans, employees are eligible to participate in the Company’s consolidated retirement plan (pension) and savings plan (401(k)). Subject to the terms of their respective policies and date of hire, Employees are eligible for the following time off benefits: Vacation –120 hours per calendar year Sick time - 40 hours per calendar year; for employees who reside in the State of Washington –56 hours per calendar year Holiday pay, including Floating Holidays –13 days per calendar year Work, Personal and Family Time - up to 40 hours per calendar year Parental Leave – 480 hours within one year of the birth/adoption/foster care of a child Condolence Leave – 30 days for an immediate family member: 5 days for an extended family member Caregiver Leave – 10 days Volunteer Leave – 4 days Military Spouse Time-Off – 80 hours Additional information can be found through the link below. https://www.careers.jnj.com/employee-benefits