At Johnson & Johnson, we believe health is everything. Our strength in healthcare innovation empowers us to build a world where complex diseases are prevented, treated, and cured, where treatments are smarter and less invasive, and solutions are personal. Through our expertise in Innovative Medicine and MedTech, we are uniquely positioned to innovate across the full spectrum of healthcare solutions today to deliver the breakthroughs of tomorrow, and profoundly impact health for humanity. Learn more at jnj.com.
As guided by Our Credo, Johnson & Johnson is responsible to our employees who work with us throughout the world. We provide an inclusive work environment where each person is considered as an individual. At Johnson & Johnson, we respect the diversity and dignity of our employees and recognize their merit.
Job Function:
R&D Product DevelopmentJob Sub Function:
R&D Machine LearningJob Category:
Scientific/TechnologyAll Job Posting Locations:
Cornellà de Llobregat, Barcelona, Spain, Madrid, SpainJob Description:
Johnson & Johnson Innovative Medicine R&D Data Science and Digital Health is recruiting for a Senior Engineer – GenAI Quality Assurance. This role can be based in Madrid or Barcelona. Hybrid working.
J&J Innovative Medicine develops treatments that improve the health of people worldwide. Research and development areas encompass oncology, immunology, neuroscience, cardiopulmonary and specialty ophthalmology. Our goal is to help people live longer, healthier lives. We have produced and marketed many first-in-class prescription medications and are poised to serve the broad needs of the healthcare market – from patients to practitioners and from clinics to hospitals. To learn more about Johnson & Johnson Innovative Medicine visit https://innovativemedicine.jnj.com/
Description: We’re hiring a professional who specializes in designing, testing, and refining complex GenAI applications, primarily in scientific or ML-driven environments. You'll be responsible for validating, stress-testing, and improving Gen-AI powered products (pipelines and AI-assisted workflows) across the product lifecycle – from pre-deployment validation to post-release monitoring.
Key Responsibilities:
- Design and implement automated and manual QA strategies for GenAI systems
- Build regression tests, generate synthetic test data, build test harnesses and evaluation pipelines for accuracy, grounding, robustness, safety
- Validate prompt logic, model behavior and evaluation metrics
- Execute tests and debug pipelines
- Support deployment of GenAI products
- Lead system design reviews, advocating best practices for architecture and reliability of GenAI applications
- Collaborate closely with data scientists and developers to embed testing and quality checkpoints
- Establish testing standards and workflows for continuous integration and deployment
- Conduct code reviews with a focus on design, testability, and maintainability
- Document system design decisions, test cases, and best practices
- Close collaboration with domain experts and stakeholders to validate developed solutions
Technical Skills & Experience Needed:
- Strong software engineering background with QA ownership
- Familiarity with RAG & Graph frameworks
- 3+ years of experience as a software engineer (preferably 5), or QA engineer in production systems, preferably including at least 1 year experience in GenAI systems
- Advanced Python skills
- Experience working with LLM-based systems in real environments
- Hands-on experience with:
- LLM APIs
- AWS Bedrock (Anthropic & OSS)
- Azure Foundry (OpenAI)
- GCP (Gemini)
- Cloud platforms (AWS, Azure, GCP)
- Proven ability to implement test frameworks for GenAI applications
- Knowledge of API testing, data validation, and data pipeline testing
- Experience with version control (Git)
- Experience with building and deploying AI/ML products through the full product lifecycle
- Good understanding of scientific computing and ML frameworks
- Solid understanding of safety, bias, and failure modes of GenAI systems
- Comfortable working in a relatively fast-moving environment where priorities may shift and initiative is valued
- Proactive problem-solver who can anticipate needs and find solutions
- Comfortable working independently, but also a strong team player
Nice-to-Have:
- Experience with Jenkins, Sonarqube
- Monitoring and observability tools (Prometheus, Grafana etc)
- Devops experience (docker, jenkins)
- Experience deploying GenAI services to production at scale
- Exposure to ML Ops or production ML systems
#LI-GR
#LI-Hybrid
#JRDDS
#JNJDataScience
#JRD
Required Skills:
Large Language Models (LLMs), Microsoft Azure AI foundry, OpenAI, Python (Programming Language), Software Quality Assurance (SQA)Preferred Skills:
Artificial Intelligence (AI), Coaching, Cognitive Computing, Critical Thinking, Cross-Functional Collaboration, Curious Mindset, Data Structures, Distributed Computing, Emerging Technologies, Human-Computer Relationships, Machine Learning (ML), Persistence and Tenacity, Program Management, Research and Development, SAP Product Lifecycle Management, Scripting Languages, Technologically SavvySkills Required
- Strong software engineering background with QA ownership
- Familiarity with RAG and Graph frameworks
- 3+ years as a software or QA engineer (preferably 5), including >=1 year with GenAI systems
- Advanced Python skills
- Experience working with LLM-based systems and LLM APIs (Azure Foundry, OpenAI, AWS Bedrock, GCP Gemini, Anthropic)
- Hands-on experience with cloud platforms (AWS, Azure, GCP)
- Proven ability to implement test frameworks for GenAI applications (regression tests, synthetic data, evaluation pipelines)
- Knowledge of API testing, data validation, and data pipeline testing
- Experience with version control (Git)
- Understanding of scientific computing, ML frameworks, and GenAI safety, bias, and failure modes
- Experience with Jenkins and SonarQube
- Experience with monitoring/observability (Prometheus, Grafana), Docker, DevOps, and MLOps
Johnson & Johnson Compensation & Benefits Highlights
The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Johnson & Johnson and has not been reviewed or approved by Johnson & Johnson.
-
Healthcare Strength — Healthcare coverage is characterized as comprehensive across medical, dental, and vision, with added supports like onsite clinics, fitness centers, and Employee Assistance resources. Mental-health services and wellbeing reimbursements are also described as meaningful components of the overall package.
-
Retirement Support — Retirement offerings are portrayed as a major differentiator, combining a 401(k) with employer matching and an employer-funded pension plan. Stock options and other long-term financial supports are also positioned as part of the broader rewards mix.
-
Parental & Family Support — Family-related benefits are presented as notably strong, including paid parental leave for all new parents and additional leave types for caregiving and bereavement. Financial assistance for adoption, fertility treatment, and surrogacy is highlighted as a significant support.
Johnson & Johnson Insights
What We Do
Profound Change Requires Boldness. Johnson & Johnson is the largest and most broadly based healthcare company in the world. We’re producing life-changing breakthroughs every day, and have been for the last 130 years. The combination of new technologies and your expertise enables amazing things to happen. Teams from J&J’s consumer business are creating digital tools to help people track the health of their skin. Those working in medical devices are 3-D printing artificial joints personalized for each patient, while researchers in pharmaceuticals use AI to discover lifesaving drugs. Imagine what the rest of our team of 134,000 people at 260 companies in more than 60 countries across the world is accomplishing. We redefine what it means to be a big company in today’s world. Social Media Community Guidelines: http://www.jnj.com/social-media-community-guidelines
