Senior Quality Engineer (Performance Testing)

At Lilly, we unite caring with discovery to make life better for people around the world. We are a global healthcare leader headquartered in Indianapolis, Indiana. Our employees around the world work to discover and bring life-changing medicines to those who need them, improve the understanding and management of disease, and give back to our communities through philanthropy and volunteerism. We give our best effort to our work, and we put people first. We’re looking for people who are determined to make life better for people around the world.

Lilly’s Purpose:

At Lilly, we unite caring with discovery to make life better for people around the world. We are a global healthcare leader headquartered in Indianapolis, Indiana. Our 42,000+ employees around the world work to discover and bring life-changing medicines to those who need them, improve the understanding and management of disease, and give back to our communities through philanthropy and volunteerism. We give our best effort to our work, and we put people first. We’re looking for people who are determined to make life better for people around the world.

Come build advanced software capabilities to accelerate our digital transformation and support Lilly’s evolution to be the leader in Pharma-tech!

The Role:

The Software Product Engineering (SPE) organization is actively seeking a motivated Senior Quality Engineer with strong experience in Performance Testing (JMeter) and API Testing. The ideal candidate is passionate about ensuring high product quality through performance analysis, robust API validations, and solid quality engineering practices. Experience in test automation using Selenium, Cypress, Playwright, or similar tools is highly desirable as a secondary skill set.

What You’ll Be Doing:

In this role, your primary responsibility is to drive performance and API testing strategies for digital health and patient-facing applications. You will ensure applications meet enterprise standards through comprehensive load testing, stress testing, and API validations. You will also support test automation as needed, working closely with development teams and integrating testing with CI/CD pipelines.

This role requires strong analytical and technical skills, hands-on experience in performance testing tools, API test automation, and a collaborative mindset to work across QA, DevOps, and engineering teams.

Key Responsibilities:

• Performance & API Testing (Primary Focus):

  • Design and execute performance testing strategies using JMeter to assess system scalability and reliability.

  • Conduct detailed API testing and automation using tools like Postman, REST Assured, and GraphQL.

  • Analyze test results, identify bottlenecks, and collaborate with development and SRE teams for remediation.

  • Partner with Site Reliability Engineering (SRE) teams to adapt quality strategy based on production insights.

• Test Automation & Engineering Excellence (Secondary Focus):

  • Design, develop, and maintain test automation scripts using Selenium, Cypress, Playwright, or similar tools.

  • Support UI and functional test automation across web and mobile applications.

  • Participate in improving and maintaining test automation frameworks and DevOps test pipelines.

• Agile & DevOps Collaboration:

  • Participate in Agile ceremonies and CI/CD test pipeline contributions.

  • Ensure automated tests run in deployment workflows and provide continuous feedback.

• Mentorship & Teamwork:

  • Guide and support junior QA team members in performance and API testing best practices.

  • Collaborate with cross-functional teams, including software engineers, product owners, and DevOps.

Required Technical Skills & Qualifications:

• Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field

• 6+ years of Quality Engineering experience

• Proven hands-on experience in Performance Testing using JMeter

• Exposure to monitoring/logging tools (e.g., AppDynamics, Grafana, Prometheus, Splunk, Elastic Stack) for end-to-end performance visibility.

• Experience in server side, transaction and I/O level performance testing.

• Analyse test results, monitor key performance metrics, pinpoint performance bottlenecks and tuning points.

• Analyze usage patterns/launch archetypes, and refine strategies accordingly.

• Provide actionable recommendations to development teams and Site Reliability Engineers (SRE) to improve application scalability and performance in software architectures.

• Experience working in cloud-based test environments (e.g., AWS, Kubernetes, Docker)

• Strong API testing experience using Postman, REST Assured, or GraphQL

• Familiarity with CI/CD integration using tools like GitHub, Jenkins, and Azure DevOps

• Programming/scripting experience in JavaScript, TypeScript, or Python

• Working knowledge of Agile methodology and QA best practices

Preferred Qualifications:

• Experience in web/mobile test automation using Selenium, Cypress, or Playwright

• Exposure to AI-based testing strategies and LLM evaluation

• Experience with security testing tools and techniques

• Familiarity with OpenAI, Bedrock, Anthropic, and RAG (Retrieval-Augmented Generation) models

• Prior experience in digital health or life sciences domain

Lilly is dedicated to helping individuals with disabilities to actively engage in the workforce, ensuring equal opportunities when vying for positions. If you require accommodation to submit a resume for a position at Lilly, please complete the accommodation request form (https://careers.lilly.com/us/en/workplace-accommodation) for further assistance. Please note this is for individuals to request an accommodation as part of the application process and any other correspondence will not receive a response.

Lilly does not discriminate on the basis of age, race, color, religion, gender, sexual orientation, gender identity, gender expression, national origin, protected veteran status, disability or any other legally protected status.

#WeAreLilly