Test Automation Engineer III

Posted 2 Days Ago
Be an Early Applicant
2 Locations
In-Office
Senior level
Software
The Role
Designs and deploys AI-enabled platform capabilities, integrating LLMs, prompt engineering, RAG, embeddings, and intelligent workflows. Builds AI evaluation and validation frameworks alongside scalable QA automation for APIs, microservices, distributed systems, and platform services. Integrates automated testing into CI/CD pipelines, validates reliability and performance, and collaborates with engineering, product, data, and platform teams. Provides technical leadership on AI engineering, automation, and quality standards.
Summary Generated by Built In
For nearly 40 years, PDI has helped convenience retailers and petroleum wholesalers adapt to changes in the industry by leveraging the latest technologies. Simplifying the complexity in your world is our main focus. That's why we're delivering an integrated portfolio of global, cloud based solutions and services to meet our customers needs today and well into the future. From the back office to fuel logistics, and the latest wave of consumer demands and digital commerce, PDI solutions and services are designed to give you a competitive edge. Our deep domain knowledge is backed by our industry-specific software offerings and a people-first approach. Serving the entire supply chain means that we’ve had to solve a wide range of industry challenges and deliver measurable value. To address the increasingly dynamic convenience retail and petroleum wholesale industry, PDI leads the way with converged digital, cloud-optimized, secure, and scalable solutions including ERP, Loyalty, Fuel Pricing, Point-of-Sale and Logistics to create a broader industry ecosystem. The result is unparalleled insights, simplified operations, and higher profitability for your employees and business. We’re dedicated to helping our more than 1,500 customers in over 50 countries, providing solutions and services to over 200,000 sites.

Job Responsibilities:

  • AI Platform Architecture & Implementation: Design, build, and deploy intelligent AI-driven platform capabilities that enable automation, intelligent insights, and advanced decision-making across distributed services and data systems.
  • Product Innovation: Drive the development of next-generation AI-enabled platform features that enhance operational efficiency, enable intelligent automation, and deliver scalable, high-performance digital experiences.
  • Generative AI Integration: Seamlessly integrate generative AI capabilities into platform services, including prompt engineering, Retrieval-Augmented Generation (RAG), intelligent workflows, and contextual reasoning systems.
  • Intelligent System Leverage: Utilize Large Language Models (LLMs), embeddings, and vector-based retrieval systems to build intelligent, context-aware solutions that enhance platform capabilities and automation.
  • AI Quality & Evaluation: Develop frameworks and methodologies for validating AI system performance, including response accuracy, model reliability, safety evaluation, and output consistency.
  • AI Testing & Validation: Design and implement automated validation strategies to ensure reliability and correctness of AI-driven features, including automated test generation, model evaluation, and workflow validation.
  • QA Automation Engineering: Develop and maintain scalable automation frameworks for validating platform services, APIs, and AI-enabled capabilities using modern testing tools and frameworks.
  • API & Integration Testing: Build automated test suites to validate API functionality, service integrations, and distributed system interactions to ensure reliability and performance.
  • Continuous Testing & CI/CD Integration: Integrate automated testing into CI/CD pipelines to enable continuous testing, faster feedback loops, and high-quality releases.
  • Cross-Functional Collaboration: Work closely with engineering, product, data, and platform teams to translate complex requirements into scalable AI-enabled solutions while maintaining high-quality engineering standards.
  • Technical Leadership: Provide guidance on AI engineering practices, automation strategies, and quality engineering standards to support platform reliability and intelligent system development.
  • Mission Alignment: Contribute to building innovative, reliable, and ethically developed AI-powered systems that improve automation, developer productivity, and data-driven decision-making.

Qualifications:

  • Experience: 8+ years of experience in software engineering, quality engineering, or platform engineering, including experience building automation frameworks and AI-enabled systems.
  • Generative AI & LLM Integration: Hands-on experience integrating Large Language Models (LLMs) into applications, including prompt engineering, RAG architectures, AI workflow orchestration, and intelligent automation systems.
  • Automation Engineering Expertise: Strong experience designing and implementing test automation frameworks using tools such as Playwright, Selenium, Cypress, TestNG, JUnit, or similar technologies.
  • API Testing & Integration: Experience building automated tests for RESTful APIs and microservices using tools such as Postman, REST Assured, or similar frameworks.
  • Programming Proficiency: Strong programming skills in at least two of the following languages: Python, Java, JavaScript, or C#.
  • Cloud Platform Experience: Experience building and deploying applications on major cloud platforms such as AWS, GCP, or Azure, including containerized environments and CI/CD pipelines.
  • Data & AI Technologies: Familiarity with vector databases, embeddings, AI model evaluation techniques, and data pipelines that support intelligent applications.
  • System Reliability & Quality: Experience ensuring system reliability through automated testing, continuous integration, performance validation, and platform monitoring.
  • DevOps & CI/CD: Experience integrating automated testing and validation frameworks within CI/CD pipelines for scalable platform delivery.
  • Soft Skills: Strong communication and collaboration skills with the ability to work across engineering, product, and platform teams to deliver intelligent, production-ready solutions.

Behavioral Competencies:

  • Cultivates Innovation
  • Decision Quality
  • Manages Complexity
  • Drives Results
  • Business Insight 

PDI is committed to offering a well-rounded benefits program, designed to support and care for you, and your family throughout your life and career.  This includes a competitive salary, market-competitive benefits, and a quarterly perks program. We encourage a good work-life balance with ample time off [time away] and, where appropriate, hybrid working arrangements.  Employees have access to continuous learning, professional certifications, and leadership development opportunities. Our global culture fosters diversity, inclusion, and values authenticity, trust, curiosity, and diversity of thought, ensuring a supportive environment for all.

Skills Required

  • 8+ years of experience in software engineering, quality engineering, or platform engineering
  • Experience building automation frameworks and AI-enabled systems
  • Hands-on experience integrating LLMs into applications
  • Experience with prompt engineering, RAG architectures, AI workflow orchestration, and intelligent automation systems
  • Experience designing and implementing test automation frameworks using Playwright, Selenium, Cypress, TestNG, JUnit, or similar technologies
  • Experience building automated tests for RESTful APIs and microservices using Postman, REST Assured, or similar frameworks
  • Strong programming skills in at least two of Python, Java, JavaScript, or C#
  • Experience building and deploying applications on AWS, GCP, or Azure
  • Experience with containerized environments and CI/CD pipelines
  • Familiarity with vector databases, embeddings, AI model evaluation techniques, and supporting data pipelines
  • Experience ensuring system reliability through automated testing, continuous integration, performance validation, and platform monitoring
  • Strong communication and collaboration skills across engineering, product, and platform teams
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Alpharetta, GA
1,905 Employees

What We Do

PDI Technologies resides at the intersection of productivity and sales growth, delivering powerful solutions that serve as the backbone of the convenience retail and petroleum wholesale ecosystem. By “Connecting Convenience” across the globe, we empower businesses to increase productivity, make more informed decisions, and engage faster with their customers. www.pditechnologies.com

Similar Jobs

Mondelēz International Logo Mondelēz International

Platform Engineer

Big Data • Food • Hardware • Machine Learning • Retail • Automation • Manufacturing
Remote or Hybrid
India
90000 Employees

JPMorganChase Logo JPMorganChase

Data Scientist

Financial Services
Remote or Hybrid
2 Locations
289097 Employees

Toast Logo Toast

Senior Software Engineer – (Java Full Stack)

Cloud • Fintech • Food • Information Technology • Software • Hospitality
In-Office
Chennai, Tamil Nadu, IND
5000 Employees

Capco Logo Capco

Alteryx Developer

Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Remote or Hybrid
India
6000 Employees

Similar Companies Hiring

Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account