Introduction: A Career at HARMAN Corporate
We’re a global, multi-disciplinary team that’s putting the innovative power of technology to work and transforming tomorrow. At HARMAN Corporate, you are integral to our company’s award-winning success.
Enrich your managerial and organizational talents – from finance, quality, and supply chain to human resources, IT, sales, and strategy
Augment your comprehensive skillset with expert training across decision-making, change management, leadership, and business development
Obtain 360-degree support throughout your career life cycle, from early-stage to seasoned leader
About the Role
We are looking for an AI Test Engineer to assure the quality, safety, and reliability of AI-enabled software used in connected product experiences. You will work at the intersection of AI application quality, automated testing, APIs, cloud and edge services, and connected devices. This is a hands-on role for a specialist who can turn ambiguous product behavior into precise, repeatable evaluation scenarios and clear engineering feedback. You are an active and thoughtful user of modern generative AI tools. You understand their capabilities and limitations and use tools such as ChatGPT, OpenAI Codex, GitHub Copilot, or comparable solutions to accelerate test design, automation, debugging, analysis, and documentation - while critically validating their output.
You will collaborate with software, machine learning, UX, hardware and product teams to validate AI-driven user journeys from prompt or voice input through orchestration, tools, services, and device responses. Your work will make prototypes and product demonstrations reproducible, observable, and ready for release decisions.
What You Will Do
Lead end-to-end quality engineering for AI-enabled applications, including conversational and agentic workflows, model integrations, orchestration layers, APIs, user interfaces, and connected-device experiences.
Design and execute structured evaluations for LLM and agent-based behavior: functional correctness, instruction following, tool use, grounding, safety boundaries, consistency, failure handling, and regression risk.
Prototype, build and maintain automated test solutions, including reusable test data, evaluation datasets, test harnesses, API collections and release-validation pipelines.
Translate product requirements and real user journeys into deterministic and exploratory test scenarios, acceptance criteria and measurable quality signals.
Validate multi-turn and multimodal interaction flows, including speech or text input, device controls, audio or media-related features and context-aware personalization when applicable.
Test REST APIs and distributed services, including request/response contracts, schemas, authentication, error handling, backward compatibility, telemetry and observability.
Investigate defects using logs, traces, test results and system behavior; isolate root causes, create high-quality defect reports and verify fixes.
Review code changes and collaborate with developers on testability, unit-test coverage, CI quality gates and practical release criteria.
Prepare and validate integrated software-and-device environments across Linux, Windows, mobile platforms, cloud services, local services and networked hardware.
Communicate quality risk, test evidence, known limitations and release readiness clearly to technical and non-technical stakeholders.
Apply AI-assisted engineering tools in your daily work to generate and refine test scenarios, accelerate automation, analyze failures, explore edge cases and improve technical documentation. Critically review and validate all AI-generated output.
What You Need to Be Successful
Bachelor’s or Master’s degree in Computer Science, Software Engineering, Electrical Engineering or a related technical field.
5+ years of hands-on experience in software quality engineering, test automation, systems integration or software validation.
Demonstrable experience testing AI-enabled software products, such as LLM applications, conversational systems, agentic workflows, recommendation systems or ML-powered features. General manual-software-testing experience alone is not sufficient.
Strong understanding of how to evaluate non-deterministic AI behavior and convert it into repeatable, evidence-based quality checks.
Hands-on experience with Python and automated testing frameworks; confidence reading and contributing to production-adjacent test code.
Practical experience with REST APIs, JSON, schema/contract validation and test automation for distributed services.
Experience with Git-based development, pull-request review, issue tracking, CI/CD and technical documentation.
Strong troubleshooting skills across application, service, network and device layers; comfortable working with logs, traces, and telemetry.
Experience using AI-assisted engineering tools responsibly to improve test design, automation, debugging and documentation.
Ability to communicate defects and quality trade-offs precisely, work independently and operate effectively when requirements evolve.
Bonus Points if You Have
Experience with LLM evaluation frameworks, prompt testing, retrieval-augmented generation, tool/function calling, agents, or model-provider integration.
Experience validating AI features in embedded, automotive, consumer-electronics, audio, mobile, or other connected-device environments.
Experience with speech interfaces, text-to-speech, speech recognition, audio or media controls, personalization, or multimodal user experiences.
Experience with cloud platforms and local/edge deployment, containers, service observability and test-environment management.
Experience with JavaScript or TypeScript, Bash, mobile-app testing, or hardware-in-the-loop/system-integration testing.
What Success Looks Like
AI-enabled user experiences are evaluated systematically before demos and releases, with clear evidence for expected and edge-case behavior.
High-risk regressions in model behavior, prompt logic, orchestration, APIs and device integration are detected early.
Test automation and evaluation assets become reusable, maintainable and part of delivery workflows.
Engineering teams have an accurate, actionable view of quality risks, release readiness and known limitations.
What Makes You Eligible
You have strong written and verbal communication skills in English.
You can work at the Garching, Germany location.
What We Offer
Flexible work environment with a culture encouraging work-life integration and collaboration in a global environment.
Access to employee discounts on world-class HARMAN/Samsung products (JBL, Harman Kardon, AKG etc.).
Extensive training opportunities through our own HARMAN University.
An inclusive and diverse work environment that fosters and encourages professional and personal development
“Be Brilliant” employee recognition and rewards program.
Work on best-in-class emerging technologies and an atmosphere that motivates you to give your best.
#LI-Hybrid
#LI-AJ1
HARMAN is proud to be an Equal Opportunity / Affirmative Action employer. All qualified applicants will receive consideration for employment without regard to race, religion, color, national origin, gender (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics.
Skills Required
- Bachelor's or Master's degree in Computer Science, Software Engineering, Electrical Engineering or related technical field
- 5+ years hands-on experience in software quality engineering, test automation, systems integration or software validation
- Demonstrable experience testing AI-enabled software products (LLM applications, conversational systems, agentic workflows, recommendation systems or ML-powered features)
- Strong understanding of evaluating non-deterministic AI behavior and converting it into repeatable, evidence-based quality checks
- Hands-on experience with Python and automated testing frameworks; able to read and contribute to test code
- Practical experience with REST APIs, JSON, schema/contract validation and test automation for distributed services
- Experience with Git-based development, pull-request review, issue tracking, CI/CD and technical documentation
- Strong troubleshooting skills across application, service, network and device layers; experience with logs, traces and telemetry
- Experience using AI-assisted engineering tools responsibly to improve test design, automation, debugging and documentation
- Strong written and verbal communication skills in English
- Ability to work at the Garching, Germany location
- Experience with LLM evaluation frameworks, prompt testing, RAG, tool/function calling, or model-provider integration
- Experience validating AI features in embedded, automotive, consumer-electronics, audio, mobile, or connected-device environments
- Experience with speech interfaces, text-to-speech, speech recognition, audio or media controls, personalization, or multimodal UX
- Experience with cloud platforms, local/edge deployment, containers, service observability and test-environment management
- Experience with JavaScript or TypeScript, Bash, mobile-app testing, or hardware-in-the-loop/system-integration testing
Harman Compensation & Benefits Highlights
The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Harman and has not been reviewed or approved by Harman.
-
Healthcare Strength — Healthcare coverage is described as comprehensive, often including medical, dental, and vision plans, with HSAs/FSAs and disability or life insurance also referenced. Wellbeing support such as EAP access and onsite occupational health services is also part of the package in some regions.
-
Wellbeing & Lifestyle Benefits — Lifestyle-oriented benefits include employee product discounts and region-specific perks like free fruit deliveries, Cycle to Work schemes, and meal coupons or allowances. Flexible schedules and work-from-home options are also part of the overall offering where roles and projects allow.
-
Fair & Transparent Compensation — Pay is repeatedly characterized as solid or market-aligned for many roles, with salary payments described as consistent and on time. Compensation is also tied to performance in some accounts, reinforcing a perception of basic fairness for a portion of employees.
Harman Insights
What We Do
Headquartered in Stamford, Connecticut, HARMAN (harman.com) designs and engineers connected products and solutions for automakers, consumers, and enterprises worldwide, including connected car systems, audio and visual products, enterprise automation solutions; and services supporting the Internet of Things. With leading brands including AKG®, Harman Kardon®, Infinity®, JBL®, Lexicon®, Mark Levinson® and Revel®, HARMAN is admired by audiophiles, musicians and the entertainment venues where they perform around the world. More than 50 million automobiles on the road today are equipped with HARMAN audio and connected car systems. Our software services power billions of mobile devices and systems that are connected, integrated and secure across all platforms, from work and home to car and mobile. HARMAN has a workforce of approximately 30,000 people across the Americas, Europe, and Asia. In March 2017, HARMAN became a wholly-owned subsidiary of Samsung Electronics Co., Ltd. HARMAN is an Equal Opportunity, Affirmative Action employer. Minorities, women, veterans and individuals with disabilities are encouraged to apply. HARMAN offers a great work environment, challenging career opportunities, professional training and competitive compensation. Looking for a challenge where your experience is valued? Come see what you can achieve as a leader with HARMAN!
