QA Automation Engineer (MLOps)

At Motorola Solutions, we believe that everything starts with our people. We’re a global close-knit community, united by the relentless pursuit to help keep people safer everywhere. We build and connect technologies to help protect people, property and places. Our solutions foster the collaboration that’s critical for safer communities, safer schools, safer hospitals, safer businesses, and ultimately, safer nations. Connect with a career that matters, and help us build a safer future.

We are looking for a driven AI/CV QA Automation Engineer to take ownership of our automated evaluation and testing framework for our core Video Analytics Engine. In this role, you will design automated evaluation infrastructure, benchmark Computer Vision model performance, and optimize end-to-end testing execution time down to 3–4 minutes per cycle. You will collaborate closely with R&D, Platform, and System Architecture teams to ensure high stability and continuous release quality.

Key Responsibilities

• Infrastructure & Optimization: Build, maintain, and optimize automated evaluation pipelines for AI/CV models and core video analytics libraries to achieve rapid, end-to-end test execution times (target: 3–4 minutes).

• Automation & CI/CD Integration: Develop Python automation test suites and integrate evaluation workflows directly into CI/CD pipelines for automated testing on Pull Requests (PRs).

• Metrics & Analytics: Measure and report model accuracy metrics (mAP, Precision, Recall, IoU) and system performance metrics (FPS, Latency, CPU/GPU/Memory utilization).

• Dataset Management: Manage, curate, and maintain golden datasets and annotation standards for regression, performance, and stress testing.

• Cross-functional Collaboration: Work with Core C++ and Architecture teams to identify pipeline bottlenecks, isolate root causes, and drive continuous release pipeline improvements.

• Bachelor/Master Degree in Software Engineer, Computer Science, Machine Learning or any relevant Field

• 3+ years of experience in QA Automation, MLOps, Software Engineer in Test (SET), or AI/CV Evaluation.

• Strong proficiency in Python for test framework development and data processing.

• Hands-on experience with Docker containerization and CI/CD tools (Jenkins, GitLab CI, GitHub Actions).

• Solid understanding of Machine Learning and Computer Vision evaluation metrics.

• Proficient in Linux environments and Bash/Shell scripting.

• Strong problem-solving skills with a focus on performance and execution speed.

Nice to Have

• Ability to read and understand basic C/C++ code.

• Familiarity with video streaming concepts and processing frameworks (e.g., GStreamer).

• Prior experience with Edge AI, Smart Cameras, or Embedded Vision systems.

EEO Statement

Motorola Solutions is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion or belief, sex, sexual orientation, gender identity, national origin, disability, veteran status or any other legally-protected characteristic. 

We are proud of our people-first and community-focused culture, empowering every Motorolan to be their most authentic self and to do their best work to deliver on the promise of a safer world. If you’d like to join our team but feel that you don’t quite meet all of the preferred skills, we’d still love to hear why you think you’d be a great addition to our team.