Lead Data Quality Assurance Engineer, Data Annotation Services

Posted 16 Minutes Ago
Be an Early Applicant
Irving, TX, USA
Hybrid
128K-209K Annually
Senior level
Artificial Intelligence • Cloud • Internet of Things • Software • Cybersecurity • Industrial • Industrial Equipment
Cat Digital delivers digital and technology solutions that power Caterpillar's world-famous yellow iron.
The Role
Leads data quality strategy and a QA engineering team for annotation and captioning datasets supporting computer vision, robotics, autonomous systems, and Physical AI. Develops automated validation frameworks, quality metrics, dashboards, audits, and quality gates; evaluates human and AI-assisted labeling technologies; manages vendor quality; investigates multimodal camera and LiDAR data issues; and partners with ML, platform, product, and vendor teams to deliver trustworthy datasets.
Summary Generated by Built In
Career Area:
Technology, Digital and Data
Job Description:
Your Work Shapes the World at Caterpillar Inc.
When you join Caterpillar, you're joining a global team who cares not just about the work we do - but also about each other. We are the makers, problem solvers, and future world builders who are creating stronger, more sustainable communities. We don't just talk about progress and innovation here - we make it happen, with our customers, where we work and live. Together, we are building a better world, so we can all enjoy living in it.
Help Build the Future of Caterpillar
At Caterpillar, technology always has a purpose: solving our customers' toughest challenges. Through Cat Technology, we are building the intelligence layer that connects machines, data, and people to make jobsites safer, more productive, and more sustainable. With over 1.6 million connected assets generating real-world data daily, we are creating the foundation for AI, autonomy, edge computing, and intelligent machines that continuously learn and improve at global scale.
Be Part of What's Next in Autonomous Construction Sites
Construction autonomy is one of the most challenging applications of AI. As a Lead Data Quality Assurance Engineer, you will lead the quality strategy for training data powering robotics, computer vision, autonomous systems, Physical AI, and Vision-Language-Action (VLA) models. You will combine data quality engineering, test automation, and machine learning expertise to ensure the datasets used by Caterpillar's AI systems are accurate, scalable, and trustworthy while leading a small team of QA engineers and collaborating across engineering, annotation, and product teams.
Job Summary:
Lead the development and execution of quality assurance processes, standards, and automation frameworks for annotation and captioning datasets supporting robotics, autonomous driving, computer vision, and Physical AI initiatives. Drive continuous improvement of dataset quality by establishing metrics, evaluating AI-assisted labeling technologies, managing vendor quality, and implementing scalable validation solutions across the data lifecycle.
What You Will Do:
  • Lead the annotation quality strategy and roadmap, providing technical leadership and mentorship to a team of QA engineers while defining standards, guidelines, acceptance criteria, and governance processes for perception and VLA datasets.
  • Design and implement automated validation frameworks, testing methodologies, and quality gates that verify annotation accuracy, consistency, completeness, schema compliance, and sensor synchronization across multimodal datasets.
  • Define and monitor dataset quality metrics, dashboards, audits, and benchmarking processes to measure dataset health, identify root causes of labeling defects, and drive continuous quality improvements with internal teams and external annotation providers.
  • Evaluate and validate human, AI-assisted, and automated labeling solutions, including technologies such as NVIDIA Cosmos Curator and Cosmos Reason, while helping develop AI-driven QA capabilities and agentic workflows for scalable review and defect analysis.
  • Partner with machine learning, platform, product, and vendor teams to integrate quality processes into data pipelines, communicate risks and tradeoffs, and ensure trusted datasets are delivered to support AI model development.

What You Will Have:
  • Bachelor's degree in Computer Science, Software Engineering, Data Science, Artificial Intelligence, Robotics, or a related technical field.
  • 5+ years of experience in data quality engineering, annotation quality assurance, or test automation for computer vision, robotics, autonomous systems, Physical AI, or machine learning environments.
  • Experience leading small technical teams, providing mentorship, setting technical direction, and collaborating with external vendors or distributed teams.
  • Strong Python development skills with experience building automated validation frameworks, data quality tooling, and production-grade software using modern engineering practices and containerized environments.
  • Experience with annotation platforms (Labelbox, Supervisely, Roboflow, or similar), SQL, data analysis tools, and machine learning evaluation metrics such as precision, recall, IoU, F1, and mAP.
  • Experience validating perception datasets that include camera and LiDAR sensor data and investigating data quality issues across collection, annotation, and processing workflows.

Top Candidates Will Have:
  • Experience with computer vision, robotics, autonomous driving, multimodal AI, Physical AI, and 3D perception systems.
  • Experience evaluating AI-assisted annotation workflows, auto-labeling technologies, agentic AI systems, or LLM/VLM-based quality automation solutions.
  • Familiarity with ML frameworks and tooling such as PyTorch, TensorFlow, ONNX, MLflow, or Weights & Biases.
  • Experience with Vision-Language-Action (VLA) datasets, caption quality evaluation, sensor fusion, and autonomous machine data pipelines.
  • Experience building human-in-the-loop quality processes, managing annotation vendor performance, and working with cloud-based data platforms and MLOps environments.

Additional Details:
  • This position requires the candidate to work full-time onsite in Irving, TX (Dallas).
  • Domestic relocation assistance is available for this position.
  • Visa sponsorship is available for this position.

Summary Pay Range:
$128,470.00 - $208,770.00
Compensation and benefits offered may vary depending on multiple individualized factors, job level, market location, job-related knowledge, skills, individual performance and experience. Please note that salary is only one component of total compensation at Caterpillar.
Benefits:
Subject to plan eligibility, terms, and guidelines. This is a summary list of benefits.
  • Medical, dental, and vision benefits*
  • Paid time off plan (Vacation, Holidays, Volunteer, etc.)*
  • 401(k) savings plans*
  • Health Savings Account (HSA)*
  • Flexible Spending Accounts (FSAs)*
  • Health Lifestyle Programs*
  • Employee Assistance Program*
  • Voluntary Benefits and Employee Discounts*
  • Career Development*
  • Incentive bonus*
  • Disability benefits
  • Life Insurance
  • Parental leave
  • Adoption benefits
  • Tuition Reimbursement

* These benefits also apply to part-time employees
Posting Dates:
Any offer of employment is conditioned upon the successful completion of a drug screen.
Caterpillar is an Equal Opportunity Employer, Including Veterans and Individuals with Disabilities. Qualified applicants of any age are encouraged to apply.
Not ready to apply? Join our Talent Community.

Skills Required

  • Bachelor's degree in Computer Science, Software Engineering, Data Science, Artificial Intelligence, Robotics, or a related technical field
  • 5+ years of experience in data quality engineering, annotation quality assurance, or test automation for computer vision, robotics, autonomous systems, Physical AI, or machine learning environments
  • Experience leading small technical teams, mentoring, setting technical direction, and collaborating with external vendors or distributed teams
  • Strong Python development skills and experience building automated validation frameworks, data quality tooling, and production-grade software in containerized environments
  • Experience with annotation platforms such as Labelbox, Supervisely, Roboflow, or similar
  • Experience with SQL, data analysis tools, and machine learning evaluation metrics including precision, recall, IoU, F1, and mAP
  • Experience validating perception datasets containing camera and LiDAR sensor data and investigating quality issues across collection, annotation, and processing workflows
  • Experience with computer vision, robotics, autonomous driving, multimodal AI, Physical AI, and 3D perception systems
  • Experience evaluating AI-assisted annotation workflows, auto-labeling technologies, agentic AI systems, or LLM/VLM-based quality automation
  • Familiarity with PyTorch, TensorFlow, ONNX, MLflow, or Weights & Biases
  • Experience with Vision-Language-Action datasets, caption quality evaluation, sensor fusion, and autonomous machine data pipelines
  • Experience building human-in-the-loop quality processes, managing annotation vendor performance, and working with cloud-based data platforms and MLOps environments

What the Team is Saying

Pradeep
Christina
Chad
Madison
Rakshan
MacGregor
Stan

Caterpillar Compensation & Benefits Highlights

How does Caterpillar ensure its pay and bonus plans are competitive?

Caterpillar uses a compensation approach designed to align employee rewards with individual contributions, business performance, and the company's long-term success. Rather than focusing on a single element of pay, the company combines competitive salaries, performance-based incentive opportunities, retirement benefits, healthcare coverage, and other rewards into a broader compensation structure intended to attract and retain talent across engineering, manufacturing, technology, operations, and business functions. 

  • Compensation is benchmarked against the market: Caterpillar regularly evaluates pay levels using external market data and competitive benchmarking. The company reviews compensation practices across relevant industries and labor markets to help ensure employees are paid competitively for their role, experience, skills, and performance. This approach helps Caterpillar compete for talent while maintaining consistency across its global workforce.
  • Performance plays a meaningful role in compensation: A portion of employee compensation is tied to performance, creating a connection between results and rewards. Employees may have opportunities to earn annual incentive compensation based on a combination of individual performance, business results, and company performance. This means compensation can increase when employees and the organization perform well.
  • Bonus opportunities are connected to business success: Unlike organizations that rely primarily on fixed compensation, Caterpillar uses incentive programs that align employees with company outcomes. This structure encourages employees to think beyond individual goals and focus on broader business performance, customer success, operational excellence, and long-term growth.
  • Career progression can create earning opportunities over time: Because Caterpillar places significant emphasis on internal mobility, leadership development, and long-term career growth, compensation growth is often tied to increasing responsibility and advancement within the organization. Employees who take on larger roles, expand their expertise, or move into leadership positions may have opportunities for meaningful increases in compensation throughout their careers.
  • Retirement benefits are an important part of total compensation: Eligible employees have access to retirement savings programs that include a 401(k) plan with company matching contributions in the United States. For employees who build long-term careers at Caterpillar, retirement contributions can become a meaningful component of overall compensation and financial security.
  • The company's financial strength supports compensation stability: Caterpillar reported approximately $64.8 billion in sales and revenues in 2024, maintains investment-grade credit ratings, and has increased its annual dividend for more than 30 consecutive years. This financial strength helps support consistent compensation programs, annual incentive opportunities, and long-term investment in employees.
  • Compensation is supported by a broader benefits package: In addition to salary and bonus opportunities, Caterpillar provides healthcare coverage, retirement benefits, wellbeing resources, paid time off, employee assistance programs, professional development opportunities, and other benefits designed to support employees throughout different stages of their careers. These programs contribute to the overall value employees receive beyond their base pay.
  • External signals:
    • Compensation perception: Employees rate Caterpillar highly for compensation relative to industry peers. (Comparably)
    • Benefits perception: Employees rate Caterpillar's benefits favorably compared to peer industrial employers. (Comparably)
    • Employee advocacy: 77% of employees would recommend Caterpillar to a friend. (Glassdoor)
    • Employer recognition: Caterpillar has been recognized as one of Forbes' World's Best Employers.

Bottom line: Caterpillar's compensation structure combines competitive base pay, performance-based incentive opportunities, retirement benefits, and long-term career growth. Employees are rewarded not only through salary and annual bonuses, but also through advancement opportunities and benefits that can grow in value over the course of a career. For many employees, the appeal lies in the combination of performance-based rewards, financial stability, and the opportunity to build long-term earning potential within a global industrial leader. 

Caterpillar Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Irving, TX
100,000 Employees
Year Founded: 1925

What We Do

Cat Digital is the digital and technology arm of Caterpillar Inc., responsible for bringing digital capabilities to our world-famous yellow iron. With over 1.5M connected assets worldwide, our teams use data, technology, advanced analytics and AI capabilities to help solve our customers' toughest challenges.

Why Work With Us

At Cat Digital, we're accelerating Caterpillar's digital transformation to help customers solve their toughest challenges. Our teams use enterprise-wide data, emerging technologies, and customer insights to deliver solutions that drive real-world impact. Join us as we create innovative experiences that help customers succeed and power the world aro

Gallery

Gallery
Gallery
Gallery
Gallery
Gallery
Gallery
Gallery
Gallery
Gallery

Caterpillar Teams

Team
Engineering
Team
Data Science
Team
Intern
About our Teams

Caterpillar Offices

Hybrid Workspace

Employees engage in a combination of remote and on-site work.

Typical time on-site: Flexible
HQIrving, TX
India
Broomfield, CO
Chennai, IN
Chicago, IL
Geneva, CH
Košice, SK
Peoria, IL
Learn more

Similar Jobs

Caterpillar Logo Caterpillar

Autonomy Engineering Specialist

Artificial Intelligence • Cloud • Internet of Things • Software • Cybersecurity • Industrial • Industrial Equipment
Hybrid
Irving, TX, USA
100000 Employees
128K-209K Annually

Caterpillar Logo Caterpillar

Data Pipeline Autonomy Engineer

Artificial Intelligence • Cloud • Internet of Things • Software • Cybersecurity • Industrial • Industrial Equipment
Hybrid
Irving, TX, USA
100000 Employees
98K-158K Annually

Caterpillar Logo Caterpillar

Treasury Technology Specialist

Artificial Intelligence • Cloud • Internet of Things • Software • Cybersecurity • Industrial • Industrial Equipment
Hybrid
Irving, TX, USA
100000 Employees
113K-183K Annually

Caterpillar Logo Caterpillar

Principal Software Engineer

Artificial Intelligence • Cloud • Internet of Things • Software • Cybersecurity • Industrial • Industrial Equipment
Hybrid
Irving, TX, USA
100000 Employees
159K-259K Annually

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account