AI Automation Engineer, Data Annotation Services

Reposted 23 Days Ago
Irving, TX, USA
Hybrid
98K-158K Annually
Entry level
Artificial Intelligence • Cloud • Internet of Things • Software • Cybersecurity • Industrial • Industrial Equipment
Cat Digital delivers digital and technology solutions that power Caterpillar's world-famous yellow iron.
The Role
Develop and deploy AI-powered annotation, labeling, and captioning systems for robotics, computer vision, autonomy, and VLA datasets. Build data pipelines supporting human review, quality validation, and dataset publication; train and evaluate machine learning models; integrate Caterpillar systems with annotation providers; and ensure scalable, observable production services for heavy-equipment and construction environments.
Summary Generated by Built In
Career Area:
Technology, Digital and Data
Job Description:
Your Work Shapes the World at Caterpillar Inc.
When you join Caterpillar, you're joining a global team who cares not just about the work we do - but also about each other. We are the makers, problem solvers, and future world builders who are creating stronger, more sustainable communities. We don't just talk about progress and innovation here - we make it happen, with our customers, where we work and live. Together, we are building a better world, so we can all enjoy living in it.
Help Build the Future of Caterpillar -
At Caterpillar, technology always has a purpose, which is to solve our customers' toughest challenges. Through Cat Technology, we are solving problems by building the intelligence layer that connects machines, data, and people to make jobsites safer, more productive, and more sustainable. By combining deep domain expertise in physical systems with software, connectivity, autonomy, and AI, we deliver solutions that work in the real world-on real jobsites, at global scale.
You'll build and deploy against one of the most unique data foundations-over 1.6 million connected assets generating real-world data daily. These data and platform capabilities are enabling the development of AI models, edge computing architectures, and software systems that scale across fleets, products, and industries. The result will be a new generation of machines that continuously learn, improve, and deliver performance at scale.
Be Part of What's Next in Autonomous Construction Sites
Construction autonomy is one of the most complex challenges in applied AI, and at Caterpillar, advancements in physical AI, simulation, sensing, and edge computing are turning things that once felt impossible-intelligent machines operating in dynamic jobsites-into reality.
Our connected ecosystem brings together massive volumes of high-quality data to create a foundation where engineers like you can build and deploy against.
If this work motivates you, we invite you to join our team. In these roles, you'll work at the intersection of the physical and digital worlds. You'll help design and deliver intelligent systems that enable machines to perceive their environment, make informed decisions, and support safer, more productive operations.
Apply today to build the new era of construction autonomy at Caterpillar.
We are seeking an AI Automation Engineer to develop annotation automation solutions used to create training data for robotics, autonomy, computer vision, and Vision-Language-Action (VLA) systems with a scrum team.
This role combines software engineering, machine learning, and data engineering to build automated annotation and captioning capabilities for real-world heavy equipment and construction environments. You will help deploy and extend technologies such as NVIDIA Cosmos Curator and Cosmos Reason while also developing Caterpillar-specific AI models that enable automated labeling, automated captioning, and AI-driven quality assurance.
This is a hands-on technical role focused on turning complex AI and data challenges into scalable production solutions.
What You'll Do
  • Develop and deploy automated labeling and captioning solutions for perception and VLA datasets.
  • Train, fine-tune, and evaluate AI models to support auto-labeling, auto-captioning, and annotation quality automation.
  • Build data pipelines and workflows that move datasets through automated labeling, human review, quality validation, and dataset publication.
  • Implement and extend platforms such as NVIDIA Cosmos Curator, Cosmos Reason, and other emerging AI automation technologies.
  • Develop solutions that integrate Caterpillar data systems with external annotation providers and human-in-the-loop workflows.
  • Ensure reliability, scalability, observability, and operational excellence across annotation automation services.

What Makes This Role Unique
Most AI automation solutions are not trained to understand heavy equipment, jobsites, sensor data, or machine operations.
In this role, you'll help develop the AI capabilities needed to label and describe Caterpillar-specific data at scale. You'll work on challenges involving computer vision, multimodal AI, robotics, autonomy, and Vision-Language-Action systems while helping create the data foundation that powers the future of intelligent machines.
Basic Qualifications
  • Bachelor's degree in Computer Science, Software Engineering, Artificial Intelligence, Machine Learning, Robotics, or a related field.
  • Experience developing production-grade software solutions using Python, modern software engineering practices and containerization platforms (e.g. Docker, Kubernetes)
  • Experience designing and implementing distributed systems, APIs, and data processing pipelines.
  • Experience training, fine-tuning, or deploying machine learning models.
  • Strong problem-solving skills and ability to work across multiple technical disciplines.
  • Experience generating and managing camera and LiDAR sensor datasets for perception or machine learning applications, including data collection pipeline design and ground truth generation.
  • Experience in data annotation and quality assurance for autonomous systems or computer vision projects, with demonstrated ability to define annotation guidelines, identify labeling defects, and drive measurable improvements in dataset accuracy.
  • Experience using annotation and dataset management tools such as Labelbox, Supervisely, RoboFlow or similar toolchains.
  • Experience using machine learning frameworks and training tools such as PyTorch, TensorFlow, ONNX, Weights & Biases, MLflow or similar frameworks.

Preferred Qualifications
  • Experience with computer vision, robotics, autonomy, Physical AI, or multimodal AI systems.
  • Experience with AI-assisted annotation, auto-labeling, or machine learning data pipelines.
  • Experience training or fine-tuning foundation models, vision models, or multimodal models.
  • Experience with NVIDIA Cosmos Curator, Cosmos Reason, or similar AI automation platforms.
  • Experience with Vision-Language-Action (VLA) datasets and workflows.
  • Experience with sensor data such as cameras, LiDAR, radar, or autonomous machine datasets.
  • Experience with cloud platforms, MLOps, and machine learning deployment pipelines.
  • Experience building human-in-the-loop AI workflows and quality automation systems.

Additional Details:
  • This position requires the candidate to work full-time at the Irving, TX office (Dallas)
  • Domestic relocation assistance is available for this position.
  • Visa sponsorship is available with this position.

Why Caterpillar
You'll work on some of the most challenging applications of AI in the physical world, helping build systems that transform vast amounts of machine and sensor data into the intelligence that powers autonomous and AI-enabled equipment. If you're excited about applying AI to real-world machines operating in complex environments, we'd like to hear from you.
Summary Pay Range:
$97,530.00 - $158,480.00
Compensation and benefits offered may vary depending on multiple individualized factors, job level, market location, job-related knowledge, skills, individual performance and experience. Please note that salary is only one component of total compensation at Caterpillar.
Benefits:
Subject to plan eligibility, terms, and guidelines. This is a summary list of benefits.
  • Medical, dental, and vision benefits*
  • Paid time off plan (Vacation, Holidays, Volunteer, etc.)*
  • 401(k) savings plans*
  • Health Savings Account (HSA)*
  • Flexible Spending Accounts (FSAs)*
  • Health Lifestyle Programs*
  • Employee Assistance Program*
  • Voluntary Benefits and Employee Discounts*
  • Career Development*
  • Incentive bonus*
  • Disability benefits
  • Life Insurance
  • Parental leave
  • Adoption benefits
  • Tuition Reimbursement

* These benefits also apply to part-time employees
This position requires working onsite five days a week.
Relocation is available for this position.
Visa sponsorship is available for eligible applicants.
Posting Dates:
Any offer of employment is conditioned upon the successful completion of a drug screen.
Caterpillar is an Equal Opportunity Employer, Including Veterans and Individuals with Disabilities. Qualified applicants of any age are encouraged to apply.
Not ready to apply? Join our Talent Community.

Skills Required

  • Bachelor's degree in Computer Science, Software Engineering, Artificial Intelligence, Machine Learning, Robotics, or a related field
  • Experience developing production-grade software using Python, modern software engineering practices, and containerization platforms such as Docker or Kubernetes
  • Experience designing and implementing distributed systems, APIs, and data processing pipelines
  • Experience training, fine-tuning, or deploying machine learning models
  • Strong problem-solving skills and ability to work across multiple technical disciplines
  • Experience generating and managing camera and LiDAR sensor datasets, including data collection pipeline design and ground truth generation
  • Experience with data annotation and quality assurance for autonomous systems or computer vision projects
  • Experience using annotation and dataset management tools such as Labelbox, Supervisely, RoboFlow, or similar tools
  • Experience using machine learning frameworks and training tools such as PyTorch, TensorFlow, ONNX, Weights & Biases, MLflow, or similar frameworks
  • Experience with computer vision, robotics, autonomy, Physical AI, or multimodal AI systems
  • Experience with AI-assisted annotation, auto-labeling, or machine learning data pipelines
  • Experience training or fine-tuning foundation models, vision models, or multimodal models
  • Experience with NVIDIA Cosmos Curator, Cosmos Reason, or similar AI automation platforms
  • Experience with Vision-Language-Action datasets and workflows
  • Experience with camera, LiDAR, radar, or autonomous machine datasets
  • Experience with cloud platforms, MLOps, and machine learning deployment pipelines
  • Experience building human-in-the-loop AI workflows and quality automation systems

What the Team is Saying

Pradeep
Christina
Chad
Madison
Rakshan
MacGregor
Stan

Caterpillar Compensation & Benefits Highlights

How does Caterpillar ensure its pay and bonus plans are competitive?

Caterpillar uses a compensation approach designed to align employee rewards with individual contributions, business performance, and the company's long-term success. Rather than focusing on a single element of pay, the company combines competitive salaries, performance-based incentive opportunities, retirement benefits, healthcare coverage, and other rewards into a broader compensation structure intended to attract and retain talent across engineering, manufacturing, technology, operations, and business functions. 

  • Compensation is benchmarked against the market: Caterpillar regularly evaluates pay levels using external market data and competitive benchmarking. The company reviews compensation practices across relevant industries and labor markets to help ensure employees are paid competitively for their role, experience, skills, and performance. This approach helps Caterpillar compete for talent while maintaining consistency across its global workforce.
  • Performance plays a meaningful role in compensation: A portion of employee compensation is tied to performance, creating a connection between results and rewards. Employees may have opportunities to earn annual incentive compensation based on a combination of individual performance, business results, and company performance. This means compensation can increase when employees and the organization perform well.
  • Bonus opportunities are connected to business success: Unlike organizations that rely primarily on fixed compensation, Caterpillar uses incentive programs that align employees with company outcomes. This structure encourages employees to think beyond individual goals and focus on broader business performance, customer success, operational excellence, and long-term growth.
  • Career progression can create earning opportunities over time: Because Caterpillar places significant emphasis on internal mobility, leadership development, and long-term career growth, compensation growth is often tied to increasing responsibility and advancement within the organization. Employees who take on larger roles, expand their expertise, or move into leadership positions may have opportunities for meaningful increases in compensation throughout their careers.
  • Retirement benefits are an important part of total compensation: Eligible employees have access to retirement savings programs that include a 401(k) plan with company matching contributions in the United States. For employees who build long-term careers at Caterpillar, retirement contributions can become a meaningful component of overall compensation and financial security.
  • The company's financial strength supports compensation stability: Caterpillar reported approximately $64.8 billion in sales and revenues in 2024, maintains investment-grade credit ratings, and has increased its annual dividend for more than 30 consecutive years. This financial strength helps support consistent compensation programs, annual incentive opportunities, and long-term investment in employees.
  • Compensation is supported by a broader benefits package: In addition to salary and bonus opportunities, Caterpillar provides healthcare coverage, retirement benefits, wellbeing resources, paid time off, employee assistance programs, professional development opportunities, and other benefits designed to support employees throughout different stages of their careers. These programs contribute to the overall value employees receive beyond their base pay.
  • External signals:
    • Compensation perception: Employees rate Caterpillar highly for compensation relative to industry peers. (Comparably)
    • Benefits perception: Employees rate Caterpillar's benefits favorably compared to peer industrial employers. (Comparably)
    • Employee advocacy: 77% of employees would recommend Caterpillar to a friend. (Glassdoor)
    • Employer recognition: Caterpillar has been recognized as one of Forbes' World's Best Employers.

Bottom line: Caterpillar's compensation structure combines competitive base pay, performance-based incentive opportunities, retirement benefits, and long-term career growth. Employees are rewarded not only through salary and annual bonuses, but also through advancement opportunities and benefits that can grow in value over the course of a career. For many employees, the appeal lies in the combination of performance-based rewards, financial stability, and the opportunity to build long-term earning potential within a global industrial leader. 

Caterpillar Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Irving, TX
100,000 Employees
Year Founded: 1925

What We Do

Cat Digital is the digital and technology arm of Caterpillar Inc., responsible for bringing digital capabilities to our world-famous yellow iron. With over 1.5M connected assets worldwide, our teams use data, technology, advanced analytics and AI capabilities to help solve our customers' toughest challenges.

Why Work With Us

At Cat Digital, we're accelerating Caterpillar's digital transformation to help customers solve their toughest challenges. Our teams use enterprise-wide data, emerging technologies, and customer insights to deliver solutions that drive real-world impact. Join us as we create innovative experiences that help customers succeed and power the world aro

Gallery

Gallery
Gallery
Gallery
Gallery
Gallery
Gallery
Gallery
Gallery
Gallery

Caterpillar Teams

Team
Engineering
Team
Data Science
Team
Intern
About our Teams

Caterpillar Offices

Hybrid Workspace

Employees engage in a combination of remote and on-site work.

Typical time on-site: Flexible
HQIrving, TX
India
Broomfield, CO
Chennai, IN
Chicago, IL
Geneva, CH
Košice, SK
Peoria, IL
Learn more

Similar Jobs

Caterpillar Logo Caterpillar

Automation Engineer

Artificial Intelligence • Cloud • Internet of Things • Software • Cybersecurity • Industrial • Industrial Equipment
Hybrid
Irving, TX, USA
100000 Employees
128K-209K Annually

Caterpillar Logo Caterpillar

Architect

Artificial Intelligence • Cloud • Internet of Things • Software • Cybersecurity • Industrial • Industrial Equipment
Hybrid
Irving, TX, USA
100000 Employees
128K-209K Annually

Caterpillar Logo Caterpillar

Systems Engineer

Artificial Intelligence • Cloud • Internet of Things • Software • Cybersecurity • Industrial • Industrial Equipment
Hybrid
Irving, TX, USA
100000 Employees
98K-158K Annually

Caterpillar Logo Caterpillar

Senior Java Engineer

Artificial Intelligence • Cloud • Internet of Things • Software • Cybersecurity • Industrial • Industrial Equipment
Hybrid
Irving, TX, USA
100000 Employees
113K-183K Annually

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account