Senior Machine Learning Engineer — Data Infrastructure

Posted 6 Hours Ago
3 Locations
Remote or Hybrid
Senior level
Artificial Intelligence • Computer Vision • Machine Learning • Robotics
The Role
Design, build, and operate large-scale crawling, ingestion, and ETL/ELT pipelines for petabyte-scale image and video datasets. Optimize distributed processing (Ray/Spark/Dask), ensure dataset provenance/versioning, reduce cost/latency, and collaborate with CV engineers and ML scientists. Provide technical leadership and mentor junior engineers.
Summary Generated by Built In
About Us

Veeda AI is building the next generation of multimodal foundation world models for Physical AI. We're a small, fast-moving team of engineers and researchers from leading AI labs, tackling some of the most challenging problems at the intersection of AI, robotics, and embodied intelligence. If you're excited about pushing the boundaries of what's possible with Physical AI, you'll have the opportunity to make an outsized impact from day one.

Responsibilities
  • Crawling & Ingestion at Scale: Architect and own the scraping and crawling infrastructure that acquires petabytes of image and video data — designing systems that are resilient, compliant, and able to keep pace with a fast-moving content landscape.

  • Image-Data Pipeline Design: Build and maintain production data pipelines that clean, transform, and process raw visual assets—handling format diversity, resolution variance, metadata extraction, and noise at scale.

  • ETL/ELT for Training & Evaluation: Design ETL/ELT workflows that prepare image and video datasets for ML model training and evaluation, including annotation ingestion, quality scoring, and reproducible dataset versioning.

  • Performance & Cost Optimization: Continuously profile and optimize pipelines for throughput, latency, and cloud storage/compute costs—ensuring research velocity without unnecessary overhead.

  • Distributed Processing Ownership: Select, deploy, and operate distributed data-processing frameworks (e.g., Ray, Spark, Dask) to handle compute-intensive tasks like large-batch image transformation, embedding generation, and feature extraction.

  • Cross-Functional Partnership: Work directly with Computer Vision Engineers, ML Scientists, and product teams to translate data requirements into reliable, well-documented pipelines and close the feedback loop between model performance and data quality.

  • Technical Leadership: Lead data-pipeline design reviews, mentor junior and mid-level data engineers, establish best practices for the data team, and raise the overall engineering bar.

Requirements
  • You have 5+ years of professional experience in data engineering or a closely related discipline with a strong foundation in distributed systems, database design, and handling large binary assets (images, video) at scale.

  • You possess strong programming skills in Python and SQL, with proven experience designing end-to-end production systems rather than basic scripts.

  • You have designed and operated web scraping or data ingestion systems running reliably in production at significant global scale.

  • You are hands-on with data-processing frameworks (e.g., PySpark, Pandas, Ray) and comfortable with image-processing libraries (OpenCV, Pillow, scikit-image).

  • You have built ETL/ELT pipelines for ML/CV use cases with a strong emphasis on dataset provenance, lineage, and reproducibility.

  • You have extensive experience with cloud object storage (AWS S3, GCP GCS) and understand the cost, latency, and durability trade-offs when managing petabyte-scale data assets.

  • Production Quality, Agent Velocity: Your daily workflow runs through AI coding harnesses (e.g., AI agents/assistants) without sacrificing software engineering rigor. You review agent code diffs with the same scrutiny as a team member's PR, recognize AI code generation failure modes, and ship rapidly without introducing technical debt or "slop."

Nice to Have
  • Experience with Ray for distributed data processing or ML-adjacent workflows.

  • Hands-on experience with data orchestration platforms (e.g., Airflow, Dagster, Prefect) to manage complex processing DAGs in production.

  • Familiarity with Computer Vision concepts and image annotation formats (COCO, PASCAL VOC, YOLO).

  • Practical knowledge of MLOps concepts, including data versioning (e.g., DVC, LakeFS) and experiment tracking for CV pipelines.

  • Experience with containerization (Docker) and orchestration (Kubernetes) for scaling data processing workloads.

  • Experience navigating multi-region data compliance challenges (GDPR, content licensing, and image rights across jurisdictions).

Skills Required

  • 5+ years professional experience in data engineering or closely related discipline
  • Strong foundation in distributed systems, database design, and handling large binary assets (images, video) at scale
  • Strong programming skills in Python and SQL with experience designing end-to-end production systems
  • Designed and operated web scraping or data ingestion systems running reliably in production at global scale
  • Hands-on experience with data-processing frameworks (PySpark, Pandas, Ray)
  • Comfortable with image-processing libraries (OpenCV, Pillow, scikit-image)
  • Built ETL/ELT pipelines for ML/CV with emphasis on dataset provenance, lineage, and reproducibility
  • Extensive experience with cloud object storage (AWS S3, GCP GCS) and cost/latency/durability trade-offs for petabyte-scale data
  • Experience reviewing and shipping code produced via AI coding harnesses/agents while maintaining software engineering rigor
  • Experience with data orchestration platforms (Airflow, Dagster, Prefect)
  • Familiarity with computer vision concepts and image annotation formats (COCO, PASCAL VOC, YOLO)
  • Practical knowledge of MLOps concepts including data versioning (DVC, LakeFS) and experiment tracking for CV pipelines
  • Experience with containerization and orchestration for scaling data workloads (Docker, Kubernetes)
  • Experience navigating multi-region data compliance (GDPR, content licensing, image rights)
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company

What We Do

Veeda AI is a small, fast-moving team of engineers and researchers building the next generation of multimodal foundation world models for Physical AI. Its work sits at the intersection of artificial intelligence, robotics, and embodied intelligence, with engineering roles involving high-throughput image and video data pipelines. The company aims to advance intelligent systems capable of operating in and understanding the physical world.

Similar Jobs

Tulip Logo Tulip

Customer Success Manager

Enterprise Web • Hardware • Internet of Things • Software
Easy Apply
Remote or Hybrid
27 Locations
310 Employees

The Aerospace Corporation Logo The Aerospace Corporation

Director Sales

Aerospace • Artificial Intelligence • Cloud • Machine Learning • Software • Cybersecurity • Defense
Remote or Hybrid
4 Locations
4600 Employees

Zapier Logo Zapier

Back-end Engineer

Artificial Intelligence • Productivity • Software • Automation
Remote
32 Locations
800 Employees
211K-316K Annually

Zapier Logo Zapier

Systems Engineer

Artificial Intelligence • Productivity • Software • Automation
Remote
27 Locations
800 Employees

Similar Companies Hiring

Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
LTX Thumbnail
Robotics • Conversational AI • Generative AI
Jerusalem, Israel
200 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account