Machine Learning Engineer III

Posted 17 Days Ago
Be an Early Applicant
Bengaluru, Bengaluru Urban, Karnataka, IND
In-Office
Senior level
Artificial Intelligence • eCommerce • Marketing Tech • Software • Analytics
We are building the operating system for brands to win in E-commerce.
The Role
Build and scale production machine learning systems for B2B SaaS products. Responsibilities include developing end-to-end ML pipelines, building ML platform infrastructure, managing data ingestion and feature engineering, deploying LLMs and other models on GPUs, monitoring model performance, and owning the ML infrastructure roadmap. The role partners closely with Data Science, Engineering, Product, Platform, and Operations teams.
Summary Generated by Built In
The Company

CommerceIQ is building the AI platform that runs commerce for the world's largest brands. We are not selling AI demos. We are shipping AI agents for content, media, and sales into the workflows of the Fortune 100 every week.

                                                                          
2,200+
          
Customers
                  
10 of Top 12
          
CPG Companies
                  
900+
          
Retailers Connected
                  
$200M+
          
Raised
        

Customers include Coca-Cola, Nestlé, Colgate-Palmolive, Mondelez, Samsung, and Kellogg's. Backed by SoftBank, Insight Partners, and Madrona. Headquartered in Mountain View with teams across the US, India, Canada, and the UK. Pre-IPO.

About the Role

We are looking for a hands-on Machine Learning Engineer III to build and run the ML and AI systems behind our agents for content, media, and sales. You will work closely with Data Science, Engineering, Platform, Product, and Operations teams to take models and LLM-based agents from idea to production, and keep them reliable, fast, and cost-efficient at scale. This is an engineering role first: you will own your systems end to end, including the infrastructure they run on. We look for builders who ship v0s quickly, iterate against evals, and stay adaptable about models and frameworks as the field moves.

Key Responsibilities :

  • AI Agents & Harnesses: Design, build, and ship production agents and the harnesses around them: tool and action design, context window management (retrieval, summarization, compaction), model selection and routing, memory and state, and subagent and parallel tool-call patterns. Iterate until agents reliably complete real customer tasks.

  • ML Pipelines: Build end-to-end batch and real-time pipelines for classical ML and LLM workloads, from data ingestion to deployment.

  • Infrastructure: Own the infrastructure your systems run on: containers, Kubernetes, queues, caches, and cloud services on AWS/GCP, managed as code.

  • Reliability & Quality: Meet latency, throughput, and cost budgets using caching, batching, and parallel execution. Handle rate limits, retries, and failures gracefully. Instrument agents with tracing to profile behavior, find bottlenecks, and catch quality regressions before customers do.

  • Evals: Build eval sets from production traces, expert examples, and past failures, plus automated checks and LLM judges that measure model and agent quality. Use them to gate every prompt, model, and code change.

  • Feedback & Experimentation: Turn reviewer and customer feedback into measurable improvements through human-in-the-loop workflows, A/B tests, offline replays, and staged rollouts.

  • Technical Ownership: Review designs and code, raise the engineering bar, and contribute to the ML and AI roadmap with Data Science and Platform teams.

Required Skills :
  • 5+ years of experience building and running ML or AI systems in production, including at least 1 year on LLM-based applications. Bachelor's or Master's in Computer Science, Maths/Stats, or a related field, or equivalent practical experience.

  • Strong programming skills in Python, including async and concurrent programming, and solid SQL.

  • Hands-on experience building production agents and LLM applications: tool and function design, context window management, RAG and embeddings, structured outputs, multi-step and multi-agent orchestration, and model selection across hosted APIs (OpenAI, Anthropic, Gemini, or similar).

  • Daily use of coding agents such as Claude Code or Cursor, with the judgment to review and verify their output.

  • Solid ML fundamentals (evaluation metrics, overfitting, leakage, drift) and experience deploying models in both batch and real-time setups, including knowing when classical ML beats an LLM.

  • Strong infrastructure skills: Docker, Kubernetes, at least one cloud provider (AWS / GCP / Azure), and production observability (OpenTelemetry, Grafana, Prometheus, or equivalent).

  • Working experience with Terraform and CI/CD, distributed data processing (Spark or Databricks), and workflow orchestration or messaging (Airflow, Temporal, Kafka, or similar).

  • Strong system design skills. You can reason clearly about cost, latency, failure modes, and scale trade-offs.

  • Excellent written and verbal communication, and the ability to drive cross-functional requirements with Product and Engineering.

 
Preferred Skills :
  • Advanced evals: LLM-as-judge calibration against human labels, golden datasets, trace capture and replay, and statistically sound comparisons of variants with confidence intervals.

  • Agent frameworks & protocols: Hands-on with LangGraph, the OpenAI Agents SDK, MCP, or similar, and knowing when a thin custom harness beats a framework.

  • Simulation environments: Simulated users and synthetic tasks for testing multi-step agents before they reach customers.

  • LLM observability & prompt management: Tools like LangSmith, Opik, or Langfuse for tracing, versioning, and debugging prompts in production.

  • Cost & latency tuning: Prompt caching, batching, model routing, and output-length control for high-volume LLM workloads.

  • Guardrails: Schema validation, content and safety checks, and fallbacks for when the model gets it wrong.

  • Vector search: Databricks Vector Search, pgvector, OpenSearch, or similar.

 
Bonus Skills :
  • Fine-tuning: Adapting models (SFT, LoRA/PEFT, preference tuning, distillation) and serving them efficiently, including on GPUs (vLLM, TGI, or equivalent).

  • Research: A track record of turning research into production impact. Publications or open-source contributions are a plus.

  • Experience in ecommerce, retail media, or B2B SaaS.

Why you will love to work with us -
  • Your work ships. Our AI agents run inside the workflows of the world's largest brands every week, and you will see the impact directly.

  • Work across classical ML, LLMs, agents, and infrastructure, not one narrow slice.

  • You will own projects end to end, from exploration to production.

  • Forget endless meetings. Get things done and start making an impact from day 1.

We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, disability status or any other category prohibited by applicable law. 

Skills Required

  • Bachelor’s or master’s degree in Computer Science, Mathematics, or Statistics
  • 7+ years of experience solving machine learning engineering problems
  • Experience deploying large-scale machine learning models in batch and real-time production environments
  • Experience with distributed computing frameworks such as Spark or MapReduce
  • Cloud experience with AWS, GCP, or Azure
  • Experience with infrastructure-as-code tools such as Terraform
  • Understanding of the complete machine learning pipeline from data ingestion through production deployment
  • Experience with machine learning operations, software engineering, and architecture
  • Experience architecting and building production-ready AI pipelines
  • Strong programming skills in Python or SQL
  • Experience with scikit-learn, pandas, and NumPy
  • Experience with machine learning tools such as TensorFlow, Keras, or PyTorch
  • Ability to transition complex research ideas from experimentation to production
  • Strong written and oral communication skills, including cross-functional requirements leadership
  • Depth and breadth in machine learning theory and practice, optimization, data mining, statistics, and linear algebra
  • Experience with Databricks
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Mountain View, CA
360 Employees
Year Founded: 2017

What We Do

CommerceIQ is the leader in E-commerce Channel Optimization (ECO), the practice of using machine learning, analytics and automations to optimize the e-commerce channel across supply chain, marketing and sales operations to win at the moment of purchase and drive profitable market share growth.

Why Work With Us

CommerceIQ is building innovative products in a hot market, in a pre-IPO company with a bold vision, and with passionate colleagues who are collectively building a company for the long run. We have developed a culture to support our growth and deliver a unique employee experience with market competitive pay and exceptional benefits.

Gallery

Gallery

Similar Jobs

Razorsight Logo Razorsight

Software Engineer

Cloud • Software • Analytics • Business Intelligence
In-Office
Bangalore, Bengaluru, Karnataka, IND
60 Employees
Hybrid
Bengaluru, Bengaluru Urban, Karnataka, IND
289097 Employees
Remote or Hybrid
2 Locations
289097 Employees

JPMorganChase Logo JPMorganChase

Client Data

Financial Services
Hybrid
Bengaluru, Bengaluru Urban, Karnataka, IND
289097 Employees

Similar Companies Hiring

Revel Thumbnail
Aerospace • Hardware • Robotics • Software
Marina Del Rey, California
70 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
33 Employees
Vega Thumbnail
Artificial Intelligence • Automotive • Insurance • Transportation
US
65 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account