Principal AI Engineer

Posted 6 Days Ago
Be an Early Applicant
San Francisco, CA, USA
Hybrid
175K-200K Annually
Senior level
Artificial Intelligence • Big Data • Machine Learning • Software • Analytics
The Role
Designs and delivers production-grade AI solutions for enterprise customers, including agentic AI systems, LLM applications, RAG pipelines, ML services, and LLMOps infrastructure. Leads customer engagements, pre-sales proofs of concept, technical strategy, architecture, delivery coordination, stakeholder communication, and issue resolution. Builds backend APIs, deploys solutions across cloud, on-premises, and hybrid environments, establishes responsible AI controls, and mentors engineering teams.
Summary Generated by Built In

H2O.ai is on a mission to democratize AI for Good. As the world’s leading agentic AI company, H2O.ai converges Generative and Predictive AI to help enterprises and public sector agencies develop purpose-built Agents, SLMs, and solutions on their private data. With a focus on secure, compliant, and infrastructure-flexible Sovereign AI deployments, H2O.ai delivers solutions that align with the highest standards of data privacy and control.

Its open-source technology is trusted by over 20,000 organizations worldwide, including more than half of the Fortune 500. H2O.ai powers AI transformation for companies like AT&T, Commonwealth Bank of Australia, Wells Fargo, Bank of America, Workday, Progressive Insurance, and NIH.

For more information, visit www.h2o.ai. 

About This Opportunity 

We are looking for a Principal AI Engineer who builds things that matter. You will design and ship end-to-end AI solutions for some of APAC's most complex enterprise problems - spanning agentic AI systems, LLM applications, and production ML pipelines. This is a hands-on engineering role embedded within a customer-facing field team, meaning your work will be seen, used, and evaluated by real enterprises from day one.

You will work alongside Kaggle Grandmasters, ML engineers, and domain experts to deliver AI that goes beyond demos - into production, into workflows, and into measurable business outcomes.
This position is based in San Francisco, Bay Area.
What You Will Do

Customer Engagement Leadership

  • Lead end-to-end technical engagement with enterprise customers, acting as the senior point of accountability for delivery quality, stakeholder relationships, and outcomes.
  • Manage multiple concurrent engagement streams simultaneously – coordinating workplans, resourcing, and milestones across cross-functional teams.
  • Serve as the primary technical escalation point for customer issues, proactively identifying risks and driving resolution across engineering, product, and leadership.
  • Build and maintain trusted relationships with customer data science teams, engineering leads, and executive stakeholders – translating business needs into technical direction and back again.
  • Lead pre-sales and proof-of-concept engagements, setting the technical strategy and ensuring the team delivers demonstrations that build genuine enterprise trust.
  • Represent H2O.ai externally at customer workshops, executive briefings, and technical deep-dives as a credible senior voice.

Agentic AI & LLM Engineering

  • Design and build agentic AI systems and multi-agent frameworks that automate complex, multi-step enterprise workflows.
  • Develop and deploy LLM-powered applications using RAG, fine-tuning, prompt engineering, function calling, and tool use.
  • Implement guardrails, evaluation frameworks, and responsible AI controls to ensure production-grade reliability and safety.
  • Stay current with the rapidly evolving agentic AI landscape – MCP, LLM orchestration frameworks, reasoning models – and bring the best into customer engagements.

End-to-End AI Application Development

  • Own the full development lifecycle across multiple streams: from problem framing and data exploration through model development, API integration, and production deployment.
  • Build scalable backend services and APIs that expose AI capabilities to enterprise applications and workflows.
  • Integrate AI models into customer environments – cloud, on-prem, and hybrid – ensuring performance, stability, and maintainability at scale.
  • Develop ML pipelines and LLMOps infrastructure that support continuous model improvement and monitoring in production.

Team Collaboration & Delivery Excellence

  • Coordinate delivery across engineers, program managers, and solution architects – ensuring workstreams are aligned, unblocked, and progressing to plan.
  • Set the technical bar for the engagements you lead, reviewing outputs, shaping architecture decisions, and ensuring engineering quality across the team.
  • Mentor and guide junior ML engineers and solution engineers within engagements, building team capability alongside delivery.
  • Collaborate closely with H2O.ai product and engineering teams to surface customer feedback, shape roadmap input, and resolve platform-level issues.
What We Are Looking For

Experience & Background

  • 8+ years of hands-on AI/ML engineering experience, including end-to-end model development and production deployment.
  • Demonstrable experience leading technical delivery across complex, multi-stakeholder enterprise engagements – not just executing within them.
  • Demonstrable experience building LLM-powered applications – RAG pipelines, agentic workflows, fine-tuned models, or similar.
  • Strong Python engineering skills; experience with ML frameworks (PyTorch, TensorFlow, scikit-learn) and LLM tooling (LangChain, LlamaIndex, or equivalent).
  • Experience deploying AI services in cloud or enterprise environments (AWS, Azure, GCP, on-prem Kubernetes).

Skills & Capabilities

  • Proven ability to manage multiple concurrent workstreams and coordinate cross-functional teams toward shared delivery milestones.
  • Deep understanding of modern GenAI concepts: prompt engineering, RAG, fine-tuning, RLHF, model evaluation, guardrails, and LLMOps.
  • Solid grounding in classical ML – able to select the right tool for the problem, not just default to the latest LLM.
  • Backend development skills: REST APIs, containerisation (Docker/Kubernetes), and CI/CD pipelines for AI applications.
  • Strong executive communication – able to run a board-level briefing one hour and a technical design review the next, credibly.
  • Comfortable with ambiguity and able to set direction for a team when requirements are incomplete or evolving.

How to Stand Out From the Crowd

  • Kaggle or competitive ML experience.
  • Familiarity with H2O.ai products, Wave, or H2O Document AI.
  • Experience in financial services, healthcare, or other regulated industry AI deployments.
  • Exposure to tabular foundation models, AutoML, or enterprise ML platforms.
  • Prior experience in a customer-facing or field engineering role.

Why H2O.ai?

  • Market leader in total rewards
  • Remote-friendly culture
  • Flexible working environment
  • Be part of a world-class team
  • Career growth
The base salary for this role ranges from $175,000 to $200,000. Compensation is determined based on several factors, including skills, experience, job scope, location, and relevant market compensation data.

H2O.ai is committed to creating a diverse and inclusive culture. All qualified applicants will receive consideration for employment without regard to their race, ethnicity, religion, gender, sexual orientation, age, disability status or any other legally protected basis.

H2O.ai is an innovative AI cloud platform company, leading the mission to democratize AI for everyone. Thousands of organizations from all over the world have used our cutting-edge technology across a variety of industries. We’ve made it easy for people at all levels to generate breakthrough solutions to complex business problems and advance the discovery of new ideas and revenue streams. We push the boundaries of what is possible with artificial intelligence. 

H2O.ai employs the world’s top Kaggle Grandmasters, the community of best-in-the-world machine learning practitioners and data scientists. A strong AI for Good ethos and responsible AI drive the company’s purpose.

Please visit www.H2O.ai to learn more.

#LI-Hybrid

Skills Required

  • 8+ years of hands-on AI and machine learning engineering experience, including end-to-end model development and production deployment.
  • Experience leading technical delivery across complex, multi-stakeholder enterprise engagements.
  • Experience building LLM-powered applications, including RAG pipelines, agentic workflows, or fine-tuned models.
  • Strong Python engineering skills.
  • Experience with PyTorch, TensorFlow, scikit-learn, and LLM tooling such as LangChain or LlamaIndex.
  • Experience deploying AI services in cloud or enterprise environments, including AWS, Azure, GCP, or on-premises Kubernetes.
  • Ability to manage multiple concurrent workstreams and coordinate cross-functional teams toward shared milestones.
  • Deep understanding of prompt engineering, RAG, fine-tuning, RLHF, model evaluation, guardrails, and LLMOps.
  • Backend development experience with REST APIs, Docker or Kubernetes containerization, and CI/CD pipelines.
  • Strong executive communication skills, including board-level briefings and technical design reviews.
  • Ability to work through ambiguity and set technical direction for teams.
  • Kaggle or competitive machine learning experience.
  • Familiarity with H2O.ai products, Wave, or H2O Document AI.
  • Experience delivering AI solutions in financial services, healthcare, or another regulated industry.
  • Exposure to tabular foundation models, AutoML, or enterprise ML platforms.
  • Prior customer-facing or field engineering experience.
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Mountain View, CA
321 Employees
Year Founded: 2012

What We Do

H2O.ai is the leading AI cloud company, on a mission to democratize AI for everyone. Customers use the H2O AI Hybrid Cloud platform to rapidly make, operate and innovate to solve complex business problems and accelerate the discovery of new ideas. H2O.ai is the trusted AI partner to more than 20,000 global organizations, including AT&T, Aegon/ Transamerica, Allergan, Bon Secours Mercy Health, Capital One, Commonwealth Bank of Australia, GlaxoSmithKline, Hitachi, Kaiser Permanente, PayPal, PWC and Walgreens, over half of the Fortune 500 and one million data scientists. Goldman Sachs, NVIDIA and Wells Fargo are not only customers and partners, but strategic investors in the company. H2O.ai’s customers have honored the company with a Net Promoter Score (NPS) of 78— the highest in the industry based on breadth of technology and deep employee expertise. The world’s top 20 Kaggle Grandmasters (the community of best-in-the-world machine learning practitioners and data scientists) are employees of H2O.ai. A strong AI for Good ethos to make the world a better place and Responsible AI drive the company’s purpose. Please join our movement at www.H2O.ai.

Similar Jobs

ServiceNow Logo ServiceNow

Principal Software Engineer

Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Hybrid
Santa Clara, CA, USA
29000 Employees
221K-387K Annually

Arm Logo Arm

Principal AI Performance Engineer

Artificial Intelligence • Internet of Things • Semiconductor
Hybrid
San Jose, CA, USA
8314 Employees
263K-355K Annually

ServiceNow Logo ServiceNow

Principal AI Forward Deployed Engineer

Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Hybrid
Santa Clara, CA, USA
29000 Employees
221K-387K Annually

DigitalOcean Logo DigitalOcean

Principal Engineer

Artificial Intelligence • Cloud • Software • Infrastructure as a Service (IaaS)
In-Office or Remote
San Francisco, CA, USA
1400 Employees
230K-288K Annually

Similar Companies Hiring

Revel Thumbnail
Aerospace • Hardware • Robotics • Software
Marina Del Rey, California
60 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
30 Employees
Vega Thumbnail
Artificial Intelligence • Automotive • Insurance • Transportation
US
43 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account