Senior AI Engineer

Posted 2 Days Ago
Be an Early Applicant
2 Locations
In-Office
Senior level
Artificial Intelligence • Machine Learning • Database
The Role
Build and lead production AI engineering solutions for client engagements, including agentic systems, RAG pipelines, vector retrieval, MCP integrations, evaluations, observability, and guardrails. Partner with architects and consultants, coach client engineering teams, and take AI systems from prototype through monitored production deployment. The role also contributes to internal AI products and reference architectures.
Summary Generated by Built In
Company overview:

Blue Orange Digital is a data engineering and AI consultancy that builds production-grade data platforms, ML systems, and analytics solutions for companies that take their data seriously. We are not a staff augmentation shop or a slide-deck consultancy. We are builders. Our teams embed directly into client engineering organizations, shipping code alongside their engineers to accelerate delivery and build lasting capability.

Our clients include Fortune 500 enterprises, high-growth startups, and a growing roster of private equity portfolio companies. We partner with Databricks, Snowflake, AWS, GCP, and Azure to deliver battle-tested solutions that drive measurable ROI.

Note: Please submit your resume in English, as all application materials must be in English for review and consideration.

Position overview:

Blue Orange Digital is scaling its AI practice and needs Senior AI Engineers to deliver production agentic and AI systems to client engagements. The work is a mix of deep, single-client transformations and portfolio-wide programs. Examples of what you could be shipping in any given quarter include:

  • End-to-end AI transformations for mid-market SaaS companies replacing manual, human-in-the-loop workflows with fully orchestrated agentic operations (document processing, review cycles, customer-facing copilots)

  • AI readiness assessments and phased implementation roadmaps across private equity and growth-equity portfolios, where a single engagement may span five to fifteen portfolio companies at varying maturity levels

  • Production RAG and retrieval systems for knowledge-heavy domains such as financial services, legal, compliance, and regulated public-sector workflows

  • Agentic tooling and MCP-based integration layers that connect LLMs to client systems of record, internal APIs, and third-party SaaS

  • Evals, observability, and guardrail frameworks that take client-built prototypes from notebook demos to load-tested, monitored production services

  • Internal AI enablement engagements — helping client engineering orgs stand up their first production agent platform, define patterns, and upskill their teams

Pod Structure:
  • You will work as a senior IC inside a delivery pod — the core unit of how BOD delivers AI work. A typical pod is three to five people:

  • AI Architect — owns the platform and data foundations

  • AI Transformation Consultant — drives strategy, roadmap, change management, and executive alignment

  • Senior AI Engineer(s) (this role) — owns the agentic and ML implementation workstream

  • Additional roles as needed to scale the build

  • Pods operate as a cohesive unit that tackles cutting-edge AI strategy and implementation end-to-end — from discovery and architecture through shipped, measured production systems — across a rotating portfolio of interesting clients. You will own the AI engineering workstream on your pod, partner daily with the Architect and Consultant as peers, and report into the Practice Lead.

Responsibilities:
  • Build production-grade agentic systems on Databricks and other lakehouse platforms, including orchestration frameworks, task runners, and monitoring layers

  • Implement RAG pipelines, vector stores, and retrieval architectures that hold up under real-world load

  • Stand up evals, observability, and guardrails for client-deployed AI systems

  • Design and integrate MCP servers and tool-calling layers between LLMs and client systems

  • Lead the AI engineering workstream on a client pod, partnering with the Architect on platform decisions and the Consultant on roadmap

  • Coach client engineering teams on production AI patterns, including prompt management, model routing, and FinOps

  • Contribute to BOD’s internal Edge product suite, including reference architectures and the Blueprint scan engine

Requirements:
  • 5+ years building production data and ML systems in Python; 2+ years specifically on LLM-based or agentic systems

  • Hands-on experience with at least one major LLM orchestration framework (LangChain, LangGraph, Langflow, Databricks Agent Framework, or equivalent)

  • Production experience with Databricks (Unity Catalog, Delta Live Tables, MLflow) or comparable lakehouse platforms such as Snowflake with dbt

  • Deep knowledge of RAG architectures, vector databases, and embedding pipelines

  • Proven track record taking AI systems from prototype to production, including evals, monitoring, and on-call ownership

  • Comfortable working directly with client engineering teams as a peer and a coach

Preferred qualifications:
  • Databricks, AWS, or Azure certifications

  • Experience with MCP, tool-calling protocols, or agentic protocol design

  • Background in security-aware AI engineering (prompt injection, data leakage, access control)

  • Multimodal AI experience across text, document, and image

  • FinOps experience optimizing model and compute spend

Benefits:
  • Competitive compensation with performance bonuses

  • Work on diverse, challenging projects across industries

  • Direct access to cutting-edge tech stacks (Databricks, AWS, GCP, Azure)

  • Builder culture where engineers lead and ship

  • Professional development budget and certification support

  • Flexible remote work environment

  • Collaborative team that values production-grade craftsmanship

Background checks may be required for certain positions/projects.

Blue Orange Digital is an equal-opportunity employer.

Skills Required

  • 5+ years building production data and ML systems in Python
  • 2+ years specifically building LLM-based or agentic systems
  • Hands-on experience with a major LLM orchestration framework such as LangChain, LangGraph, Langflow, Databricks Agent Framework, or equivalent
  • Production experience with Databricks, including Unity Catalog, Delta Live Tables, and MLflow, or a comparable lakehouse platform such as Snowflake with dbt
  • Deep knowledge of RAG architectures, vector databases, and embedding pipelines
  • Proven experience taking AI systems from prototype to production, including evaluations, monitoring, and on-call ownership
  • Ability to work directly with client engineering teams as a peer and coach
  • Databricks, AWS, or Azure certifications
  • Experience with MCP, tool-calling protocols, or agentic protocol design
  • Background in security-aware AI engineering, including prompt injection, data leakage, and access control
  • Multimodal AI experience across text, document, and image
  • FinOps experience optimizing model and compute spend

Blue Orange Digital Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Blue Orange Digital and has not been reviewed or approved by Blue Orange Digital.

  • Healthcare Strength — Health coverage is described as comprehensive across medical, dental, and vision in current job postings, with some descriptions indicating particularly strong plan generosity. This points to a solid core insurance foundation for U.S.-based roles.
  • Retirement Support — Current role descriptions consistently include a 401(k) with company match. This adds long‑term financial value to the overall package.
  • Leave & Time Off Breadth — Certain postings specify unlimited PTO along with paid parental and bereavement leave. This breadth of time‑off options supports flexibility for varied life events.

Blue Orange Digital Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: New York, NY
75 Employees
Year Founded: 2015

What We Do

Blue Orange is a data science and machine learning consulting and development firm. We build modern data warehousing to support machine learning and AI. We help companies integrate these insights to drive data-driven decision making.

Similar Jobs

PwC Logo PwC

Artificial Intelligence Engineer

Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
Hybrid
4 Locations
370000 Employees
124K-335K Annually

PwC Logo PwC

Artificial Intelligence Engineer

Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
Hybrid
24 Locations
370000 Employees
77K-202K Annually
Remote or Hybrid
US
15100 Employees
107K-150K Annually

NBCUniversal Logo NBCUniversal

Senior AI Platform Governance Engineer

AdTech • Cloud • Digital Media • Information Technology • News + Entertainment • App development
Remote or Hybrid
New York, NY, USA
115K-145K Annually

Similar Companies Hiring

Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
33 Employees
Vega Thumbnail
Artificial Intelligence • Automotive • Insurance • Transportation
US
65 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account