The Principal, AI Architect is the organization’s senior-most technical authority for designing and guiding the development of scalable, secure, and compliant AI platforms and capabilities. This role defines architectural direction, establishes engineering standards and reference patterns, and provides strategic technical leadership across multiple business and technology teams. Operating as an expert-level individual contributor, the Principal, AI Architect translates business use cases into robust platform designs, drives decisions on tooling, frameworks, and model integration, and ensures that AI systems meet enterprise requirements for performance, reliability, and regulatory compliance. This role tackles multi-dimensional, highly complex technical challenges with substantial autonomy. Additionally, this role influences senior leadership, partners across functions including Data, Product, Security, and Enterprise Technology, and provides guidance to engineering teams building AI solutions. The role introduces new architectural approaches, evaluates emerging technologies, and shapes the long-term roadmap for the firm’s AI ecosystem.Position Summary
The Principal, AI Architect is the organization’s senior-most technical authority for designing and guiding the development of scalable, secure, and compliant AI platforms and capabilities. This role defines architectural direction, establishes engineering standards and reference patterns, and provides strategic technical leadership across multiple business and technology teams. Operating as an expert-level individual contributor, the Principal, AI Architect translates business use cases into robust platform designs, drives decisions on tooling, frameworks, and model integration, and ensures that AI systems meet enterprise requirements for performance, reliability, and regulatory compliance. This role tackles multi-dimensional, highly complex technical challenges with substantial autonomy. Additionally, this role influences senior leadership, partners across functions including Data, Product, Security, and Enterprise Technology, and provides guidance to engineering teams building AI solutions. The role introduces new architectural approaches, evaluates emerging technologies, and shapes the long-term roadmap for the firm’s AI ecosystem.
Primary Responsibilities- Define and maintain the enterprise‑grade AI platform architecture, including orchestration layers, LLM integration patterns, vector/RAG pipelines, agent frameworks, API mesh, and reusable shared services.
- Develop architectural standards, guardrails, and reference designs governing how engineering teams build and integrate AI workloads.
- Translate business and product requirements into detailed technical designs, ensuring scalability, security, reliability, and alignment with enterprise architecture principles.
- Evaluate build‑vs‑buy decisions for AI components, frameworks, and cloud services; develop recommendations and influence cross‑functional stakeholders.
- Review solution designs from engineering teams; identify risks, surface architectural gaps, and recommend long‑term, sustainable approaches.
- Partner with Security, Compliance, Legal, and Risk to embed SOX, SOC 2, PCI, PII, data residency, and other regulatory requirements into architectural designs.
- Collaborate with Data Platform teams to define data access patterns, boundaries, governance expectations, and integration mechanisms aligned with enterprise data strategy.
- Lead development of architectural decision records (ADRs), integration specifications, and platform documentation supporting engineering and compliance readiness.
- Assess LLM providers, model hosting patterns (e.g., Bedrock, SageMaker, open-source models), and orchestration frameworks; continuously recommend improvements based on evaluation of emerging capabilities.
- Drive cross-functional alignment on AI design choices and platform evolution; facilitate architectural reviews, design sessions, and technical deep dives.
- Provide expert-level guidance and mentorship to engineering teams implementing AI services, pipelines, and production applications.
- Ensure AI solutions follow cloud best practices across reliability, cost efficiency, observability, performance, and operational readiness.
- Partner with Product, Engineering, and Enterprise Architecture to influence long-term platform direction, including multi-tenant patterns, internal developer experiences, and future-state AI services.
- Support readiness for audits and risk assessments by ensuring AI platform design documentation, logs, and controls meet enterprise and regulatory expectations.
- Champion engineering excellence, standardization, and modernization through clear architectural principles, platform governance, and adoption of best‑in‑class tools and patterns.
- Deep technical expertise in AI/ML platform architecture, including LLMs, RAG pipelines, vector databases, agent frameworks, orchestration systems, and prompt/response patterns.
- Expert-level AWS knowledge (e.g., Bedrock, SageMaker, Lambda, ECS/EKS, API Gateway, IAM, KMS, networking, security controls).
- Strong understanding of enterprise integration patterns, API design, event-driven architectures, service mesh, and distributed systems engineering.
- Advanced knowledge of secure design principles, compliance frameworks, and architectural controls for regulated environments (SOX, SOC 2, PCI, PII, data residency).
- Ability to simplify highly complex concepts, communicate architectural decisions to technical and non-technical stakeholders, and influence senior leadership.
- Strong analytical and problem‑solving skills, capable of evaluating multiple technical paths and making sound recommendations under ambiguity.
- Demonstrated ability to drive architectural alignment across cross-functional engineering teams.
- Proficiency with cloud-native observability, monitoring, scalability design, and performance tuning for AI workloads.
- Ability to evaluate emerging AI technologies, model providers, and frameworks, and integrate them responsibly into a long-term architectural roadmap.
- High degree of ownership, judgment, and technical leadership with the ability to operate independently and make decisions with wide organizational impact.
- Bachelor’s degree in computer science, engineering, or related field required; master’s degree preferred.
- 8–10+ years of progressive software/platform engineering experience, including substantial depth in AI/ML system architecture.
- Hands-on experience designing and deploying production AI systems using LLMs, RAG pipelines, orchestration frameworks (e.g., LangChain, LlamaIndex), and cloud-native AI services.
- Significant experience with AWS cloud architecture, including design of scalable, secure, highly available distributed systems.
- Experience operating in regulated industries or environments with strong compliance expectations preferred (financial services, insurance, or equivalent).
- Demonstrated ability to influence cross-functional leaders, drive architectural standardization, and guide complex technical initiatives.
- Strong written and verbal communication skills, including production of decision-quality technical documentation.
- Proven ability to lead architecture for large-scale platforms and guide engineering teams in adopting modern, standardized patterns.
#LI-RL1
IND1
Click here for some insight into our culture!
The Baldwin Group will not accept unsolicited resumes from any source other than directly from a candidate who applies on our career site. Any unsolicited resumes sent to The Baldwin Group, including unsolicited resumes sent via any source from an Agency, will not be considered and are not subject to any fees for any placement resulting from the receipt of an unsolicited resume.
What We Do
BRP is now The Baldwin Group! We’ve updated our name to reflect our unified group of talented teams across the country. The Baldwin Group is a cohesive group of experts in business insurance, employee benefits, retirement planning, and all areas of private and personal insurance. Since our founding in 2011, we’ve evolved from a local business into a national firm with a vast network of specializations and industry practices for the benefit of our more than two million clients across the country. In addition, we have built excellent relationships with a wide range of insurance company partners. These relationships, coupled with our entrepreneurial and family-oriented culture, and deep expertise enable us to seamlessly deliver a breadth of innovative solutions to clients. At The Baldwin Group, we help provide the solutions our clients need to have confidence and gain peace of mind as they pursue what’s possible for themselves, their families, and their businesses. Whether they are renting their first apartment or buying a larger home, opening a small business or taking their company public, we offer solutions to support them on every step of their journey. This has been our story since the beginning—we provide the indispensable expertise and quality insights that give our clients peace of mind to pursue their purpose, passion, and dreams. And that’s what The Baldwin Group will continue to do for years to come: we Protect the Possible℠.
