Generative AI Architect
Location: New York, NY & Orlando, FL | Practice Area: Technology & Engineering | Type: Permanent
Shape the architecture of enterprise-scale generative AI solutions at the forefront of innovation
The Role
As part of Capco’s Technology Delivery Team, you will apply deep expertise in architecture, AI, and modern engineering practices to design and deliver next-generation solutions. As a Generative AI Architect, you will lead the definition and implementation of scalable, secure, and enterprise-grade AI systems, guiding projects from concept through to production while aligning technology with strategic business goals.
What You’ll Do
- Define and deliver enterprise-wide architecture for generative AI and agentic systems aligned to business objectives
- Design scalable, modular solution patterns and integrate foundation models into enterprise environments
- Architect and implement agentic AI systems, including workflows, orchestration, and system integrations
- Establish robust cloud-native infrastructure and MLOps pipelines for deployment, monitoring, and lifecycle management
- Collaborate across teams, mentor colleagues, and contribute to innovation and thought leadership in AI
What We’re Looking For
- Bachelor’s or Master’s degree in Computer Science, AI/ML, or a related field
- 10+ years of experience in software architecture, including hands-on work with AI/ML systems
- Strong expertise in generative AI, foundation models, and agentic AI frameworks
- Proficiency in Python and experience with leading AI/ML frameworks and cloud platforms (AWS, Azure, or GCP)
- Proven ability to communicate complex technical concepts and influence technical decision-making
- WIllingness to work in our office 3 days/week
Bonus Points For
- Experience with prompt engineering and advanced RAG-based architectures
- Familiarity with vector databases and unstructured data processing techniques
- Experience implementing MLOps frameworks and production-grade AI systems
- Exposure to containerized and distributed systems (e.g., Kubernetes)
- Experience contributing to knowledge sharing, workshops, or external thought leadership
Why Join Capco
- Deliver high-impact technology solutions for Tier 1 financial institutions
- Work in a collaborative, flat, and entrepreneurial consulting culture
- Access continuous learning, training, and industry certifications
- Be part of a team shaping the future of digital financial services
- Help shape the future of digital transformation across FS & Energy
We offer a competitive, people-first benefits package designed to support every aspect of your life:
- Medical, dental, and vision coverage
- 401(k) with employer match
- Paid parental leave and dependent care support
- Tuition and wellness reimbursement programs
- Commuter benefits and access to employee discount platforms
Use of Artificial Intelligence in Talent Acquisition
At Capco, we use artificial intelligence (AI) tools to support and enhance several parts of talent acquisition. This includes using AI-enabled features within LinkedIn to help source potential candidates, speeding up routine recruitment communications such as emails and creating compelling and brand-aligned job postings that accurately reflect role requirements, and AI-scheduling applications to improve the efficiency of interview coordination.
AI is used as a support tool only. All hiring decisions are made by talent acquisition and hiring teams.
Inclusion at Capco
We’re committed to making our recruitment process accessible and straightforward for everyone. If you need any adjustments at any stage, just let us know – we’ll be happy to help. We value each person’s unique perspective and contribution. At Capco, we believe that being yourself is your greatest strength. Our #BeYourselfAtWork culture encourages individuality and collaboration – a mindset that shapes how we work with clients and each other every day.
We have been informed of several recruitment scams targeting the public. We strongly advise you to verify identities before engaging in recruitment related communication. All official Capco communication will be conducted via a Capco recruiter.
LI-MB1
LI-HYBRID
Skills Required
- Bachelor's or Master's degree in Computer Science, Artificial Intelligence, Machine Learning, or related quantitative field.
- 10+ years of progressive experience in software architecture.
- At least 2-3 years focused specifically on Generative AI and Machine Learning.
- Demonstrated expertise designing and implementing Generative AI and Agentic AI architectures.
- Hands-on experience with agentic AI frameworks (e.g., LangChain, LangGraph, CrewAI, AutoGen).
- Strong programming skills in Python.
- Experience with AI/ML frameworks such as TensorFlow and PyTorch.
- Experience with cloud platforms (AWS, Azure, GCP) and AI/ML services (SageMaker, Azure ML, Google Cloud AI Platform, Vertex AI).
- Experience designing and deploying cloud-native, containerized infrastructure (Kubernetes, ECS, EKS).
- Familiarity with MLOps principles and tools for model CI/CD and monitoring (e.g., MLflow, Kubeflow).
- Experience with vector databases and unstructured data ingestion (Pinecone, Weaviate, FAISS, Azure AI Search).
- Experience implementing Retrieval Augmented Generation (RAG) and mitigating hallucinations/bias in LLMs.
- Proven ability to integrate AI solutions with enterprise systems using RESTful APIs and microservices.
- Excellent communication, interpersonal, leadership, and mentoring skills.
- Willingness to work in the New York office three days per week.
What the Team is Saying
Capco Compensation & Benefits Highlights
-
Healthcare Strength — Health, dental, vision, EAP and fitness support are described as solid, reinforced by a global wellbeing program with mental‑health resources and financial‑wellness content.
-
Leave & Time Off Breadth — Vacation & Paid Time Off and Sick Leave are characterized as strong, with flexible, hybrid working and family‑friendly policies also highlighted.
-
Parental & Family Support — Parental leave is presented as a strong point alongside adoption, fertility and childcare benefits, with exact terms varying by country and role.
Capco Insights
What We Do
Capco, a Wipro company, is a global management and technology consultancy specializing in driving transformation in the energy and financial services industries. Capco operates at the intersection of business and technology by combining innovative thinking with unrivalled industry knowledge to fast-track digital initiatives for banking and payments, capital markets, wealth and asset management, insurance, and the energy sector. Capco’s cutting edge ingenuity is brought to life through its award-winning Be Yourself At Work culture and diverse talent. TRUSTED ADVISORS - Our collaborative and entrepreneurial approach position us as trusted long-term partners to our clients. DEEP EXPERTISE - Clients look to us for clear guidance, proven expertise, and the support they need to set their companies up for success. DISRUPTIVE SOLUTIONS- We do not provide off -the-shelf answers to clients’ challenges. Instead, we work in close collaboration to understand the issues, and craft disruptive, bespoke solutions. ACCOUNTABILITY AND OWNERSHIP - We recognize every client has distinct needs and expectations, and we take ownership and accountability for the solutions we design, build, and deliver.
Why Work With Us
We support and encourage an inclusive culture, entrepreneurial outlook and independent thinking. Capco is not about organizational charts and rigid hierarchies – we want all employees to feel that Capco is their firm to own and run. We believe diversity powers innovation. Be Yourself At Work (#BYAW) is an integral and underlying part of our culture
Gallery
Capco Offices
Hybrid Workspace
Employees engage in a combination of remote and on-site work.
