AI Engineer - Agent Infrastructure & AI Workflow

Posted 4 Hours Ago
Hiring Remotely in USA
Remote
Entry level
Software
The Role
Build and operate AWS-based infrastructure for long-running AI agent pipelines and AI-enabled software development workflows. Responsibilities include orchestration, multi-model inference, evaluation, semantic caching, observability, secure deployment, CI/CD, infrastructure as code, agent tooling, dashboards, and operational runbooks. The role collaborates with product and delivery teams to create reliable, measurable AI services and explain system behavior, risks, and trade-offs to stakeholders and clients.
Summary Generated by Built In
Shape the Future with TribalScale

TribalScale is a digital innovation firm that helps organizations adapt and thrive in a rapidly changing world. We partner with clients to build transformative digital products, modernize technology platforms, and apply emerging technologies—including artificial intelligence—to meaningful business challenges.
Our teams work closely with clients from strategy through execution. We value curiosity, ownership, practical innovation, and people who are comfortable turning ambiguity into action.

Our Digital Expertise

  • Transformation Experts: We transform traditional business models into agile, AI-powered ecosystems.
  • Strategic Visionaries: We navigate the uncharted waters of technological evolution.
  • Product Virtuosos: We orchestrate the creation of world-class digital solutions.
  • Code Optimizers: We leverage AI to refine and perfect digital systems.

Our Technological Toolkit

  • Mobile & Web Development: (iOS, Android, React Native, React, Node.js)
  • Voice-Activated Platforms: (Amazon Alexa, Google Home)
  • Connected Ecosystems: (Cars and Homes)
  • Streaming Platforms: (Roku, Fire TV, Android TV, tvOS)

The TribalScale Professional

You thrive in challenging environments where innovation is key. Your passion for technology is matched only by your drive to redefine its limits. You seek more than a job; you seek a calling—a chance to make a lasting impact on the digital landscape.

The Opportunity

We are looking for a talented and driven developer to join a client of TribalScale's team and build the shared, cloud native agent infrastructure on AWS that our AI-assisted modeling pipeline and our internal AI-enabled development workflow run on. A client of TribalScale, builds virtual Arm devices: phones, IoT boards and automotive controllers that run real, unmodified firmware on a client of TribalScale’s CHARM hypervisor. Atlas is our product for virtual IoT, automotive and embedded hardware. Today each new device model takes a team of modeling engineers weeks of reading reference manuals and hand-writing peripheral models. We are building an AI-assisted modeling pipeline that collects vendor documentation, extracts per-peripheral specifications, generates register and system definitions, synthesizes behavioral C code, and validates the result by booting vendor firmware. We use it on our own bring-ups first, then hand it to Atlas partners so they can build and validate their own models.

This role sits on our AI & SDLC Platform team, which supplies agent infrastructure and AI platform support to the delivery teams. Model Delivery owns the modeling backlog and its outcomes. You own the substrate that pipeline runs on: job orchestration, multi-model inference, evaluation hooks, observability and secure deployment. Your work takes the pipeline from an engineer-run prototype to a reliable, measured service. You apply the same infrastructure to replace parts of our internal software development process with AI-enabled workflows.

 
What You’ll Do
  • Design and implement orchestration for long-running agent pipelines on AWS: job orchestration, artifact and manifest generation, checkpointing, retries, and prompt and model versioning.
  • Run multi-model inference across Amazon Bedrock and self-hosted models, with routing, an independent judge model, semantic caching and token-cost and latency controls. 
  • Provide shared evaluation and tracing hooks so Model Delivery can measure each pipeline stage and compare models, prompts and pipeline versions. 
  • Build and operate the internal AI gateway, agent runtime and tool integrations that engineers use in the AI enabled SDLC: code review, ticket-to-merge-request workflows and knowledge retrieval.
  • Develop and maintain CI/CD pipelines and infrastructure as code (Terraform or CDK) with secure secrets management and least-privilege access.
  • Instrument agents and pipelines (success rate, cost, latency, failure modes) and maintain dashboards, alerts and runbooks. 
  • Work with the product teams that own customer-facing MCP and API surfaces so internal agent tools and product interfaces stay consistent. 
What You Bring
  • Hands-on experience with AWS services including Bedrock, Lambda, ECS or EKS, S3 and Step Functions. 
  • Experience with GenAI infrastructure: LLM integration, agent frameworks, MCP, semantic caching and LLM evaluation. 
  • Familiarity with Amazon EKS and Kubernetes-based deployments. 
  • Familiarity with GitHub/GitLab workflows, secrets management and secure deployment practices. •  
  • Knowledge of observability tools like Datadog and log aggregation strategies. 
  • Ability to write clean, maintainable code and contribute to shared documentation and best practices.
  • Experience collaborating directly with customers, stakeholders, or cross-functional delivery teams.
  • Excellent written and verbal communication skills, including the ability to explain AI-system behavior, limitations, risks, and technical trade-offs clearly.
  • Comfort working in fast-moving environments where requirements and technical constraints continue to evolve.
  • A high degree of ownership, curiosity, empathy, and bias toward action.
  • Ability to travel occasionally for client workshops or on-site delivery, where required.
We recognize that strong candidates may not meet every qualification listed. If this role excites you and your experience is adjacent to what we have described, we encourage you to apply.
 
Nice to Have
  • Experience with Agentic AI Frameworks: Hands-on experience with LangChain, LangGraph, CrewAI, AutoGen, or similar frameworks for building and orchestrating AI agents.
  • Advanced AWS Experience: Experience optimizing AI workloads using Amazon Bedrock, SageMaker, or other AWS AI/ML services.
  • Multi-Model LLM Experience: Experience integrating and managing multiple LLM providers, including OpenAI, Anthropic Claude, and open-source models.
  • AI-Assisted Development Tools: Familiarity with Claude Code, Cursor, GitHub Copilot, or similar AI-powered development tools.
  • LLM Evaluation & Observability: Experience with tools such as LangSmith, Langfuse, Arize Phoenix, or similar platforms for monitoring and evaluating AI systems.
  • Embedded Systems & Virtualization: Exposure to Arm architectures, firmware development, IoT devices, hypervisors, or hardware virtualization.
  • Model Context Protocol (MCP): Experience building MCP servers, integrating external tools, or developing reusable agent tooling.
  • Infrastructure Scalability: Experience with distributed systems, Kubernetes, container orchestration, and scaling production AI workloads.
  • AI Workflow Automation: Experience automating software development processes, including code generation, automated testing, code reviews, and CI/CD workflows.
  • Open-Source Contributions: Contributions to open-source AI frameworks, developer tools, or cloud infrastructure projects.
What Success Looks Like
In your first few months, you will have built trusted relationships with client and TribalScale teams, developed a strong understanding of the client’s operating environment, and contributed working software to a meaningful business challenge.

As you grow in the role, you will:
  • Turn loosely defined client needs into clear, executable technical plans.
  • Deliver AI-enabled products that perform reliably outside of controlled demonstrations.
  • Establish evaluation and observability practices that make quality measurable and regressions visible.
  • Improve agent behavior by refining harnesses, loops, tools, graphs, context, and safeguards—not only by changing prompts or models.
  • Help client teams understand what their AI systems can do, where they can fail, and how they should be operated responsibly.
  • Create reusable technical patterns that accelerate future TribalScale engagements.
  • Become a trusted partner who can navigate uncertainty, solve difficult technical problems, and help promising ideas reach production.
Why TribalScale
  • Work on high-impact challenges across industries and technology domains.
  • Build real products and production systems—not just recommendations or presentations.
  • Work directly with clients and see the impact of your decisions.
  • Explore emerging approaches to AI, agentic systems, product development, and software delivery.
  • Collaborate with multidisciplinary teams that value experimentation and continuous learning.
  • Influence both client outcomes and TribalScale’s evolving technical practices.
  • Join an environment where ownership, diverse perspectives, and thoughtful innovation are encouraged.

Why Choose TribalScale

At TribalScale, collaboration is at the heart of our innovative approach. We don't simply work for clients; we form partnerships, building transformative solutions that redefine what's possible. Our team, once at the forefront of the mobile revolution, now leads the charge in AI-driven innovation.

We empower each team member to be a catalyst for change, adhering to our principles of meritocracy, empowerment, and transparency. Diversity isn't just celebrated—it's fundamental to our strength. Our mission to "Right the Future" is a call to action to make a significant impact in the world of innovation.


Diversity: Our Collective Strength

TribalScale proudly stands as a beacon of equal opportunity in employment and workplace culture. We are steadfastly committed to equal employment opportunity, transcending the boundaries of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, able-bodiedness, or gender identity.

We not only welcome but actively encourage applications from individuals of all abilities, ages, citizenships, marital statuses, and gender identities. Your unique perspective is the key to our collective innovation.

Should you require any accommodations, we implore you to inform us. Our commitment to inclusivity knows no bounds, and we stand ready to adapt our processes to ensure your comfort and success.


Skills Required

  • Hands-on experience with AWS services including Bedrock, Lambda, ECS or EKS, S3, and Step Functions
  • Experience with generative AI infrastructure, including LLM integration, agent frameworks, MCP, semantic caching, and LLM evaluation
  • Familiarity with Amazon EKS and Kubernetes-based deployments
  • Familiarity with GitHub or GitLab workflows, secrets management, and secure deployment practices
  • Knowledge of observability tools such as Datadog and log aggregation strategies
  • Ability to write clean, maintainable code and contribute to shared documentation and best practices
  • Experience collaborating directly with customers, stakeholders, or cross-functional delivery teams
  • Excellent written and verbal communication skills, including explaining AI-system behavior, limitations, risks, and technical trade-offs
  • Ability to travel occasionally for client workshops or on-site delivery
  • Experience with agentic AI frameworks such as LangChain, LangGraph, CrewAI, or AutoGen
  • Advanced AWS experience with Bedrock, SageMaker, or other AWS AI/ML services
  • Experience integrating multiple LLM providers, including OpenAI, Anthropic Claude, and open-source models
  • Familiarity with AI-assisted development tools such as Claude Code, Cursor, or GitHub Copilot
  • Experience with LLM evaluation and observability platforms such as LangSmith, Langfuse, or Arize Phoenix
  • Exposure to Arm architectures, firmware development, IoT devices, hypervisors, or hardware virtualization
  • Experience building MCP servers, integrating external tools, or developing reusable agent tooling
  • Experience with distributed systems, Kubernetes, container orchestration, and scaling production AI workloads
  • Experience automating software development processes, including code generation, automated testing, code reviews, and CI/CD workflows
  • Contributions to open-source AI frameworks, developer tools, or cloud infrastructure projects
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Toronto
89 Employees
Year Founded: 2015

What We Do

We build digital products and transform businesses. We help the world’s largest enterprises and best entrepreneurs identify strategic opportunities to build, design, and release cutting-edge technology solutions to benefit their customers. All services under one roof: strategy, design, development, and QA. We are fluent across platforms. Whether it be building cloud-native applications, refactoring code, creating web, mobile, in-vehicle Voice apps, connecting businesses to their users, or improving accessibility, we've done it all. We'll help you and your team create and release digital products that benefit your business, and your users. Not a massive development shop, VC firm, or design agency. But a unique group of skilled individuals, all feeding on one another's talent.

Similar Jobs

Whatnot Logo Whatnot

Ios Engineer

Consumer Web • eCommerce • Mobile • Retail • Social Media • Software
In-Office or Remote
3 Locations
1200 Employees

Whatnot Logo Whatnot

Operations Manager

Consumer Web • eCommerce • Mobile • Retail • Social Media • Software
In-Office or Remote
2 Locations
1200 Employees

Whatnot Logo Whatnot

Trust & Safety Agent

Consumer Web • eCommerce • Mobile • Retail • Social Media • Software
In-Office or Remote
Culver City, California, USA
1200 Employees

Whatnot Logo Whatnot

Staff Software Engineer

Consumer Web • eCommerce • Mobile • Retail • Social Media • Software
In-Office or Remote
3 Locations
1200 Employees

Similar Companies Hiring

Ford Energy Thumbnail
Automotive • Software • Energy • Utilities • Manufacturing • Renewable Energy
US
Revel Thumbnail
Aerospace • Hardware • Robotics • Software
Marina Del Rey, California
70 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
33 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account