AI Engineer

Posted 3 Days Ago
Long Island City, NY, USA
In-Office
91K-254K Annually
Entry level
Agency • Digital Media • Professional Services
The Role
Build and improve an internal AI agent platform using LLM APIs, tool calling, structured outputs, SQL, Python execution, and advertising APIs. Manage context, memory, guardrails, reliability, and evaluation frameworks while expanding document and workflow automation. Collaborate with machine learning, product, and full-stack teams to deliver robust AI applications and productivity tools.
Summary Generated by Built In

About the Role We are seeking an exceptional AI Engineer to join our growing team and take a leading role in building and evolving our internal AI-powered agent platform used across the organization.

In this role, you will design, build, and improve AI-powered applications that integrate large language models (LLMs) with internal tools, SQL databases, advertising APIs (Google Ads, Meta), and stateful code execution environments. You will play a critical role in improving reliability, context orchestration, evaluation maturity, and expanding Rai into document and workflow automation use cases.

Your work will directly impact 200–500 employees and potentially clients, making AI a core productivity multiplier across the organization.

Responsibilities include but are not limited to:

  • LLM Application Development Design, build, and maintain AI-powered applications leveraging LLM APIs, tool calling, and structured outputs.
  • Agent & Tool Orchestration Develop and improve agent architectures that integrate tools such as SQL execution, Python code execution, and marketing platform APIs through MCP-style integrations.
  • Context & Memory Management Design and refine multi-turn context handling, session memory strategies, and prompt structures to improve response reliability and reduce hallucinations.
  • Reliability & Guardrails Implement safeguards for tool execution, SQL queries, and code execution. Improve retry logic, structured validation, and hallucination mitigation strategies.
  • Evaluation & Quality Assurance Contribute to building structured evaluation frameworks for LLM-powered systems, including multi-turn testing, regression testing, and task-based success metrics.
  • Product Expansion Support expansion of Rai into document generation, tables, slide decks, and potential Google Workspace integrations.
  • Collaboration Work closely with Machine Learning Engineers, Product Managers, and Full-Stack Engineers to ensure AI systems are robust, maintainable, and aligned with business goals.
  • Continuous Innovation Stay current with advances in LLM systems, agent architectures, and applied AI tooling to continuously improve Rai’s capabilities.

Requirements

  • Strong programming skills in Python with experience building production systems.
  • Experience building applications powered by LLM APIs (OpenAI, Anthropic, Vertex AI, etc.).
  • Deep understanding of:
    • Context windows and token limits
    • Multi-turn conversation behavior
    • Tool/function calling
    • Structured outputs (JSON schema)
    • Prompt design and failure modes
  • Experience integrating external APIs into production systems.
  • Proficiency in SQL.
  • Experience working with cloud platforms (GCP, AWS, or Azure).
  • Strong problem-solving skills and ability to debug complex system behavior.
  • Excellent communication and cross-functional collaboration skills.

Strong Plus

  • Experience designing evaluation frameworks for LLM-powered systems.
  • Understanding of embeddings, vector search, and RAG architectures.
  • Experience building agent or multi-agent workflows.
  • Experience with stateful execution environments or sandboxed code execution.
  • Experience with document automation (Google Docs, Slides, PDFs).
  • Experience building internal developer tools or productivity platforms.
  • TypeScript.

Required knowledge of:

  • Python
  • SQL
  • Cloud Platforms (GCP, AWS, Azure)
  • LLMs / AI APIs
  • Git / GitHub

Nice to have:

  • Data Warehouses (BigQuery, Snowflake, Redshift)
  • Data Transformation (dbt)
  • Semantic Layers (Cube, Looker, dbt Metrics)
  • TypeScript

Our interview process includes, but is not limited to the following:

  • Excel and Typing Test

We offer a competitive salary and benefits based on ability level, including:

  • Unlimited vacation policy
  • Monthly Phone Stipend
  • Comprehensive Medical, Dental, and Vision insurance options
  • 401(K) plan with matching
  • Dog friendly office
  • Hybrid work opportunity
  • Professional Development Program
  • Bonus Perk - Seamless allowance

Total compensation based on education, experience, and skills level ($90,900-$254,100)

  • Level 1 - Possesses essential capabilities

    • $90,900-$123,540

  • Level 2 - Possesses developing capabilities

    • $123,540-$156,180

  • Level 3 - Possesses notable capabilities.

    • $156,180-$188,820

  • Level 4 - Possesses strong capabilities.

    • $188,820-$221,460

  • Level 5 - Possesses advanced capabilities.

    • $221,460-$254,100

About WITHIN

WITHIN is the world's first Performance Branding company, partnering with some of the biggest brands in the world to drive business growth through innovative marketing strategies. Our integrated operating model collapses the traditional marketing silos between creative and media, performance and brand, and across media channels. With a full suite of offerings including media, creative, SEO, Lifecycle, Retail Media, Affiliate and Influencer, we’re able to work with our brand partners in an integrated fashion, allowing us to align marketing strategies back to core business objectives. Client teams at WITHIN are trained on how to always act as a trusted business partner, acting as a fiduciary to client needs above our own.

Teams at WITHIN have the ability to work with iconic brands such as The North Face, Timberland, Ben and Jerry's and Jose Cuervo. Everyone at WITHIN wants to grow and be challenged. It’s a collaborative place made up of small, closely knit and versatile teams that are fast and adaptive to solve problems and build systems.

Check out some of our work!

We weave AI into everything we do, using the latest tech across all teams to innovate, work smarter, and make better decisions. Whether it’s in creative, operations, or anything else, AI helps us level up and do things at a whole new scale. We expect our people to use AI in their daily work, fully embracing it as a critical tool to help us succeed. 

Join Our Network!

Stay connected with us and be the first to know about new opportunities, industry insights, and updates.

Follow us on:

  • LinkedIn
  • WhatsApp Community
  • Instagram
  • Tik Tok

Locations

  • New York City: 43-01 22nd St, Suite 602, Queens, NY 11101, United States
  • Bogotá: WeWork Av. Carrera 19 #100-45 Usaquén, Piso (Floor) 10, Bogotá, Distrito Capital de Bogotá 110111, Colombia
  • Mexico City: Av. Insurgentes Sur 1082, Piso (Floor) 2, Oficina 2008, Ciudad de México, CDMX 03100, México

AI-Assisted Screening Notice
As part of our initial application review process, we may use an AI-assisted tool to help compare skills and job titles from your resume with the requirements of the role. This tool evaluates information based on contextual relevance and is used only to support our manual review process. It is not used to make hiring decisions.
If you are a resident of New York City and would like to request an alternative evaluation process or a reasonable accommodation, please contact us at 315-533-2388.

Skills Required

  • Strong programming skills in Python with experience building production systems
  • Experience building applications powered by LLM APIs, including OpenAI, Anthropic, or Vertex AI
  • Understanding of context windows and token limits
  • Understanding of multi-turn conversation behavior
  • Understanding of tool or function calling
  • Understanding of structured outputs and JSON schema
  • Understanding of prompt design and failure modes
  • Experience integrating external APIs into production systems
  • Proficiency in SQL
  • Experience working with cloud platforms such as GCP, AWS, or Azure
  • Strong problem-solving skills and ability to debug complex system behavior
  • Excellent communication and cross-functional collaboration skills
  • Experience designing evaluation frameworks for LLM-powered systems
  • Understanding of embeddings, vector search, and RAG architectures
  • Experience building agent or multi-agent workflows
  • Experience with stateful execution environments or sandboxed code execution
  • Experience with document automation, including Google Docs, Slides, or PDFs
  • Experience building internal developer tools or productivity platforms
  • TypeScript
  • Knowledge of Git and GitHub
  • Knowledge of data warehouses such as BigQuery, Snowflake, or Redshift
  • Knowledge of data transformation tools such as dbt
  • Knowledge of semantic layers such as Cube, Looker, or dbt Metrics
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
325 Employees
Year Founded: 2015

What We Do

WITHIN is a digital-first, integrated media and creative agency that combines performance marketing, brand strategy, media, commerce, and in-house creative capabilities. Its Performance Branding framework aligns marketing objectives across the customer journey to help innovative brands drive measurable, profitable growth. The company works as a trusted business partner for global clients across North America, Europe, and Australia.

Similar Jobs

PwC Logo PwC

Site Reliability Engineer

Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
Hybrid
9 Locations
370000 Employees
124K-280K Annually

PwC Logo PwC

Site Reliability Engineer

Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
Hybrid
9 Locations
370000 Employees
99K-232K Annually

Capital One Logo Capital One

Artificial Intelligence Engineer

Fintech • Machine Learning • Payments • Software • Financial Services
Hybrid
4 Locations
55000 Employees
230K-286K Annually

Capital One Logo Capital One

Artificial Intelligence Engineer

Fintech • Machine Learning • Payments • Software • Financial Services
Hybrid
3 Locations
55000 Employees
162K-201K Annually

Similar Companies Hiring

Hedra Thumbnail
Software • News + Entertainment • Marketing Tech • Generative AI • Enterprise Web • Digital Media • Consumer Web
San Francisco, CA
14 Employees
Bankrate Thumbnail
Artificial Intelligence • Consumer Web • Digital Media • Fintech • Marketing Tech • Software • Financial Services
US
160 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account