Caravel | BPM Technology Solutions
AI Prompt Developer
AI Practice / Emerging Technology (TSS) · Full-time · Fully remote — South America · Reports to: AI Practice Lead
About CaravelCaravel | BPM Technology Solutions is an award-winning NetSuite and Salesforce partner and part of BPM LLP, a Top-40 accounting and advisory firm. For 20+ years and 1,000+ implementations we've helped businesses across North America put the right technology to work — honestly, and without the usual consulting theater. We're a fully remote team with delivery centers across the US, Canada, India, and the Philippines, and we're standing up an AI practice to match.
About the roleAs an AI Prompt Developer at Caravel, you'll build the production layer of our AI practice — the prompts, prompt chains, and LLM-driven components that power client solutions and the internal accelerators our consultants rely on. You'll partner with our AI Specialists to turn solution designs into reliable, evaluated, production-ready builds. This is a hands-on build role for someone who cares about getting model behavior right, not just getting it to run.
What you'll do- Design, build, test, and iterate on prompts and prompt chains for production LLM workflows across client delivery and internal automation.
- Implement evaluation harnesses, guardrails, and regression tests so output quality is measurable and stays stable over time.
- Integrate LLM components with business systems and data — APIs, retrieval/RAG pipelines, and structured outputs.
- Partner with AI Specialists to convert solution designs into production builds, and document patterns for reuse.
- Tune for accuracy, cost, latency, and safety against real evaluation data — not vibes.
- Grow Caravel's library of reusable AI accelerators.
- 2+ years building software or AI/LLM components, including hands-on experience crafting and iterating prompts for real applications.
- Working knowledge of LLM fundamentals: context windows, few-shot prompting, function/tool calling, structured outputs, and RAG basics.
- Proficiency in Python (or similar) and comfort with APIs, JSON, and version control (Git).
- A test-and-measure mindset — you evaluate output quality, you don't eyeball it.
- Clear written English and strong documentation habits.
- Ability to collaborate across time zones with an onshore/nearshore team.
- Experience with evaluation frameworks (e.g., promptfoo, Ragas, or custom eval harnesses).
- Familiarity with embeddings, vector databases, and retrieval pipelines.
- Exposure to ERP/CRM ecosystems (NetSuite, Salesforce) or business-process automation.
- Experience with agentic frameworks and orchestration.
Full-time, fully remote within South America, with daily overlap with US business hours to collaborate with the AI Specialist team.
Why CaravelYou'll help build a brand-new AI practice inside a firm with two decades of delivery credibility — real client problems, real production systems, and a team that would rather tell you the truth than sell you a demo.
Compensation & benefitsCompetitive base commensurate with experience, a fully remote setup, and the opportunity to help shape a new AI practice from the ground up.
Skills Required
- 2+ years building software or AI/LLM components, including hands-on prompt crafting
- Working knowledge of LLM fundamentals (context windows, few-shot prompting, function/tool calling, structured outputs, RAG)
- Proficiency in Python (or similar) and comfort with APIs, JSON, and version control (Git)
- Test-and-measure mindset with evaluation and regression testing practices
- Clear written English and strong documentation habits
- Ability to collaborate across time zones with onshore/nearshore teams
- Experience with evaluation frameworks (promptfoo, Ragas, custom harnesses)
- Familiarity with embeddings, vector databases, and retrieval pipelines
- Exposure to ERP/CRM ecosystems (NetSuite, Salesforce) or business-process automation
- Experience with agentic frameworks and orchestration
BPM LLP Compensation & Benefits Highlights
The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about BPM LLP and has not been reviewed or approved by BPM LLP.
-
Leave & Time Off Breadth — Policies include generous PTO, multiple firm holidays, and seasonal breaks, with unlimited PTO available for certain roles. Feedback suggests these options enhance overall value even in a demanding industry.
-
Healthcare Strength — Multiple medical, dental, and vision plan choices are offered with a strong employer-paid share, alongside HSA options and mental-health resources. Feedback suggests the breadth and depth of coverage are a core strength of the package.
-
Flexible Benefits — Flexible and remote/hybrid work options are emphasized, along with alternative schedules. Feedback suggests this flexibility is a meaningful component of total rewards.
BPM LLP Insights
What We Do
BPM LLP is one of the 50 largest public accounting and advisory firms in the country. With more than 800 professionals along the West Coast – as well as offices abroad – we help clients succeed around the world. We offer a cross-functional team approach that gives clients direct access to the best and most qualified resources. With full-service capabilities in audit, tax and advisory services, we possess in-depth knowledge of the transactional industry—its key processes, challenges surrounding growth and performance, regulatory compliance and governance—and the many other complex accounting and reporting issues you face. Our collective knowledge representing a diverse client base allows us to serve as experts in over a dozen industries. In 2021, we are proud to be named by Forbes “Best Tax and Accounting Firms” and #22 on Vault’s “Accounting 50” ranking! We invite you to learn more about us, visit bpmcpa.com
