Sr. AI Software Engineer

Join Invoca: Driving Innovation in AI

At Invoca, we don't just talk about commitment to our customers, collaboration, and continuous improvement—it's how we live and work. We foster an inclusive, egoless culture that fuels innovation and creates value for both our customers and our people. Joining us means enjoying competitive pay, excellent perks, and working on an industry-leading product. If you're looking for a tech job that stands out, you've found it. Come help us build something truly special.

As an AI-First organization, successful candidates must have a strong aptitude for or foundational experience with AI/ML frameworks. Our teams are at the forefront of innovation, deploying agentic AI workflows and advanced Retrieval-Augmented Generation (RAG) integration to power the next generation of our intelligent, API-driven solutions.

About the Engineering Team

When you join the Engineering Team, you become part of a highly supportive community dedicated to continuous improvement in software development tools, practices, and processes. We thrive on collaboration, swarming to solve complex problems, and providing constructive feedback that helps everyone grow.

Our close-knit, multi-functional teams offer a unique opportunity to share and expand your expertise across various domains—from databases and front ends to telephony and everything in between. We are passionate about:

• Continuous improvement
• Working at a brisk, yet sustainable pace
• Writing resilient code
• Maintaining production reliability
• Strategically paying down technical debt
• Hiring and growing fantastic teammates

Learn more about the Invoca development team on our blog and explore our open source projects.

Are you passionate about harnessing the power of generative AI and foundation models to build truly intelligent products? At Invoca, we're a team of innovators committed to building exceptional teams and groundbreaking AI solutions. This is a unique opportunity to architect the next generation of AI-powered customer experiences, making a direct and measurable impact on our products and the success of our clients.

As a key member of our AI Engineering team, you won't just build models; you'll architect the future of how businesses understand and interact with their customers through robust software engineering and product development. You will:

• Architect and Deploy Applied AI Systems: Design, build, and deploy scalable, production-grade applications using foundation models and other advanced AI techniques, directly influencing product performance and efficiency through strong software engineering practices.
• Engineer Advanced Agentic AI Workflows & Frameworks: Go beyond basic implementation. Engineer robust Retrieval-Augmented Generation (RAG) pipelines and multi-step agentic workflows that can reason, use tools, and solve complex product problems.
• Contribute to Agentic AI System Evaluation: Establish and manage rigorous evaluation frameworks for complex AI agents. You will go beyond simple response quality to assess the entire agentic process, including the validity of reasoning steps, correctness of tool use, task completion rates, and overall robustness, contributing to the continuous improvement of our products.
• Excel in Prompt Engineering and Optimization: Craft, test, and manage sophisticated prompt chains and templates to ensure optimal performance, reliability, and cost-effectiveness from our AI models, driving product innovation.
• Build for Scale and Reliability: Develop resilient serving architectures that seamlessly integrate Large Language Models (LLMs) with enterprise systems, ensuring high availability and performance through expert software engineering.
• Champion MLOps for Applied AI: Develop and maintain sophisticated MLOps and CI/CD pipelines tailored for the unique challenges of generative AI, including prompt versioning, RAG pipeline management, and continuous evaluation of agent behavior, ensuring product quality and efficiency.
• Translate Business Needs into AI-Powered Solutions: Work as a strategic partner to product and engineering teams, deeply understanding customer challenges and translating them into innovative, viable, and impactful AI features, driving product development from conception to deployment.

At Invoca, Applied AI Engineers are empowered by mentorship from leading experts across our data science, engineering, and architecture teams. Our dedicated data platform team leverages a powerful combination of proprietary, patented technologies and best-in-class vendor tools to create an exceptionally scalable AI application platform. Our goal is to seamlessly deliver transformative AI-powered experiences through our robust API platform, and your expertise will contribute significantly in accelerating this mission.

We're looking for a creative and driven Applied AI Engineer who is excited to tackle complex problems and build impactful solutions through strong software engineering and product development. You likely have:

• Proven Experience: 5+ years of professional experience in Applied AI Engineering, ML Engineering, or a closely related role with a strong focus on building and deploying AI-powered products and applications, demonstrating a strong foundation in software engineering.
• Applied AI & Python Expertise: Advanced proficiency in Python and hands-on experience building applications with leading AI/ML frameworks (e.g., LangChain, LlamaIndex, CrewAI, PyTorch). You are an expert with data and ML libraries (e.g., Pandas, spaCy), applying these skills to product development.
• Production Generative AI Champion: Demonstrated success deploying and maintaining applications powered by LLMs and other generative models in a production environment, highlighting your product development and software engineering capabilities.
• Retrieval-Augmented Generation (RAG) Expertise: Deep, hands-on experience designing, building, and optimizing RAG pipelines, including expertise in vector databases (e.g., Qdrant, Pinecone, Weaviate), embedding strategies, and chunking techniques, as applied to agentic AI workflows.
• Agentic AI System Evaluation Expertise: Demonstrable experience with modern evaluation techniques for multi-step AI agents. You should be able to speak to the trade-offs of evaluating reasoning traces, tool usage, and final outcomes using frameworks like LangSmith, DeepEval, Ragas, TruLens, or custom-built solutions, showcasing your understanding of agentic AI frameworks.
• Prompt Engineering & In-Context Learning: Demonstrable skill in designing, testing, and optimizing complex prompts and few-shot examples to maximize model performance for specific tasks, crucial for developing effective agentic AI workflows.
• Fine-Tuning Proficiency: Experience in fine-tuning foundation models for specific downstream tasks, with a clear understanding of when to fine-tune versus when to use in-context learning or agentic approaches, demonstrating your expertise in agentic AI frameworks.
• Scalable Model Serving: Advanced proficiency with API-driven frameworks for accessing and serving self-hosted foundation models (e.g., AWS SageMaker/Bedrock, Databricks Model Serving, TGI, vLLM), focusing on building resilient, scalable, and optimized integrations through strong software engineering.
• Performance and Cost Optimization: A proven ability to optimize AI systems for low latency and high throughput. You have experience with techniques like model quantization, caching strategies, and infrastructure choices to manage and reduce operational costs, demonstrating your product development and software engineering skills.
• MLOps for AI Systems: Intermediate proficiency with MLOps tooling (e.g., MLFlow, Arize), and best practices for CI/CD, monitoring, and maintenance of complex AI systems, essential for managing agentic AI workflows in production.
• Educational Foundation: Bachelor's Degree in Computer Science, Engineering, Statistics, or a related field (or equivalent practical experience). An advanced degree (Master's or Ph.D.) is a plus, providing a solid foundation for software engineering and product development.

This role is remote and open to candidates located in the United States and Canada only. Please note that we are unable to provide visa sponsorship for this position.

At Invoca, all new hires in the U.S. receive benefits starting on day one of employment. Our benefits offerings include:

Please note that benefits for teammates outside the U.S. may vary in accordance with their country’s laws and regulations.

• Flexible Time Off – We encourage a healthy work-life balance. Our flexible paid time off policy allows you to recharge and take time away as needed.
• Paid Holidays – Invoca provides 16 U.S. paid holidays, including a winter break, giving you ample opportunity to refresh and spend time with friends and family.
• Health Benefits – Our healthcare program includes medical, dental, and vision coverage, with multiple plan options so you can choose what works best for you and your family. Fertility assistance is also included.
• Retirement – Invoca offers a 401(k) plan through Fidelity with a company match of up to 4%.
• Stock Options – All employees are invited to share in Invoca’s success through stock options.
• Mental Health Program– Well-being support on a broad range of issues is available through our SpringHealth program.
• Paid Family Leave – Up to 6 weeks of 100% paid leave is provided for baby bonding, adoption, and caring for family members.
• Paid Medical Leave – Up to 12 weeks of 100% paid leave is provided for childbirth and medical needs.
• InVacation – As a thank-you to our long-term team members, we offer a bonus after 7 years of service.
• Wellness Subsidy – We provide a subsidy that can be applied toward gym memberships, fitness classes, and more.
• Position Base Range - Salary Range $160,000 - $252,000/ plus bonus potential

Our company is committed to creating a culture that is not only grounded in continuous learning, teamwork, and customer success, but is fair, equitable, and welcoming for everyone.” Gregg Johnson CEO

And to us, diversity and inclusion means even more than treating current employees well and making them feel welcome. It also means proactively hiring people who bring different insights because of their unique demographics, ways of thinking, and prior experiences.

We intend to continue hiring great people and protecting our culture so everyone can be themselves and speak their minds. That way Invoca will always be a place filled with laughter, energy, hard work, thoughtfulness and respect.

We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.

We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender, gender identity or expression, or veteran status. We are proud to be an equal opportunity workplace.

#LI-Remote