Responsibilities:
- Improve and optimize critical LLM inference pipelines to generate high-quality deal assessments while maintaining cost efficiency.
- Develop and implement new AI features, such as integrating external data sources (e.g., company news) into deal risk assessments.
- Enhance monitoring systems to improve pipeline visibility, accelerate debugging, and reduce failure resolution time by 50%.
- Scale inference pipelines effectively to handle increased volumes, targeting 5 million AI-generated insights monthly.
- Write clean, maintainable, and well-documented code, following engineering best practices.
- Build tooling to enable customer support teams to independently resolve common issues.
- Demonstrate behaviors consistent with our Engineering Leveling Guidelines.
Requirements:
- 3+ years professional experience developing distributed systems in a cloud environment (AWS preferred).
- Strong experience analyzing large structured and unstructured datasets.
- Proficiency with Spark or equivalent big data processing engines (Hive, Hadoop, MapReduce, Storm, Samza).Experience using Large Language Models (LLMs), familiarity with prompting techniques (chain-of-thought, RAG), and knowledge of common market models.
- Understanding of LLM limitations and strategies to mitigate them.
- Proven problem-solving abilities, with practical and elegant coding solutions.
- Passionate about engineering excellence—advocates for high-quality, reliable, and maintainable software.
- Experience improving existing codebases, automation, and tooling for operational efficiency.
- Bachelor’s Degree in Computer Science, Computer Engineering, or closely related discipline.
- Familiarity with Elasticsearch and Kafka.
- Experience with fine-tuning or advanced inference techniques for LLMs.
Similar Jobs
What We Do
People.ai delivers the industry’s leading ROI (Revenue Operations and Intelligence) platform. Using patented AI technology, it transforms business activity data into recommendations that increase the impact of Sales, Marketing, and Operations. Companies such as Zoom, New Relic and PTC rely on People.ai to increase marketing ROI and grow revenue. People.ai automatically captures and analyzes business activity data including email, contacts, and meetings from GTM teams, auto-populating CRM and systems of record. With People.ai's data platform, sales, marketing, and revenue operation teams gain unprecedented visibility into the health of their business with AI-generated insights that increase rep productivity, drive strategic coaching sessions, and deliver predictable growth quarter after quarter.
Why Work With Us
Taking care of our people enables us to serve our customers. We believe each of our customers’ problems has a data-driven solution. Through end-to-end ownership, we aim to find creative and ambitious solutions to those problems.
Gallery







