PolyAI is a leader in automating customer service through innovative voice technology. Our voice assistants empower businesses to deliver exceptional customer service at every interaction.
This is an exciting position as we are building a new team within the Engineer function. This team will focus on the application of the latest technology into our product.
In this role, you will work on building software to enhance the visibility and configurability of large language models (LLMs). You will be responsible for rapidly developing tools and platforms to evaluate, iterate, and productionalize models, ensuring their reliability and accuracy.
We are looking for the right candidate, and therefore are flexible on the levelling for this position ranging from mid- level to senior!
Responsibilities:
- Must have at least 4 years of Python experience
- Must have at least 4+ years working experience
- Develop software that provides visibility into LLM models and offers configurability for tuning and evaluation.
- Take a hands-on approach to quickly prototype, test, and iterate on solutions, moving from proof-of-concept to production.
- Employ a data-driven methodology to drive model accuracy, leveraging evaluation results to inform decisions.
- Collaborate with cross-functional teams to integrate developed tools and ensure they meet production standards.
- Communicate findings and ranking metrics clearly to both technical and non-technical stakeholders.
Why Join Us:
Join a dynamic and innovative team at the forefront of LLM development. You will have the opportunity to work on challenging projects, rapidly build impactful solutions, and drive data-informed improvements that push the boundaries of what LLMs can achieve.
- Open to feedback and happy to work in an iterative position
- Degree in Computer Science or related field, or equivalent experience.
- Strong proficiency in Python
- Experience developing evaluation suites, datasets, and data-driven tools for model reliability testing.
- Ability to rapidly prototype and iterate on solutions while maintaining a focus on production-level quality.
- Strong problem-solving skills and a creative mindset
- Familiarity with cloud platforms such as AWS, GCP, or Azure is a plus.
💰 Participation in the company’s employee share options plan
🏝 25 days holiday, plus bank holidays
🏡 Flexible working from home policy plus a one-off WFH allowance when you join
🌎 Work from outside of the UK for up to 6 months each year
🧡 Enhanced parental leave
📚 Yearly learning budget
🚲 Bike2Work scheme
📚 Annual learning and development allowance
🏡 One-off WFH allowance when you join
Company-funded fertility and family-forming programmes
Menopause care programme with Maven
🏥 Private healthcare and dental cover, discounts on gym members and relaxation apps, and access to a range of mental health programs
Equal Opportunity Statement:
PolyAI is proud to be an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.
All employment decisions at PolyAI will be based on the business needs without attention to ethnicity, religion, sexual orientation, gender identity, family or parental status, national origin, neurodiversity status or disability status.
Top Skills
What We Do
PolyAI builds enterprise conversational assistants that carry on natural conversations with customers to solve their problems. Our conversational assistants understand customers, regardless of what they say or how they say it.