The Role
As a Senior Data Scientist, you will enhance AI solutions by developing evaluation datasets and pipelines, tuning retrieval performance, and collaborating with teams to improve model quality and user experience.
Summary Generated by Built In
The data-driven mind behind every breakthrough. Put your skills to the test to build AI solutions that shape the way businesses operate and innovate.
About Us
Ascent has recently been acquired by Acuity Analytics. This is both a significant milestone for us and a tremendous opportunity for you. Acuity Analytics is a business with a strong global reputation, an impressive client base and ambitious growth plans. We deliver deep insights and domain-led digital transformation to high-growth and heavily regulated organisations. To our customers, we bring a partnership that provides the talent, technology and capability to enhance performance and operational efficiency.
About the role
Join the AI Platform team to drive RAG retrieval relevance and LLM answer quality across emails and attachments.
Define evaluation datasets, labelling pipelines, metrics, and experiments to tune chunking, embeddings (Flamingo API), hybrid search, filtering, and citation grounding.
Your insights will directly improve model quality, retrieval performance, and end-user impact
About you
What you’ll do
Required skills
About Us
Ascent has recently been acquired by Acuity Analytics. This is both a significant milestone for us and a tremendous opportunity for you. Acuity Analytics is a business with a strong global reputation, an impressive client base and ambitious growth plans. We deliver deep insights and domain-led digital transformation to high-growth and heavily regulated organisations. To our customers, we bring a partnership that provides the talent, technology and capability to enhance performance and operational efficiency.
About the role
Join the AI Platform team to drive RAG retrieval relevance and LLM answer quality across emails and attachments.
Define evaluation datasets, labelling pipelines, metrics, and experiments to tune chunking, embeddings (Flamingo API), hybrid search, filtering, and citation grounding.
Your insights will directly improve model quality, retrieval performance, and end-user impact
About you
- Detail-oriented, hands-on, and metric-driven.
- Curious about LLMs, vector search, and retrieval systems.
- Collaborative with engineers, ETL teams, and business users.
- Comfortable designing evaluation pipelines and experiments.
- Strong communicator: turns feedback into actionable insights
What you’ll do
- Define evaluation sets across clients, content types, and languages.
- Build labelling pipelines and dashboards for manual or UI-based feedback.
- Measure and tune hybrid retrieval (semantic + keyword), top-k, rerankers, and filters.
- Evaluate embedding models and chunking strategies for accuracy and coverage.
- Assess LLM answer quality: grounded factuality, hallucination rate, completeness.
- Analyze failure patterns across queries, long contexts, attachments vs. emails.
- Collaborate with backend, ETL, and frontend teams to align telemetry, schema, and feedback capture.
- Translate user feedback into actionable metrics and backlog items.
- Evaluate cost/performance trade-offs for summarization, spillover, and indexing.
Required skills
- Applied ML/Data Science with strong evaluation discipline.
- Python (pandas, Jupyter/Notebooks) + SQL.
- Information retrieval / RAG evaluation: Recall@K, MRR, nDCG, citation grounding.
- Experience with LLMs: prompting, grounding, long-context handling, cost/latency awareness.
- Building reproducible pipelines and dashboards.
- Strong communicator: translating business questions into metrics and experiments.
- Hands-on with Azure AI Search vector/hybrid tuning, index schema.
- Experience designing human-in-the-loop annotation pipelines.
- Knowledge of enterprise access-control / security trimming.
- Experience tracking embedding drift and retrieval failures.
- Working with large-scale document/email datasets.
Why Join Us
People are at the Heart of our Business. By investing in people, we achieve exceptional results for our clients and create new opportunities for our teams to thrive. Check out this page for more details. Why Join Us
Skills Required
- Applied ML/Data Science with strong evaluation discipline
- Python (pandas, Jupyter/Notebooks) + SQL
- Information retrieval / RAG evaluation: Recall@K, MRR, nDCG, citation grounding
- Experience with LLMs: prompting, grounding, long-context handling, cost/latency awareness
- Building reproducible pipelines and dashboards
- Strong communicator: translating business questions into metrics and experiments
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
Ascent is a design-led software, data and cloud business that specialises in advanced analytics and AI. We design, build and manage cloud-native products, solutions, platforms and experiences on Azure. Our community of engineers, architects, data scientists, experience designers and consultants is here to help customers do something new, or do something better. Ascent is home to 450+ technology specialists across 5 key European locations (UK, Germany, Portugal, Malta and Bulgaria). Our talented, consultative teams deliver a range of solutions, from digital product and service design to mobile app development, API integrations, data engineering, AI and data science. Our modern app, data and infrastructure platforms help businesses leave legacy behind and enable rapid, efficient innovation
