In YouGov Shopper, we believe that constant innovation is the key to improve the pertinence and quality of the data that we receive from our consumer panel members and app users.
Our team’s goal is to reduce the associated workload by increasing automation. We achieve this by combining panelist data with a large variety of additional data sources, using creative data science and an increasing usage of LLMs.
As a Data Engineer, you will join our cross-functional team of Machine Learning Engineers and Data Scientists to develop new components for our text-matching framework.
You will support data scientists with their day-to-day work, supporting a seamless research-to-production workflow regarding data and code, working closely with our SREs and software engineers to integrate our DS/ML components with our productive data processing pipelines on AWS.
Here’s a breakdown of what you’ll do:
Design, build, and maintain ETL/ELT pipelines and data workflows across batch and streaming systems.
Develop and optimize data models for analytics, reporting, and machine learning use cases.
Ensure data quality, consistency, and governance across multiple data sources.
Work on efficient CI/CD pipelines to continuously deploy our new features and models.
Set up and refine ML and data pipelines. Define model quality and set up a monitoring and alerting system.
Work closely with software engineers and SREs on the integration of our components.
Present your achievements to a broader audience, i.e. during agile ceremonies, internal knowledge-sharing events or conferences.
Contribute to the evolution of our data platform, including architectural improvements and tool selection.
These are the essentials for having an interview:
4+ years of experience as a Data Engineer or in a similar role.
Hands-on experience with cloud platforms for data engineering workloads.
Experience collaborating with data scientists and supporting ML pipelines.
Familiarity with DevOps practices (CI/CD, infrastructure as code, containerization with Docker/Kubernetes).
Working experience with most of our tech-stack.
Clearly and confidently in English within a business and technical context.
You think beyond the obvious, approaching problems with creativity and innovative solutions.
You can balance technical complexity with business value, estimating effort versus impact effectively.
You’re self-driven, eager to learn, and proactive in supporting teammates—whether it’s debugging issues, setting up tools, or sharing best practices.
....nice to have skills:
Good knowledge about using LLMs for research and productive use.
Experience with streaming platforms (Kafka, Kinesis, or Pub/Sub).
Experience with working in an agile environment (Scrum, JIRA).
Good knowledge of machine learning algorithms, preferably in NLP and text recognition.
Tools and Technology used :
Python best practices and coding standards.
AWS (Lambda, SageMaker, APIGateway, Bedrock) .
Docker, Terraform, mlflow .
git, GitLab (CI/CD, runners).
MongoDB .
ELK stack .
Collaboration & documentation: JIRA, Confluence, Teams, Miro .
Why join YouGov?
Join our global team to help us achieve our social mission: to make millions of people’s opinions heard for the benefit of our local, national, and international communities.
Understanding diversity of opinion requires diversity of background. Although our global panel of millions of people worldwide powers our research, our biggest asset is our people. If our research is to be truly representative of what the world thinks, we need people from all walks of life to be part of the team to bring their perspective to the work we do.
Life at YouGov
We are driven by a set of shared values. We are fast, fearless, and innovative. We work diligently to get it right. We are guided by accuracy, ethics, and proven methodologies. We respect and trust each other, bringing these values into everything that we do.
We strive to provide YouGovers with best-in-class benefits to support their physical, financial, and emotional wellbeing. We want our employees to have a sense of belonging and uniqueness in a supportive workplace, so they can bring their full selves to work.
Equal Opportunity Employer
As an Equal Opportunity Employer, qualified applicants will receive consideration for employment without regard to race, color, religion, sex (including pregnancy, gender identity or expression, and sexual orientation), parental status, national origin, marital status, age, disability, genetic information, HIV status, political affiliation, socioeconomic background, veteran status or any other characteristic protected by law or in line with our responsibilities as a fair and ethic employer. All employment decisions are made based on occupational qualifications, merit, and business need.
Data Privacy
To find out how we collect and use your personal data when you apply for a role at YouGov, please read our privacy notice at https://jobs.yougov.com/privacy
Top Skills
What We Do
YouGov is an international online research data and analytics technology group. Our mission is to offer unparalleled insight into what the world thinks.
With operations in the UK, the Americas, Europe, the Middle East, India and Asia Pacific, we have one of the world's largest research networks.
At the core of our platform is an ever-growing source of connected consumer intelligence that has developed daily over our 20 years of operation. We call it living data. All of our products and services draw upon this detailed understanding of our 26+ million registered panel members in over 55 markets to deliver accurate, actionable consumer insights.
Our innovative solutions help the world’s most recognised brands, media owners and agencies to explore, plan, activate and track better marketing activities:
Explore
Actionable answers from your audience - from syndicated data and in-depth custom research to quick surveys and polls.
Plan
Unlock the most complete view of your audience, with over a million profiling points.
Activate
Supercharge campaigns with precision targeting and unmissable advertising.
Track
Continuously monitor what the world thinks about brands, campaigns and your competition, with daily updates.
As innovators and pioneers of online market research, we have a strong reputation as a trusted source of accurate data and insights. Testament to this, YouGov data is regularly referenced by the global press, and we are the most quoted market research source in the world (Meltwater 2022).
