Lead Data Engineer

Reposted 4 Hours Ago
Easy Apply
Be an Early Applicant
Hiring Remotely in Portugal
Remote
20K-20K Annually
Senior level
Software • Consulting
The Role
The Senior Data Engineer will build core infrastructure software for data platforms, mentor engineers, and ensure data access and performance across systems.
Summary Generated by Built In

Location: UK or Portugal

Department: Engineering

Employment Type: Permanent

About YLD:

Our goal is to help our clients keep moving forward. We work with them to build the skills and capabilities they need to stay ahead of the competition, and we know our success only happens when they succeed. We’re a team of curious, talented people, and we’re committed to making YLD a place where great people want to work, grow, and stay. We’re a remote-first consultancy specialising in software engineering, product design, and data. Our teams are based across London, Lisbon, and Porto, and we create digital solutions that continue to deliver value long after our work is done.

About the role:

As a Senior Data Engineer, you’ll be part of a client team building innovative products. We expect you to be curious, passionate, driven, and enthusiastic. You’ll be proficient at problem-solving, and crafting scalable, resilient, and fault-tolerant architectures. You’ll be an effective communicator and a team player. You and your team will move in a fast-paced engineering environment, achieving outstanding results and delivering exciting projects.

About you:

A YLD Senior Data Engineer is a highly skilled engineer who spans across data engineering and analytics engineering, and knows where the boundaries sit. You've built pipelines and transformation layers. You've inherited messy data projects and made them good. You have opinions about how data teams should work and the humility to adapt them to context.

You have a real passion for the craft and are an active learner who gets excited by the variety that consultancy brings: different clients, different stacks, different problems.

Your day-to-day responsibilities will look like this:
  • Delivering data work on client engagements: pipelines, transformation layers, models, and the infrastructure around them
  • Adapting to different client contexts, legacy warehouse migrations, greenfield lakehouses, struggling transformation layers that need rescuing
  • Defining and evolving our internal standards for data work: testing, documentation, project structure, code review
  • Mentoring and growing data engineers across the company
  • Showing up for client team moments (internal speakers, learning sessions, social events) to build strong working relationships.
  • Contributing to proposals and helping shape engagements during the sales process
  • Representing YLD externally through writing, speaking, and contributing to the wider data community.
You’ll have the following skills and experience:
  • SQL as engineering: You write SQL that's reviewable, testable, and performs at scale. You understand query planning, engine quirks, and how materialisation choices affect cost and performance
  • Python for data: You write typed, testable Python for pipelines and tooling. You've built and maintained production data systems, not just notebooks
  • Data modelling: You've made deliberate choices between dimensional, Data Vault, normalised, and denormalised designs. You can explain those trade-offs in terms of flexibility, query performance, and maintainability
  • Transformation architecture: You design transformations that are idempotent, incremental, and dependency-aware. You think in DAGs, not scripts
  • Pipeline design: You understand batch, streaming, and micro-batch trade-offs. You consider latency, complexity, cost, and reprocessability. And choose the right approach for the problem
  • Data testing: You write tests as code, schema contracts, assertions, and transformation logic. You know what to catch at build time vs. defer to observability
  • Data observability: You treat data reliability like site reliability. Measurable indicators, alerting, incident response, and root cause analysis
  • CI/CD for data: You version, test, and deploy pipelines like software. Environment promotion, rollback strategies, and infrastructure as code for reproducible environments
  • Data governance: You've implemented lineage, cataloguing, sensitive data classification, or access control. Not just built pipelines, but made them auditable and secure
  • Cost-conscious: You've optimised warehouse spend, storage strategies, or job efficiency. You treat compute as a resource to manage, not ignore
  • Platform fluency: You've worked across the modern stack. Orchestration (Airflow, Dagster), warehouses (Snowflake, BigQuery, Databricks), ingestion (Fivetran, Airbyte, custom), and transformation (dbt, Spark)
  • Cross-functional fluency: You translate engineering constraints into business terms and negotiate realistic commitments
You’ll be:
  • Self-motivated and proactive
  • Comfortable with ambiguity, experimentation, and iteration
  • Collaborative by default. You work well in teams and across teams
  • Analytical and detail-oriented in your approach to problems
  • Comfortable context-switching across clients, stacks, and problem types
  • Willing to shape engagements, not just deliver them: contributing to proposals, scoping, and client relationships
  • Active in the wider data community: writing, speaking, or open-source contribution
  • Genuinely committed to diversity, equity, and inclusion

Benefits you'll get:

  • Company Private Health care
  • Enhanced fully paid maternity and paternity leave for up to 6 months
  • Company’s Pension Scheme (UK Only)
  • 25 days annual holiday (excluding Public Holidays)
  • £2000/€2000 annual allowance for Training/Conferences
  • £300/€300 annual allowance for additional hardware
  • Mental Health support: access to Spill app
  • Meditation/Sleep support: Headspace or Calm app subscription
  • Bonus (depending on Company performance and results)
  • Company laptop
  • Generous referral schemes
Our typical Recruitment Process looks like this:
  • 1st Interview with someone from the Talent team (30/45 mins)
  • Technical Interview with our Senior Developers (1h30)

Get a glimpse of what it's like working at YLD! 🤳

Check out our LinkedIn page

We live and breathe our values, and know you will too:
  • Growing every day
  • Including everyone
  • Relationships built on honesty and ethics
  • Inspiring solutions
  • Winning together

We’re an equal-opportunity employer and value diversity in all its forms. We do not discriminate based on race, religion, colour, national origin, gender, sexual orientation, pregnancy or maternity, age, marital status, or disability. We also offer a remote-first working environment, with flexible working and work–life balance as standard for all employees.


Top Skills

Apache Airflow
Aws Kinesis
Aws Lambda
Dbt
JavaScript
Kafka
Python
Spark
SQL
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
London
127 Employees
Year Founded: 2013

What We Do

With offices in London, Lisbon, and Porto, YLD is a product design and software engineering consultancy specialising in customer experience and disruptive technologies. We were among the first adopters of innovative technologies like Node.js, React.js, React Native, Kubernetes, and GraphQL, which are now staples for many businesses. YLD was also an early adopter of Design Systems as a service and founded Design Systems London, a non-profit community focused on design and product. We leave your teams and tech in a better space by curating bespoke teams of cross-functional experts in software engineering, architecture, DevOps, delivery, design, product and data science to work alongside your teams through close collaboration and, where needed, pair programming or technical training. We drive rapid iteration towards key business objectives, vision and chosen metrics, creating a long-standing product culture and delivery capability in each piece of work. We’ve helped companies like Bulb, Uphold, NewDay, GoDaddy, CondeNast, and many others, achieve technical product excellence. As a result, we enable organisations, regardless of industry, to become their most successful by creating and nurturing a culture that embraces experimentation and learning that lasts beyond the partnership. We are committed to the Open Source community, with almost 10,000 contributions across 500 open source projects. Collective contributions result in more robust, innovative and faster solutions, allowing open source communities to review the code and propose improvements that increase security and reliability. We are also actively engaged in numerous engineering and design communities, supporting and organising the likes of ReactJS Girls and Design Systems London with both online and in-person events and conferences

Similar Jobs

Natixis in Portugal Logo Natixis in Portugal

Data Engineer

Information Technology
Remote
Portugal
2007 Employees

HiBob Logo HiBob

Customer Experience Specialist

HR Tech • Information Technology • Professional Services • Sales • Software
Remote or Hybrid
Portugal
1350 Employees

HiBob Logo HiBob

Product Manager

HR Tech • Information Technology • Professional Services • Sales • Software
Remote or Hybrid
Portugal
1350 Employees

GitLab Logo GitLab

Senior Product Manager

Cloud • Security • Software • Cybersecurity • Automation
Easy Apply
Remote
31 Locations
2500 Employees

Similar Companies Hiring

Scotch Thumbnail
Software • Retail • Payments • Fintech • eCommerce • Artificial Intelligence • Analytics
US
25 Employees
Milestone Systems Thumbnail
Software • Security • Other • Big Data Analytics • Artificial Intelligence • Analytics
Lake Oswego, OR
1500 Employees
Fairly Even Thumbnail
Software • Sales • Robotics • Other • Hospitality • Hardware
New York, NY

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account