Senior Data Engineer

Posted Yesterday
Be an Early Applicant
Dublin, IRL
In-Office
Senior level
Information Technology • Consulting
The Role
Design, build and optimize high-volume Databricks data pipelines. Collaborate with architects and data scientists, tune Spark performance, configure clusters, mentor juniors, follow Agile Scrum, and maintain technical documentation.
Summary Generated by Built In
Company Description

Version 1 has celebrated 30 years in business and continues to be trusted by global brands to deliver technology and transformation solutions that drive customer success. Our deep expertise enables our customers to navigate the rapidly evolving technology landscape. We foster strong partnerships with global technology leaders including Microsoft, AWS, Oracle, Red Hat, OutSystems, Snowflake, ensuring that our customers are provided with the highest quality solutions and services. 

 We’re an award-winning employer reflecting how our employees are at the very heart of  what we do: 

  • UK & Ireland's premier AWS, Microsoft & Oracle partner 
  • 3300+ strong, €350/£300m revenue business 
  • 10+ years as a Great Place to Work in Ireland & UK 
  • Best Workplace for Women in the UK & Ireland by GPTW 
  • Best Workplace for Wellbeing in the UK by GPTW 

We’re a core values driven company, we hire people who share our values, and we reward those who display and foster them, it’s deeply embedded within our DNA. Invest in us and we’ll invest in you!. 

Job Description

Are you an experienced Data Engineer who wants to work with cutting edge technologies? Are you keen to build, develop and work at the forefront and centre of data engineering in a global enterprise? If so, this may be the role for you!

This is a hybrid role with the flexibility to work both virtually and from Dublin office.

Reporting to the Data Engineering Manager you will:

  • Work with solution architects, data architects, and application developers to gather data integration requirements and develop solutions accordingly
  • Collaborate with data scientists to develop and integrate statistical and forecasting algorithms into robust high-performing pipelines.
  • Design, develop, and optimize data pipeline solutions scaling to multi-terabyte datasets in Databricks environments
  • Assess and improve Spark performance in areas of memory management, caching strategies, and cluster resource optimization
  • Manage individual tasks and communicate updates to colleagues following an Agile Scrum methodology
  • Mentor junior colleagues, providing guidance and support to help them grow professionally
  • Maintain up to date Technical and Operational documentation

 

How this opportunity is different

This is a great opportunity for an experienced Engineer who wishes to broaden their role through working across multiple data and analytics projects and products. The Data Engineering team is working with new, innovative technologies such as Databricks, Unity Catalog, and AWS alongside established technologies like SQL Server.

Qualifications

  • Third level IT qualification or equivalent experience, with a solid foundation in mathematics and/or statistics.
  • 10+ years hands-on experience as an ETL/DWH developer with strong knowledge in designing, developing, and scaling end-to-end high-volume data integration processes
  • Strong programming experience with Python, SPARK, and SQL
  • Strong understanding of Spark execution plans and memory management
  • Experience with Databricks cluster configuration, performance, and cost optimization strategies
  • Customer focused with excellent communications skills (both oral and written)
  • A strong team player that can also work independently

Additional Information

Why Version 1? 

 At Version 1, we believe in providing our employees with a comprehensive benefits package that prioritises their wellbeing, professional growth, and financial stability. 

  • Share in our success with our Quarterly Performance-Related Profit Share Scheme, where employees collectively benefit from a share of our company's profits 
  • Strong Career Progression & mentorship coaching through our Strength in Balance & Leadership schemes with a dedicated quarterly Pathways Career Development programme 
  • Flexible/remote working, Version 1 is tremendously understanding of life events and people’s individual circumstances and offer flexibility to help achieve a healthy work life balance 
  • Financial Wellbeing initiatives including; Pension, Private Healthcare Cover, Life Assurance, Financial advice and an Employee Discount scheme 
  • Employee Wellbeing schemes including Gym Discounts, Bike to Work, Fitness classes, Mindfulness Workshops, Employee Assistance Programme and much more. Generous holiday allowance, enhanced maternity/paternity leave, marriage/civil partnership leave and special leave policies 
  • Educational assistance, incentivised certifications, and accreditations, including AWS, Microsoft, Oracle, and Red Hat 
  • Reward schemes including Version 1’s Annual Excellence Awards & ‘Call-Out’ platform. 
  • Environment, Social and Community First initiatives allow you to get involved in local fundraising and development opportunities as part of fostering our diversity, inclusion and belonging schemes. 

And many more exciting benefits… drop us a note to find out more.    

Version 1 is an equal opportunities employer. 

We are committed to building a diverse, inclusive and respectful workplace where everyone feels valued and able to thrive. We welcome applications from people of all backgrounds, identities and lived experiences, and we value the different perspectives people bring including those shaped by disability and neurodiversity. 

We want every candidate to have a positive and accessible recruitment experience. If you need reasonable adjustments at any stage of the process, please contact your recruiter at Version 1. We will consider all requests carefully, respectfully and confidentially. 

Video links: 

https://www.youtube.com/watch?v=F_d3ELTH5zo 

Skills Required

  • Third level IT qualification or equivalent experience with foundation in mathematics/statistics
  • 10+ years hands-on ETL/DWH development, designing and scaling end-to-end high-volume data integration
  • Strong programming experience with Python, Spark, and SQL
  • Strong understanding of Spark execution plans, memory management, and caching strategies
  • Experience with Databricks cluster configuration, performance and cost optimization
  • Experience designing and optimizing pipelines for multi-terabyte datasets in Databricks environments
  • Experience with SQL Server
  • Experience working in Agile Scrum teams and managing individual tasks
  • Excellent oral and written communication skills; customer focused
  • Ability to mentor junior colleagues and provide technical guidance
  • Familiarity with Unity Catalog
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Dublin
3,000 Employees
Year Founded: 1996

What We Do

Version 1 proves that IT can make a real difference to our customers'​ businesses. We are trusted by global brands to deliver IT services and solutions which drive customer success. Our 3000+ strong team works closely with our technology partners to provide independent advice that helps our customers navigate the rapidly changing world of IT. Our greatest strength is balance in our efforts to achieve Customer Success, Empowered People and a Strong Organisation, underpinned by the commitment to our values. We believe this is what makes Version 1 different and more importantly, our customers agree.

Similar Jobs

Optum Logo Optum

Senior Data Engineer

Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Hybrid
Dublin, IRL
160000 Employees

Version 1 Logo Version 1

Senior Data Engineer

Information Technology • Consulting
Hybrid
Dublin, IRL
3000 Employees
65K-75K Annually

Primark Logo Primark

Senior Data Engineer

Fashion • Retail
Hybrid
Dublin, IRL
37781 Employees

GridBeyond Logo GridBeyond

Senior Data Engineer

Artificial Intelligence • Energy
Hybrid
Dublin, IRL
149 Employees

Similar Companies Hiring

Amplify Platform Thumbnail
Fintech • Financial Services • Consulting • Cloud • Business Intelligence • Big Data Analytics
Scottsdale, AZ
62 Employees
Standard Template Labs Thumbnail
Artificial Intelligence • Information Technology • Software
New York, NY
25 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account