Databricks Specialist

Department: IT

Reporting to: Platform Engineering & DevOps Manager

Who we are

We’re part of Super Group, the NYSE-listed digital gaming company behind some of the world’s leading Sports and iGaming brands.

At Betway, we’re driven by our shared vision to become the global leader in the online sports betting and casino industry. Our people are forward-thinking team-players who thrive on a collective diversity of skills and backgrounds. Founded in 2006, our teams in Guernsey, London, Malta, Germany, Portugal and Spain are constantly expanding and evolving.

Who we’re looking for

We’re on a thrilling journey of growth and innovation, and we need passionate, driven individuals to join us. At Betway, every day is action-packed, and we expect you to bring your A-game. In return, you’ll find a supportive environment where your skills can flourish and your career can soar.

Ready to become a game-changer? Supercharge your career with us and be part of something extraordinary.

Why we need you

We’re on a mission to create extraordinary experiences for our customers, and we believe that your unique skills, passion and superdrive will help us achieve our vision.

At Betway, we foster a culture of innovation and continuous improvement. Collaborate with a diverse team of experts, embrace technical challenges, and unleash your creativity. Thrive in an environment that values authenticity, responsibility, and the thrill of pushing boundaries whilst believing everything is possible.

As a Databricks specialist, you'll play a vital role in owning our Databricks strategy and how we use it to innovate across our industry-leading brands. Designing and developing robust data frameworks, powering real-time data pipelines, and creating data services that deliver actionable insights to our global customer base.

You will be responsible for:

• Strategy Development: Create and own a Databricks strategy for the group, ensuring alignment with business goals and maximizing value.
• Architectural Leadership: Serve as the owner and responsible person for all Databricks- related activities, acting as the architect across the Data Engineering, Data Analytics, and Data Science teams.
• Collaboration Enablement: Bridge the gap between teams by setting up templates and frameworks for seamless collaboration, data sharing, and enablement aligned with the product vision.
• Unity Catalogue Management: Manage Unity catalogue, including permissions, usage, paths, locations, and implementation, ensuring data accessibility, security, and reliability.
• Guidance and Training: Provide guidance, support, and training to teams regarding Databricks usage, offering best practices, monitoring, and cost management/optimization strategies.
• Platform Monitoring: Monitor usage of the Databricks platform to inform decisions on deprecation, resource allocation, and cost control. 

Essential skills you’ll bring to the table

Proficiency in Terraform:

• Experience in using Terraform for infrastructure as code (IaC) to automate the provisioning and management of cloud resources.
• Ability to write, test, and maintain Terraform scripts to ensure efficient and scalable infrastructure deployment.
• Knowledge of best practices for Terraform state management, module creation, and version control.

Experience with Azure, AWS, or any other major cloud provider:

• In-depth understanding of cloud services and architecture provided by major cloud platforms such as Azure, AWS, or Google Cloud.
• Hands-on experience in deploying, managing, and optimizing cloud resources, including compute, storage, networking, and security services.
• Familiarity with cloud-native tools and services, such as Azure Databricks, AWS Glue, or Google Cloud Dataproc, for data processing and analytics.

Knowledge of DataOps practices:

• Understanding of DataOps principles and methodologies to improve the quality, speed, and collaboration in data analytics and engineering workflows.
• Experience in implementing CI/CD pipelines for data workflows, ensuring automated testing, deployment, and monitoring of data processes.
• Ability to work with version control systems, such as Git, to manage code and data changes effectively.

Desirable skills you’ve got up your sleeve

It would be great if you also have some of the following skills:

• Experience with Apache Spark
• Familiarity with machine learning frameworks and libraries
• Understanding of data governance and compliance
• Strong problem-solving and analytical skills
• Excellent communication and interpersonal skills

Our values are non-negotiables

Our culture is underpinned by core values that are linked to key behavioural competencies. Along with the below behavioural competencies, these are essential for all employees in order for you to embed in and drive our culture forward.

These competencies are:

• Adaptability
• Ownership and accountability
• Initiating action
• Resilience
• Team orientation
• Integrity
• Innovation