Data Engineer

Posted 6 Days Ago
Be an Early Applicant
Gzira, MLT
Hybrid
Entry level
Digital Media
The Role
Build and maintain scalable batch and real-time data pipelines and models on Databricks with Azure and Unity Catalog. Develop PySpark and Python ETL/ELT workflows, Kafka streaming ingestion, automated tests, data quality checks, CI/CD, infrastructure-as-code deployments, and documentation. Monitor and troubleshoot the cloud data platform, use agentic AI tools and LLM-powered workflows, collaborate with technical and business stakeholders, and support continuous platform improvement.
Summary Generated by Built In

We are seeking a Data Engineer to join our Data & Analytics team, responsible for designing, building, testing and maintaining scalable data pipelines and data models on our Databricks lakehouse on Azure, governed through Unity Catalog. You will work in an AI-first team where agentic AI is part of how we design, build, test and operate our data platform every day. As part of the team, you’ll contribute to technical design and help shape our engineering standards.
YOUR CHALLENGE:

  • Design and develop data pipelines in Python (PySpark) on Databricks, applying engineering best practices for performance, reliability and maintainability.
  • Ingest and integrate diverse data sources into the lakehouse in batch, following our bronze, silver and gold layering and ensuring data quality and accuracy.
  • Help introduce event streaming and real-time ingestion to the platform: design, build and operate streaming pipelines on Databricks from sources such as Kafka, handling late, duplicate and out-of-order events reliably.
  • Maintain data models and the data estate codebase, with data governed, secured and documented in Unity Catalog.
  • Write automated tests for every change: unit tests for pipeline logic, integration tests against real data, and data quality checks that catch issues before they reach users.
  • Follow and contribute to the team’s engineering standards: clean, modular code, peer code review, CI/CD, infrastructure as code (Databricks Asset Bundles) and clear documentation.
  • Use agentic AI tools (such as Claude Code) daily to build, test, review and troubleshoot, and help design and improve the AI agents and skills that automate our data workflows, with human review built in.
  • Monitor and operate our cloud data platform (Databricks on Azure) day to day: track pipelines and jobs, troubleshoot issues and support daily data operations.
  • Collaborate with engineers, analysts, and business stakeholders; support ad hoc data analysis requests.
  • Drive continuous improvement through training and self-development.
  • Any other ad hoc tasks that may be required by the business from time to time.

TO DO IT, YOU WILL NEED:

  • A Degree in IT, Computer Science, or related fields.
  • Proven experience as a Data Engineer, building and maintaining scalable ETL/ELT pipelines for data lakes or lakehouses, with exposure to both batch and real-time data.
  • Hands-on experience with Databricks on Azure, including Unity Catalog (catalogs, schemas, permissions and lineage).
  • Hands-on experience with event streaming and real-time ingestion: Spark Structured Streaming and event platforms such as Kafka.
  • Strong SQL skills; experience with relational databases and complex queries.
  • Experience orchestrating pipelines with Databricks Workflows (Jobs) and deploying them with Databricks Asset Bundles; Azure Data Factory experience is an asset.
  • Coding proficiency in PySpark and Python.
  • A strong testing mindset: experience writing unit and integration tests (e.g. pytest) and data quality checks, and writing code that is designed to be tested.
  • Solid software engineering practices: Git, pull requests and code review, CI/CD (Azure DevOps, GitHub Actions or equivalent) and documentation.
  • Hands-on experience working with agentic AI: using AI coding agents (such as Claude Code) in daily engineering work, and designing, building or integrating LLM-powered agents that orchestrate data workflows.
  • Comfortable delivering in a fast-paced, agile environment.
  • Strong analytical and problem-solving skills.
  • Excellent communication and team collaboration.
  • Self-motivated with a drive for continuous learning.

Want to help build the future of Catena Media?  Apply now for the opportunity to join our collaborative team!

Skills Required

  • Degree in IT, Computer Science, or a related field
  • Experience building and maintaining scalable ETL/ELT pipelines for data lakes or lakehouses
  • Exposure to both batch and real-time data
  • Hands-on experience with Databricks on Azure and Unity Catalog
  • Hands-on experience with Spark Structured Streaming and event platforms such as Kafka
  • Strong SQL skills and experience with relational databases and complex queries
  • Experience orchestrating pipelines with Databricks Workflows or Jobs
  • Experience deploying with Databricks Asset Bundles
  • Azure Data Factory experience
  • Coding proficiency in PySpark and Python
  • Experience writing unit and integration tests, such as pytest, and data quality checks
  • Solid software engineering practices, including Git, pull requests, code review, CI/CD, and documentation
  • Hands-on experience using agentic AI coding tools and designing, building, or integrating LLM-powered agents
  • Comfort working in a fast-paced agile environment
  • Strong analytical and problem-solving skills
  • Excellent communication and team collaboration skills
  • Self-motivation and commitment to continuous learning
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Il-Gżira
519 Employees
Year Founded: 2012

What We Do

The Catena Media story began in 2012 and, in the years since, we’ve established ourselves as one of the world’s most successful online lead generation companies focusing on the iGaming and Finance industries, through strong organic growth and strategic acquisitions. Born from an idea conjured by two like-minded friends with a shared hobby, we’re now a 400+ strong workforce across 8 locations, including Malta, UK, Serbia, Japan, US, Australia, Italy and Sweden. Our people are diverse, creative and innovative, and are complemented by our aligned focus on creating kick ass products and inspiring and supporting great leaders. You’ll find no dull office cubicles or rigid organisational structures here – we value creativity, passion and collaboration. We want to inspire every member of our team to reach the pinnacle of their potential (while enjoying some industry-leading perks); becoming a Catena Media ambassador along the way. Modesty aside, our company events are legendary (for all the right reasons), and our new, bespoke Head Office has been designed specifically with employees health and wellbeing in mind, while a team of company chefs muster up fresh delights every day. We work hard too, of course. In fact, our aim is to transform any industry we decide to be in through the power of choice: focusing on organic growth in combination with geographical expansion and acquisitions to meet our ultimate goal of becoming the world’s number one provider of high-value leads.

Similar Jobs

Megapixel Entertainment Limited Logo Megapixel Entertainment Limited

Data Engineer

Consumer Web • Digital Media • eCommerce • Gaming
Hybrid
Gzira, MLT
59 Employees
Hybrid
Sliema, Reġjun tal-Lvant, MLT
1900 Employees
Hybrid
Saint Julian's, MLT
1074 Employees

bet365 Logo bet365

Designer

Digital Media • Gaming • Software • Esports • Automation
Hybrid
Tas-Sliema, MLT
10000 Employees

Similar Companies Hiring

bet365 Thumbnail
Digital Media • Gaming • Software • Esports • Automation
Denver, Colorado
10000 Employees
Bankrate Thumbnail
Artificial Intelligence • Consumer Web • Digital Media • Fintech • Marketing Tech • Software • Financial Services
US
160 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
567 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account