We are looking for a Senior Data Engineer to be a part of our Data and Analytics Team. The Senior Data Engineer will be responsible for accomplishing designed tasks, projects and operations related to data estate and will report to the Head of Data Engineering.
As a Senior Data Engineer, your focus will be to ensure that you carry out designated tasks, projects and operations, related to the data estate.
YOUR CHALLENGE:
- Develop data processes using pyspark, implementing the best practices to reach the best performance on the processes.
- Capacity ingesting and integrating different type of sources in the datalake, assuming responsibility on the data quality and data accuracy
- Build and maintain data model and the code base of the data estate
- A proven track record of administration, engineering, and operationalizing Cloud Data Platform
- Assist in the daily data operations and maintenance tasks, monitoring the data processes and troubleshooting the possible problems
- Work closely and collaborate with a team of engineers, operational specialists and analysts
- Assist business stakeholders, by carrying out ad hoc data analysis tasks
- Continuously improve business knowledge and knowledge on data and analytics estate through training and self-development
- Any other Adhoc requirements by the business
TO DO IT, YOU WILL NEED:
- An IT Degree or a Degree in a relevant field
- Minimum of 3 years previous working experience as a Data Engineer or a DWH developer, with a proven record of designing and building highly scalable, automated ETL processes for data lake and data warehousing (batch and real-time)
- Previous experience with data integration and data computing in Cloud Platforms, especially Azure
- Experience in SQL, and working with relational databases and complex queries
- Proven experience in computing tools such as Databricks or Jupyter
- Experience in pipeline orchestration using tools/components as ADF, Fabric Pipeline, AWS Step Functions, AWS Glue, Oozie, Airflow
- Knowledge of software development, preferably in one or more of the following languages: Pyspark, Scala, Python, JavaScript, Java, C/C++, etc.
- Any work experience in building distributed environments using any of Kafka, Spark, Hive, Hadoop, etc. (considered as an asset)
- Experience with CI/CD using tools like Git, Azure Devops, Jenkins
- Experience with Microsoft Fabric(considered as an asset)
- Proven experience using dashboard and reporting tools such as Power BI, Looker, Tableau, Qlik (considered as an asset)
- Ability to work and deliver in a fast-paced agile environment
- To be a team player
- To be highly motivated with good analytical skills and excellent communication
Similar Jobs
What We Do
The Catena Media story began in 2012 and, in the years since, we’ve established ourselves as one of the world’s most successful online lead generation companies focusing on the iGaming and Finance industries, through strong organic growth and strategic acquisitions.
Born from an idea conjured by two like-minded friends with a shared hobby, we’re now a 400+ strong workforce across 8 locations, including Malta, UK, Serbia, Japan, US, Australia, Italy and Sweden. Our people are diverse, creative and innovative, and are complemented by our aligned focus on creating kick ass products and inspiring and supporting great leaders.
You’ll find no dull office cubicles or rigid organisational structures here – we value creativity, passion and collaboration. We want to inspire every member of our team to reach the pinnacle of their potential (while enjoying some industry-leading perks); becoming a Catena Media ambassador along the way.
Modesty aside, our company events are legendary (for all the right reasons), and our new, bespoke Head Office has been designed specifically with employees health and wellbeing in mind, while a team of company chefs muster up fresh delights every day.
We work hard too, of course. In fact, our aim is to transform any industry we decide to be in through the power of choice: focusing on organic growth in combination with geographical expansion and acquisitions to meet our ultimate goal of becoming the world’s number one provider of high-value leads.
