DataOps Engineer

Purpose of the job

The DataOps Engineer will play a critical role in ensuring the reliability, security and operational excellence of Collinson's modern data platform. As a key member of the Data & Analytics team, you will be responsible for automating platform operations, maintaining cloud infrastructure, supporting CI/CD pipelines and ensuring the platform remains secure, scalable and highly available.

In this hands-on role, you will work closely with Data Engineers, Security, Infrastructure and Product teams to support enterprise-wide data initiatives through automation, observability and platform standardisation.

Key Responsibilities

· Manage and maintain Snowflake, Kafka, AWS, MongoDB and supporting data platform infrastructure.

· Build and maintain CI/CD pipelines and deployment automation.

· Develop and maintain Infrastructure as Code using Terraform.

· Manage AWS networking including VPCs, VPC Peering, PrivateLink and secure private networking.

· Work with the Central Network team to implement and support enterprise networking solutions.

· Support Confluent Kafka platform operations and event-driven data integration patterns.

· Perform platform patching, upgrades, and lifecycle management.

· Ensure timely remediation of security vulnerabilities and compliance with security standards.

· Implement monitoring, alerting and observability using Datadog and platform monitoring tools.

· Support production incidents, root cause analysis, and operational improvements.

· Maintain platform documentation, operational runbooks, and engineering standards.

· Optimize platform performance, reliability, and cloud costs.

· Support platform governance, access management, and disaster recovery activities.

· Evaluate emerging technologies and recommend improvements to platform engineering practices.

· Own operational excellence of the data platform.

· Define and improve platform reliability standards.

· Drive automation and reduce manual operational effort.

· Improve developer experience for data engineering teams.

· Develop and maintain operational metrics, SLAs and SLOs to improve platform reliability and availability.

Knowledge, skills and experience required

Mandatory Technical Skills

DataOps & Platform Engineering

• AWS fundamentals

• Snowflake Administration

• MongoDB

• Confluent Kafka Platform

• Python

• SQL

• Git

• CI/CD pipelines

• Infrastructure as Code (Terraform)

• Data Observability and Monitoring (Datadog)

• Incident Management

• Production Support

• Security Patching

• Vulnerability Management

• Performance optimisation

• Cost optimisation

AWS Networking

• VPC

• VPC Peering

• AWS PrivateLink

• Route 53

• Security Groups

• IAM

• Private networking

• Central Network integration

Preferred Skills

• AWS Transit Gateway

• AWS Direct Connect / VPN concepts

• Datadog dashboards and alerting

• Airflow

• Platform Engineering / SRE practices

Nice to Have

• Generative AI fundamentals

• LLM integration patterns

• AI Agent frameworks

• Machine Learning platform awareness

• Real-time analytics architectures

Person Specification

• Self-motivator with a desire to learn new skills and embrace new technologies in a constantly changing technology landscape

• Strong problem-solving and analytical skills.

• Passion for automation, reliability and secure platform operations.

• Self-motivated with a continuous learning mindset.

• Strong stakeholder management and communication skills.

• Ability to communicate technical concepts to non-technical audiences.

• Collaborative team player who thrives in agile environments.

• Quality-focused with strong attention to detail.

• Ability to balance business priorities with technical excellence.

• Proactive in identifying opportunities for improvement and innovation.

• Comfortable working across global teams and multiple business domains.