Senior Data Engineer (Big Data Processing)

Posted Yesterday
Be an Early Applicant
Singapore, SGP
In-Office
Senior level
Information Technology • Software • Cybersecurity • Defense
The Role
Lead design, build and maintain scalable, low-latency large-scale data pipelines. Optimize performance, ensure data quality and governance, troubleshoot critical systems, mentor junior engineers, and collaborate with stakeholders to deliver mission-critical data products.
Summary Generated by Built In
CSIT develops products to advance the national security interests of Singapore. We use our products in a wide range of use-cases, including but not limited to Counter-terrorism and Computer Network Defence. We are looking for talented senior data engineers to lead and build mission-critical products that identify, analyse and investigate threats.

Role

  • As a senior data engineer in a team that is responsible for mission-critical data analytics systems, you will contribute to the development and maintenance of high-performance data pipelines and systems related to national security. You will be involved in complex technical projects to collect, parse and process large datasets with the aim to turn them into useful information and insights. Join us to seize the opportunity to use cutting-edge technologies to protect the nation.

Responsibilities

  • Design and build data pipelines that are scalable, robust and maintainable to ingest crucial data using cutting-edge platforms and technologies
  • Work with product managers, engineering managers and key stakeholders to deliver impactful data products that meet our business needs
  • Optimise performance of large-scale data pipelines for low-latency, high-throughput and reliability
  • Ensure data integrity, quality and governance through robust design and operational monitoring
  • Troubleshoot and resolve complex issues in critical data pipelines
  • Implement best practices in data engineer, including testing, orchestration and monitoring of data pipelines
  • Lead technical discussions with the team and key stakeholders to shape the future of our data products
  • Mentor junior data engineers and contribute to building a strong data engineering culture within the team

Requirements

  • Background in computer science or equivalent
  • 5+ years of experience in data engineering, with a strong focus on building large-scale data pipelines
  • Proven experience in writing optimised ETL code to handle large datasets
  • Proficient in programming languages such as Scala or Java
  • Familiarity with the following technologies: Spark, Kafka, Hadoop, Elastic stack, Kudu
  • Strong understanding of modern data architectures and data modelling paradigms
  • Able to communicate technical details effectively and clearly
  • Good interpersonal, analytical and problem-solving sklils to get things done in a dynamic environment

Why join us?

  • The work is purposeful and meaningful
  • You will get to work with talented and driven people
  • We work with modern technologies and tech stacks
  • We have excellent engineering culture and work-life balance
  • We aspire for engineering and operational excellence
  • We empower to innovate

As CSIT is an agency under the Ministry of Defence (Singapore), only Singapore Citizens will be considered.

Skills Required

  • Degree in Computer Science or equivalent
  • 5+ years experience in data engineering building large-scale data pipelines
  • Proven experience writing optimized ETL code for large datasets
  • Proficiency in Scala or Java
  • Familiarity with Spark, Kafka, Hadoop, Elastic stack, Kudu
  • Strong understanding of modern data architectures and data modelling paradigms
  • Effective technical communication skills
  • Good interpersonal, analytical and problem-solving skills
  • Must be a Singapore Citizen
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
631 Employees
Year Founded: 2003

What We Do

The Centre for Strategic Infocomm Technologies (CSIT) is a technical agency in the Ministry of Defence that harnesses cutting-edge digital technologies to meet Singapore's security needs. It develops capabilities to support missions such as cyber defence, counter terrorism, and counter hostile information operations, with a technical focus on cybersecurity, data analytics, software engineering, and cloud infrastructure and services.

Similar Jobs

Centre for Strategic Infocomm Technologies Logo Centre for Strategic Infocomm Technologies

Senior Software Engineer

Information Technology • Software • Cybersecurity • Defense
In-Office
Singapore, SGP
631 Employees

Wise Logo Wise

Automation Senior Analyst

Fintech • Mobile • Payments • Software • Financial Services
Hybrid
Singapore, SGP
9000 Employees

Braze Logo Braze

Account Executive

Marketing Tech • Mobile • Software
Easy Apply
Hybrid
Singapore, SGP
2000 Employees

Wise Logo Wise

APAC Employee Relations Regional Lead

Fintech • Mobile • Payments • Software • Financial Services
Hybrid
Singapore, SGP
9000 Employees

Similar Companies Hiring

Outpost Space Thumbnail
Aerospace • Defense
US
24 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account