Be an Early Applicant
The Role
Develop and maintain ETL data pipelines, optimize data flow and delivery, automate manual processes, and design scalable data infrastructure. Gather telemetry data to improve system efficiency and business metrics. Collaborate with cross-functional teams on requirements and data products, using databases, workflow tools, microservices, and APIs. Preferred experience includes Agile development, monitoring, fault-tolerant pipelines, big data technologies, and search engines.
Summary Generated by Built In
We are seeking a Data Engineer to join our Data & Systems Engineering team. In this role, you will be responsible for enhancing and optimizing the data flow between our systems and refining our data pipeline architecture. You will collaborate closely with cross-functional teams to gather requirements, design scalable solutions, and implement cutting-edge data products. The ideal candidate is passionate about driving the development of our next generation of data initiatives.
Key Responsibilities
- Develop and maintain robust data pipelines for extracting, transforming, and loading data from diverse sources.
- Identify, design, and implement process improvements, including automation of manual processes, optimization of data delivery, and design of scalable infrastructure.
- Gather and analyze telemetry data to provide actionable insights, enhancing the efficiency of data systems and key business performance metrics.
Minimum Requirements
- Background in Computer Science, Computer Engineering, Information Systems, or a related field.
- A minimum of 2 years of hands-on experience with object-oriented programming languages such as Python, Golang, Java, or C++. (Project/internship experience will be considered for recent graduates.)
- Proficiency with both relational SQL and NoSQL databases.
- Experience in building ETL flows using tools such as NiFi or Airflow.
- Familiarity with microservices architecture and RESTful API design.
Preferred Qualifications
- Experience with software development in Agile SCRUM environments, including testing and production error/metrics monitoring.
- Expertise in building scalable, fault-tolerant, and maintainable data pipelines.
- Proficiency in big data tools such as Hadoop, Spark, and Kafka.
- Experience with search engines like Elasticsearch or Solr.
Considerations for senior positions
- Candidates with at least 5 years of proven track record in data engineering development.
- Experience in technical coaching to junior data engineers.
As CSIT is an agency under the Ministry of Defence (Singapore), only Singapore Citizens will be considered.
Skills Required
- Background in Computer Science, Computer Engineering, Information Systems, or a related field
- At least 2 years of hands-on experience with object-oriented programming languages such as Python, Golang, Java, or C++; project or internship experience considered for recent graduates
- Proficiency with relational SQL and NoSQL databases
- Experience building ETL flows using NiFi or Airflow
- Familiarity with microservices architecture and RESTful API design
- Software development experience in Agile SCRUM environments, including testing and production error or metrics monitoring
- Expertise building scalable, fault-tolerant, and maintainable data pipelines
- Proficiency with Hadoop, Spark, and Kafka
- Experience with Elasticsearch or Solr
- At least 5 years of data engineering development experience for senior positions
- Experience providing technical coaching to junior data engineers for senior positions
- Singapore citizenship
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
The Centre for Strategic Infocomm Technologies (CSIT) is a technical agency in the Ministry of Defence that harnesses cutting-edge digital technologies to meet Singapore's security needs. It develops capabilities to support missions such as cyber defence, counter terrorism, and counter hostile information operations, with a technical focus on cybersecurity, data analytics, software engineering, and cloud infrastructure and services.
