Roles & Responsibilities
- Design, develop, and maintain Ninja Van's infrastructure for data streaming, processing, and storage.
- Build tools to ensure effective maintenance and monitoring of the data infrastructure.
- Contribute to key architectural decisions for data pipelines and lead the implementation of major initiatives.
- Collaborate with stakeholders to deliver scalable and high-performance solutions for data requirements, including extraction, transformation, and loading (ETL) from diverse data sources.
- Enhance the team's data capabilities by sharing knowledge, enforcing best practices, and promoting data-driven decision-making.
- Develop and enforce Ninja Van's data retention policies and backup strategies, ensuring data is stored redundantly and securely.
Requirements
- Strictly looking 8+ years of experience in a similar role, with a proven track record of building scalable and high-performance data infrastructure using Python, PySpark, Spark, and Airflow.
- Solid computer science fundamentals, excellent problem-solving skills, and a strong understanding of distributed computing principles.
- Expert-level SQL knowledge and extensive experience working with both relational and NoSQL databases.
- Advanced knowledge of Apache Kafka, along with demonstrated proficiency in Hadoop v2, HDFS, and MapReduce.
- Hands-on experience with stream-processing systems (e.g., Storm, Spark Streaming), big data querying tools (e.g., Pig, Hive, Spark), and data serialization frameworks (e.g., Protobuf, Thrift, Avro).
- [Good to have] Familiarity with infrastructure-as-code technologies like Terraform, Terragrunt, Ansible, or Helm. Don’t worry if you don’t have this experience—what matters is your interest in learning!
- [Good to have] Experience with Change Data Capture (CDC) technologies such as Maxwell or Debezium.
- Bachelor’s or Master’s degree in Computer Science or a related field from a top university.
Top Skills
What We Do
Ninja Van Group is a tech-enabled logistics organisation, backed by marquee investors including GeoPost, Alibaba Group, and B Capital Group. Launched in 2014 as an e-commerce express logistics company, it reached 100% network coverage by 2018 with over 2,000 stations and hubs across Southeast Asia. Today, around two million parcels course through its network daily. A decade of operations fortified Ninja Van Group’s e-commerce express network, enabling concurrent diversification across the realms of e-commerce and express logistics. To maximise its scale in e-commerce, Ninja Van Group offers a comprehensive suite of solutions – from digital to full-funnel marketing – to help shippers sell better. As a springboard for expansion beyond e-commerce, Ninja Van Group's e-commerce express network lays the groundwork for venturing into other express verticals, including business-to-business inventory restocking and cold chain.