The Role
The role involves leading the architecture, deployment, and optimization of a big data platform using technologies like Hadoop, Flink, and Spark, mentoring engineers, and collaborating to resolve data issues.
Summary Generated by Built In
At Lalamove, we believe in the power of community. Millions of drivers and customers use our technology every day to connect with one another and move things that matter. Delivery is what we do best and we ensure it is always fast and simple. Since 2013, we have tackled the logistics industry head on to find the most innovative solutions for the world’s delivery needs. We are full steam ahead to make Lalamove synonymous with delivery and on a mission to impact as many local communities we can. We have massively scaled our efforts across Asia and now have our sights on taking our best in class technology to the rest of the world. And we are looking for talented professionals to join us in this journey!!
As a Data Platform Engineer at Lalamove, you will be joining the growing Data Platform team to develop and enhance our data platform. The data platform is the centralised portal that enables engineers and analysts across the company to ingest, process, orchestrate, analyse, and visualize the data of our company. As part of the Data Engineering function, the team will design, develop, maintain, and scale the data platform, including the data infrastructure and data services, which provides the foundation to downstream use cases such as data warehousing, reporting, machine learning, analytics, data products etc.
What you’ll do:
- Lead the architecture design, technology selection, deployment, development, management, monitoring, and performance tuning of large-scale data platforms based on the Hadoop ecosystem. Ensure efficient and stable cluster operations and deliver robust architectures for data storage, query engines, real-time computing, and metadata management.
- Develop and maintain core system components, mentor engineers, and continuously optimize system performance and stability.
- Collaborate across teams and departments to analyze and resolve operational and data-related issues within the big data platform.
- Build industry-leading data systems that support fast-growing data businesses and large-scale production workloads.
What you’ll need:
- Bachelor’s degree or above with 3–8 years of experience in big data platform development or distributed system engineering.
- Solid Java foundation; familiar with SOA architecture and mainstream frameworks such as Spring Boot and Spring Cloud.
- Proficient with mainstream big data computing engines, including:
- Experience with data change capture (CDC) pipelines, including Alibaba Canal and Flink CDC, covering MySQL/PostgreSQL binlog parsing, schema evolution handling, watermarking, consistency guarantees, and integration with data lakes or downstream streaming systems.
- Strong familiarity with OLAP engines and the big data ecosystem, including Doris, ClickHouse, Druid, Kylin, Hive, HBase, Kafka, Elasticsearch, and MapReduce.
- Experience with lakehouse table formats such as Apache Iceberg and Apache Paimon, including metadata management, table optimization, partition pruning, compaction, and file layout tuning.
- Strong Mandarin communication skills for daily business communication and technical documentation.
Flink: Flink on Kubernetes, state management, Checkpoint/Savepoint, exactly-once semantics, unified batch/stream processing, Flink SQL/Table API, CEP, runtime internals, and Flink CDC for real-time incremental change data capture.
Spark: Spark on Kubernetes, Spark SQL/Streaming, Adaptive Query Execution (AQE), shuffle optimization, resource isolation, and dynamic allocation.
Hive on Tez: Tez DAG optimization, container reuse, auto-parallelism tuning, and Hive MR-to-Tez migration performance optimization.
To all candidates- Lalamove respects your privacy and is committed to protecting your personal data.
This Notice will inform you how we will use your personal data, explain your privacy rights and the protection you have by the law when you apply to join us. Please take time to read and understand this Notice. Candidate Privacy Notice: https://www.lalamove.com/en-hk/candidate-privacy-notice
Top Skills
Alibaba Canal
Apache Iceberg
Apache Paimon
Elasticsearch
Flink
Hive
Java
Kafka
Mapreduce
Spark
Spring Boot
Spring Cloud
Tez
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
Established in December 2013, Lalamove was created to make on-demand and same-day delivery possible for everyone at the touch of a button. Today, Lalamove operates in over 20 markets across Asia, Latin America, and the United States connecting over 7 million customers with a pool of over 700,000 driver partners. Our driver partners operate a vast array of vehicles to suit each market including lorries, trucks, vans and cars for deliveries of almost anything of any size. Fleets of two-wheel vehicles are also available for courier services providing fast and low-cost delivery solutions. Through dedicated mobile and web apps, Lalamove seamlessly connects users and drivers around the world to move things that matter.
