Location:
CN-Shenzhen-HyQShift:
Standard - 40 Hours (China)Scheduled Weekly Hours:
40Worker Type:
PermanentJob Summary:
Build and maintain data pipelines and platform components across the full data stack. You will work within an established architecture, contributing reliable, well-tested code while growing your expertise across streaming, batch, storage, and analytics technologies.Job Duties:
Responsibilities- Data Pipelines: Develop, test, and deploy batch (Spark) and streaming (Flink/Spark Structured Streaming) jobs on OpenShift
- Message & Stream: Create and manage Kafka topics, configure connectors, monitor consumer lag, troubleshoot message delivery
- Lakehouse & Storage: Create and maintain Iceberg tables (schema changes, partitioning, maintenance); operate MinIO for data lake workloads
- Query & Serving: Write SQL transformations (dbt), build Trino queries for federated analytics, manage materialized views on StarRocks/ClickHouse
- Orchestration: Author and maintain Airflow/Dagster DAGs; troubleshoot pipeline failures and data quality issues
- Observability: Build Grafana dashboards and Prometheus alerts for pipeline health, data freshness, and quality metrics
- Kubernetes Operations: Write basic Helm charts, manage ConfigMaps/Secrets, troubleshoot pod failures under guidance
- CI/CD: Maintain CI pipelines for data jobs, contribute to ArgoCD application definitions
- Write clear documentation: runbooks, pipeline specs, onboarding guides
- Participate in code reviews and agile ceremonies
- 3 – 6 years in data engineering, software engineering, or DevOps
- Working knowledge of Kubernetes: Pods, Deployments, Services, ConfigMaps, basic Helm usage
- Practical Spark experience: PySpark or Spark SQL batch ETL, reading/writing to object storage and Iceberg tables
- Basic Kafka experience: producing and consuming messages, understanding partitions and offsets
- Understanding of data lake/lakehouse concepts: columnar formats (Parquet/ORC), open table formats (Iceberg/Delta Lake), partitioning, schema evolution
- Experience with an S3-compatible object store (MinIO, AWS S3, Ceph)
- Solid SQL skills; proficient in Python
- Comfortable with Git, Docker, CI/CD, and Linux shell scripting
- Exposure to Trino or Presto for federated queries
- Familiarity with a real-time OLAP engine: StarRocks, ClickHouse, or Doris
- Experience with dbt for data transformation
- Workflow orchestration: Airflow or Dagster
- Interest in data observability, data mesh, and data quality frameworks
Company Introduction:
ITD SZ
港交所科技（深圳）有限公司，是2016年12月28日于深圳市前海自贸区成立的外商独资企业。
作为港交所的技术子公司，港交所科技（深圳）有限公司主要是为集团及其附属公司提供计算机软件、计算机硬件、信息系统、云存储、云计算、物联网和计算机网络的开发、技术服务、技术咨询、技术转让；经济信息咨询、企业管理咨询、商务信息咨询、商业信息咨询、信息系统设计、集成、运行维护；数据库管理、大数据分析；以承接服务外包方式提供系统应用管理和维护、信息技术支持管理、数据处理等信息技术和业务流程外包服务。
Skills Required
- 3–6 years of experience in data engineering, software engineering, or DevOps
- Working knowledge of Kubernetes, including Pods, Deployments, Services, ConfigMaps, and basic Helm usage
- Practical Spark experience with PySpark or Spark SQL batch ETL
- Experience reading and writing to object storage and Iceberg tables
- Basic Kafka experience, including producing and consuming messages and understanding partitions and offsets
- Understanding of data lake and lakehouse concepts, including Parquet or ORC, Iceberg or Delta Lake, partitioning, and schema evolution
- Experience with an S3-compatible object store such as MinIO, AWS S3, or Ceph
- Solid SQL skills
- Proficiency in Python
- Comfort with Git, Docker, CI/CD, and Linux shell scripting
- Exposure to Trino or Presto for federated queries
- Familiarity with StarRocks, ClickHouse, or Doris
- Experience with dbt for data transformation
- Experience with Airflow or Dagster
- Interest in data observability, data mesh, and data quality frameworks
Hong Kong Exchanges Compensation & Benefits Highlights
The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Hong Kong Exchanges and has not been reviewed or approved by Hong Kong Exchanges.
-
Retirement Support — Employer retirement contributions and provident fund structures are described as notably above statutory baselines, with certain entities in the group offering even higher employer pension rates. This strengthens perceived long-term value and helps total compensation feel more robust.
-
Healthcare Strength — Core coverage includes medical and dental insurance alongside life and personal-accident protection, with health checkups and comprehensive plans highlighted. This breadth of health protection is seen as a meaningful pillar of the package.
-
Leave & Time Off Breadth — Paid leave spans multiple categories, including parental and volunteering time, in addition to standard annual and sick leave. This variety adds non-cash value and supports work-life needs.
Hong Kong Exchanges Insights
What We Do
HKEX Group is a global exchange group, operating dynamic and integrated financial markets in Asia and Europe. From our home in the financial hub of Hong Kong and an additional base in London, we provide world-class facilities for trading and clearing securities and derivatives in Equities, Commodities, Fixed Income and Currency. Uniquely positioned at the intersection of Chinese and international capital flows, Hong Kong has long been Connecting China with the World. With the accelerated opening-up of China’s capital markets, HKEX continues to be at the forefront of this historic transition, which we believe will Shape the Global Market Landscape
.png){kind=logo}
