Top Data Engineer Jobs in Kuala Lumpur

Design, build, and maintain scalable ETL and real-time data processing systems on Databricks and AWS. Develop Spark-based pipelines, ensure data quality and governance, implement security controls, automate infrastructure with Terraform, and collaborate with analysts and engineers to resolve issues and optimize performance.

As a Power Backend Engineer, you will develop data scrapers, enhance product features, optimize API performance, and collaborate with the product team on future development plans.

Lead site-based CSA activities for data centre projects: manage contractors, ensure compliance with design, safety and quality, coordinate stakeholders, produce reports, and support project leadership.

Provide day-to-day operational support for Back End (BE) Operations and ATO governance, maintain and enhance governance databases, produce reports and dashboards, perform data analysis, coordinate cross-site stakeholders, execute improvement actions, and support process consistency and continuous improvement across BE sites.

Support and optimize large-scale Spark/YARN jobs and storage (S3/EMR). Build job-profiling, cost-analysis, AI-assisted automation, monitoring/alerting (Prometheus, Flink/Spark), and internal ops tooling to improve stability and reduce costs.

Lead mechanical design for data centre projects in Sydney, overseeing performance, energy efficiency, project delivery, client engagement, and mentoring junior engineers while incorporating industry innovations.

Own and operate the cloud data platform, maintain IaC, optimize warehouse cost/performance, build and maintain batch and real-time ingestion and transformation pipelines, operate BI platform, and design AI-powered applications and agents (RAG/LLM-backed). Partner with stakeholders, mentor teammates, document runbooks, and drive data platform reliability and security.

Design and execute tests for end-to-end data flows across MongoDB and Azure services, automate UI/API/data-layer tests, validate Power BI reports and SQL/MongoDB transformations, integrate tests into CI/CD, and collaborate with engineering and product teams to identify, document, and resolve data defects.

Develop, deploy, and maintain LLM pipelines and RAG QA/search systems; design and optimize prompts and multi-agent LLM architectures; operate multi‑GPU/cluster inference; build evaluation pipelines for model quality, bias, and hallucination; collaborate with product and CS teams to integrate conversational AI.

Design and build high-throughput reconciliation systems and data pipelines. Implement real-time (Flink) and batch (Hive) workflows, write complex SQL for validation and anomaly detection, collaborate with Finance/Risk/Product on reconciliation rules, optimize for low latency, and leverage AI/LLM tooling to automate triage and improve operations.