Top Data Engineer Jobs in Ipoh

Design, build and optimise scalable cloud data pipelines and transformations; ensure data quality, lineage and reconciliation; support large-scale migrations (profiling, mappings, cleansing); collaborate with business and technical stakeholders; contribute to data architecture and migration frameworks.

Design, build, and maintain scalable ETL and real-time data processing systems on Databricks and AWS. Develop Spark-based pipelines, ensure data quality and governance, implement security controls, automate infrastructure with Terraform, and collaborate with analysts and engineers to resolve issues and optimize performance.

Manage and optimize data pipelines, troubleshoot issues, and provide ongoing support for the Group Application Data Platform in alignment with business requirements.

As a Power Backend Engineer, you will develop data scrapers, enhance product features, optimize API performance, and collaborate with the product team on future development plans.

Provide day-to-day operational support for Back End (BE) Operations and ATO governance, maintain and enhance governance databases, produce reports and dashboards, perform data analysis, coordinate cross-site stakeholders, execute improvement actions, and support process consistency and continuous improvement across BE sites.

Support and optimize large-scale Spark/YARN jobs and storage (S3/EMR). Build job-profiling, cost-analysis, AI-assisted automation, monitoring/alerting (Prometheus, Flink/Spark), and internal ops tooling to improve stability and reduce costs.

Lead mechanical design for data centre projects in Sydney, overseeing performance, energy efficiency, project delivery, client engagement, and mentoring junior engineers while incorporating industry innovations.

Design and execute tests for end-to-end data flows across MongoDB and Azure services, automate UI/API/data-layer tests, validate Power BI reports and SQL/MongoDB transformations, integrate tests into CI/CD, and collaborate with engineering and product teams to identify, document, and resolve data defects.

Develop, deploy, and maintain LLM pipelines and RAG QA/search systems; design and optimize prompts and multi-agent LLM architectures; operate multi‑GPU/cluster inference; build evaluation pipelines for model quality, bias, and hallucination; collaborate with product and CS teams to integrate conversational AI.

Design, develop, and maintain high-performance, highly available backend services and APIs for Big Data products using Java/Python. Manage full service lifecycle, capacity planning, profiling/benchmarking, troubleshooting, security, and system architecture. Contribute to open-source big data projects and build scalable tools for global operations.

Design and build high-throughput reconciliation systems and data pipelines. Implement real-time (Flink) and batch (Hive) workflows, write complex SQL for validation and anomaly detection, collaborate with Finance/Risk/Product on reconciliation rules, optimize for low latency, and leverage AI/LLM tooling to automate triage and improve operations.

Lead design and implementation of scalable, high-performance backend services for traditional and AI-powered search. Own search architecture, optimize indexing/retrieval/ranking, build reusable frameworks, collaborate with data scientists on LLM-enabled search and agents, and deliver robust, low-latency solutions.

Design and develop high-performance backend services for an AI-powered trading assistant: build AI agent execution, trading order execution, AI sub-account and API key lifecycle management, integrate Binance trading APIs, implement skills/tool-calling frameworks, and ensure scalable, low-latency real-time data pipelines, observability, and security.