Top Data Engineer Jobs in Ipoh

Build and operate scalable financial market data pipelines for Binance stock products and AI applications. Responsibilities include sourcing, ingesting, modeling, processing, storing, and serving real-time and historical data; designing multi-market data frameworks; optimizing Flink pipelines; and establishing quality, reconciliation, monitoring, lineage, and recovery systems. The role also evaluates vendors and data sources, defines data contracts, and collaborates with trading, product, AI, legal, and compliance teams.

Build and operate scalable financial market data infrastructure, including source evaluation, ingestion, cleansing, modeling, real-time and batch processing, quality governance, reconciliation, monitoring, and data services. Develop Flink-based pipelines supporting trading, research, and AI applications. Partner with product, trading, compliance, procurement, and engineering teams to define data contracts, source strategies, and consistent financial data semantics across markets.

Support the design, development, and optimization of data pipelines, ETL/ELT processes, data models, and cloud-based data solutions using Databricks, Python, and SQL. Perform data quality validation, documentation, testing, deployment, and troubleshooting. Collaborate with engineers, architects, analysts, and stakeholders while exploring AI-assisted development tools, generative AI, and prompt engineering for data engineering use cases.

Supports the design, development, and optimization of data pipelines, ETL/ELT processes, data models, and data quality workflows using Databricks, Python, SQL, and cloud-based platforms. The intern collaborates with engineers, architects, analysts, and stakeholders; participates in testing, deployment, Agile ceremonies, and documentation; and explores AI-assisted development, prompt engineering, and Generative AI proof-of-concepts for data engineering.

Build and operate production-grade AI data pipelines and financial knowledge services for equities content. Responsibilities include processing text, tables, documents, and multimedia; creating knowledge bases and search indexes; engineering RAG retrieval and citation systems; integrating LLMs and NLP models; managing orchestration, APIs, quality, cost, observability, reliability, and scalable production operations.

Design, build, and maintain scalable ETL and real-time data processing systems on Databricks and AWS. Develop Spark-based pipelines, ensure data quality and governance, implement security controls, automate infrastructure with Terraform, and collaborate with analysts and engineers to resolve issues and optimize performance.

Lead mechanical design for data centre projects in Sydney, overseeing performance, energy efficiency, project delivery, client engagement, and mentoring junior engineers while incorporating industry innovations.

Design and execute tests for end-to-end data flows across MongoDB and Azure services, automate UI/API/data-layer tests, validate Power BI reports and SQL/MongoDB transformations, integrate tests into CI/CD, and collaborate with engineering and product teams to identify, document, and resolve data defects.

Develop, deploy, and maintain LLM pipelines and RAG QA/search systems; design and optimize prompts and multi-agent LLM architectures; operate multi‑GPU/cluster inference; build evaluation pipelines for model quality, bias, and hallucination; collaborate with product and CS teams to integrate conversational AI.

Lead supplier quality analytics for outsourced foundry, assembly, and test subcontractors. Build ELT pipelines, data validation, automated testing, and interactive dashboards (Spotfire/PowerBI). Use statistical modeling to track, predict, and resolve manufacturing variability, support continuous improvement, and provide weekend rotational support.