Senior Data Engineer

Posted 9 Days Ago
Be an Early Applicant
KL Eco City, Kuala Lumpur, Wilayah Persekutuan Kuala Lumpur
In-Office
Senior level
Information Technology
The Role
The Senior Data Engineer will design, develop, and implement data pipelines and integration processes, improve data quality, and collaborate with teams to meet business goals. They will also support data issues and document findings.
Summary Generated by Built In

Join New Era Technology, where People First is at the heart of everything we do. With a global team of over 4,500 professionals, we’re committed to creating a workplace where everyone feels valued, empowered, and inspired to grow. Our mission is to securely connect people, places, and information with end-to-end technology solutions at scale.
At New Era, you’ll join a team-oriented culture that prioritizes your personal and professional development. Work alongside industry-certified experts, access continuous training, and enjoy competitive benefits. Driven by values like Community, Integrity, Agility, and Commitment, we nurture our people to deliver exceptional customer service.
If you want to make an impact in a supportive, growth-oriented environment, New Era is the place for you. Apply today and help us shape the future of work—together.


🌟 Hiring: Senior Data Engineer – Malaysia (Client Location) | New Era Technology 🌟

Client Location: KL, Malaysia
Company: New Era Technology – www.neweratech.com
Work Type: Permanent


🚀 About the Role:

New Era Technology is looking for experienced Senior Data Engineer to be deployed at our prestigious client in Malaysia at their KL office.


🛠️ Key Responsibilities:

  1. Design, develop, document and implement end to-end data pipelines and data integration processes, both batch and real-time. This include data analysis, data profiling, data cleansing, data lineage, data mapping, data transformation, developing ETL / ELT jobs and workflows, and deployment of data solutions.
  2. Monitor, recommend, develop and implement ways to improve data quality including reliability, efficiency and cleanliness, and to optimize and fine-tune ETL / ELT processes.
  3. Recommend, execute and deliver best practices in data management and data lifecycle processes, including modular development of ETL / ELT processes, coding and configuration standards, error handling and notification standards, auditing standards, and data archival standards.
  4. Prepare test data, assist to create and execute test plans, test cases and test scripts.
  5. Collaborate with Data Architect, Data Modeler, IT team members, SMEs, vendors and internal business stakeholders, to understand data needs, gather requirements and implement data solutions to deliver business goals.
  6. BAU support for any data issues and change requests, document all investigations, findings, recommendations and resolutions.

KEY PERFORMANCE INDICATORS

  1. Maturity level on technical skillsets of management and development on big data platform including data modeling design, data transformation, big data programming and performance tuning
  2. Effectiveness of project contribution, including from technical support, project management and team collaboration perspective, to deliver data lake system on assigned local countries
  3. Level of understanding on business requirements and capability to transform them into technical solution
  4. Variety of new technologies (such as Azure and AWS Big Data Solution, Power BI, Tableau, Python and etc) and techniques being learnt that can be applied to solution delivery

🎓 Qualification & Experience:

  1. Bachelor in IT, Computer Science or Engineering.
  2. At least 3-5 years of using Big Data technologies like Azure and AWS Big Data Solution, Hadoop, Hive, HBase, Spark, Sqoop, Kafka and Spark Streaming.
  3. Minimum 5 years of professional experience in data warehouse, operational data store, and large scale data architecture implementations in Unix or/and Windows environment.
  4. At least 3+ years of solid hands-on development experience with ETL development to transform complex data structure in multiple data sources environment.
  5. At least 5 years data model (relational and/or data warehouse), data mart design and implementation.
  6. Minimum 3-5 years ETL programming in any of these languages including Python, Scala, Java or R
  7. Experience on Azure Databricks for ETL/ELT development and big data analytics programming in Python
  8. Strong Experience with various of ETL/ELT frameworks, data warehousing concepts, data management framework and data lifecycle processes.
  9. Solid understanding on Azure Data Management Solution including Azure Data Factory, Azure Databricks, Azure Blob storage (Gen2) and Azure Synapse

KNOWLEDGE & TECHNICAL SKILLS

  1. Familiar with ETL/ELT framework, data warehousing concepts, data management framework and data lifecycle processes.
  2. Experienced in handling and processing different types of data (structured, semi structured and unstructured).
  3. Strong knowledge in various database technologies (RDBMS, NoSQL and columnar).
  4. Preferably with a good understanding of data analytics and data visualization, strongly prefer Power BI and Tableau.
  5. Strong understanding of programming languages like Python, Scala, Java, R, Shell and PLSQL
  6. Good understanding on Master Data Management (MDM) and Data Governance Tools preferring Informatica technologies
  7. Experienced working in insurance industry will be an added advantage.
  8. Ability to communicate and present technical information in a clear and unambiguous manner.
  9. Strong ability to work independently and cooperate with diverse teams in a multiple stakeholder’s environment.
  10. Strong sense of work ownership, high affinity with anything data and a desire for constant improvements.
  11. Experience in API development and integration. E.g. SOAP, RestAPI
  12. Build and modify APIs(Restful) and programs using Phyton and Java

👤 Preferred Candidate:

  • Nationality: Malaysians only
  • Availability: Candidates who can join max in 60 days.

📧 How to Apply:
Send your updated resume to [email protected] with the subject line:
“ Senior Data Engineer (Perm)- Malaysia”


🔗 About Us:
New Era Technology (www.neweratech.com) is a global IT services provider with a footprint in 80+ countries, delivering cutting-edge digital transformation, consulting, and staffing services across industries


                                                                                                             


New Era Technology, Inc., and its subsidiaries (“New Era” “we”, “us”, or “our”) in its operating regions worldwide are committed to respecting your privacy and recognize the need for appropriate protection and management of any Personal Data that you may provide us. In this, we are also committed to providing you with a positive experience on our websites and while using our products, services and solutions (“Solutions”).
View our Privacy Policy here https://www.neweratech.com/us/privacy-policy/

Top Skills

Aws Big Data Solution
Azure
Azure Blob Storage
Azure Data Factory
Azure Databricks
Azure Synapse
Hadoop
Hbase
Hive
Java
Kafka
Power BI
Python
R
Scala
Spark
Spark Streaming
Sqoop
Tableau
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: New York, NY
1,535 Employees

What We Do

New Era Technology is a global managed technology service provider. New Era serves as a trusted adviser to more than 14,500 customers worldwide. Customers rely on New Era’s seamless blend of solutions that securely connect people, places, and information in a rapidly changing digital world. New Era has offices in the Americas, the United Kingdom, APAC, and Europe.

New Era provides solutions and services to diverse industries including Global Enterprise, Banking & Finance, Smart Buildings & IoT, Healthcare, Education, and Government.

Solutions and Services:
• Collaboration & Unified Communications
• Data Networking
• Digital Transformation
• SecureBlu Security Services
• CloudBlu Cloud Services
• Physical Security & Life Safety
• Managed Services
• Professional Services

Similar Jobs

Lalamove Logo Lalamove

Senior Data Engineer

Logistics • Software • Transportation
In-Office or Remote
Kuala Lumpur, Wilayah Persekutuan Kuala Lumpur, MYS
4387 Employees
In-Office
KL Eco City, Kuala Lumpur, Wilayah Persekutuan Kuala Lumpur, MYS
9995 Employees

Encora Logo Encora

Senior Data Engineer

Software • Consulting
In-Office
Kuala Lumpur, Wilayah Persekutuan Kuala Lumpur, MYS
7456 Employees

Unison Consulting Logo Unison Consulting

Senior Data Protection Engineer Level 3

Information Technology • Consulting
In-Office
Kuala Lumpur, Wilayah Persekutuan Kuala Lumpur, MYS
96 Employees

Similar Companies Hiring

Axle Health Thumbnail
Logistics • Information Technology • Healthtech • Artificial Intelligence
Santa Monica, CA
17 Employees
Scrunch AI Thumbnail
Software • SEO • Marketing Tech • Information Technology • Artificial Intelligence
Salt Lake City, Utah
Standard Template Labs Thumbnail
Software • Information Technology • Artificial Intelligence
New York, NY
10 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account