Senior Data Engineer

Posted 4 Days Ago
Easy Apply
Be an Early Applicant
Kuala Lumpur, Wilayah Persekutuan Kuala Lumpur
In-Office
Senior level
Information Technology
The Role
Design, develop, document and maintain end-to-end batch and real-time data pipelines, ETL/ELT workflows, and large-scale data architectures. Improve data quality, perform data profiling and transformation, collaborate with architects and stakeholders, provide production support, testing, and deliver data solutions using big-data technologies.
Summary Generated by Built In

Join New Era Technology, where People First is at the heart of everything we do. With a global team of over 4,500 professionals, we're committed to creating a workplace where everyone feels valued, empowered, and inspired to grow. Our mission is to securely connect people, places, and information with end-to-end technology solutions at scale.

At New Era, you'll join a team-oriented culture that prioritizes your personal and professional development. Work alongside industry-certified experts, access continuous training, and enjoy competitive benefits. Guided by our core attributes — putting people first, embracing continuous learning, and thriving through collaboration and inclusion — we nurture our people to deliver exceptional customer service.

If you want to make an impact in a supportive, growth-oriented environment, New Era is the place for you. Apply today and help us shape the future of work—together

🌟 Hiring: Senior Data Engineer – Malaysia (Client Location) | New Era Technology 🌟

Client Location: Kuala Lumpur
Company: New Era Technology – www.neweratech.com
Work Type: Full-Time, Permanent

 🚀 About the Role:

New Era Technology is looking for experienced Senior Data Engineer to be deployed at our prestigious client in Malaysia at their Kuala Lumpur office. A role to be responsible for system design, development and implementation of regional frontend systems. Provide maintenance and support on production systems.

🛠️ Key Responsibilities:

  • Design, develop, document and implement end-to-end data pipelines and data integration processes, both batch and real-time. This include data analysis, data profiling, data cleansing, data lineage, data mapping, data transformation, developing ETL / ELT jobs and workflows, and deployment of data solutions.
  • Monitor, recommend, develop and implement ways to improve data quality including reliability, efficiency and cleanliness, and to optimize and fine-tune ETL / ELT processes.
  • Recommend, execute and deliver best practices in data management and data lifecycle processes, including modular development of ETL / ELT processes, coding and configuration standards, error handling and notification
  • standards, auditing standards, and data archival standards.
  • Prepare test data, assist in creating and execute test plans, test cases and test scripts.
  • Collaborate with Data Architect, Data Modeler, IT team members, SMEs, vendors and internal business stakeholders, to understand data needs, gather requirements and implement data solutions to deliver business goals.
  • BAU support for any data issues and change requests, document all investigations, findings, recommendations and resolutions.

KEY PERFORMANCE INDICATORS

  • Maturity level on technical skillsets of management and development on big data platform including data modeling design, data transformation, big data programming and performance tuning
  • Effectiveness of project contribution, including from technical support, project management and team collaboration perspective, to deliver data lake system on assigned local countries
  • Level of understanding on business requirements and capability to transform them into technical solution
  • Variety of new technologies (such as Azure and AWS Big Data Solution, Power BI, Tableau, Python and etc) and techniques being learnt that can be applied to solution delivery

EXTERNAL & INTERNAL CONTACTS

  • Group Infrastructure Team, Security Teams and Operation Team
  • Group Project Team
  • Local country Project Team (IT and User)
  • IT Vendors and/or Service Providers

🎓 Qualification & Experience:

  • Bachelor's degree in IT, Computer Science or related Engineering.
  • At least 5 years of relevant experience in data engineering or related field
  • In-depth understanding of data structures, algorithms, databases, and software engineering.
  • Experience in data management and data warehousing technologies (data mart, data lake, lake house)
  • Ability to write efficient and scalable code
  • Experience with end-to-end data processing pipelines, ETL/ELT, and data warehousing
  • Knowledge of distributed systems and experience working with distributed data processing technologies.
  • 5+ years of professional experience in implementing operational data stores, data warehouses, data mart and large scale data architectures in Unix and/or Windows environments
  • 5+ years of hands-on ETL development experience, including transforming complex data structures from multiple sources.
  • 5+ years of experience with big data technologies including Azure and AWS, Azure data factory, Databricks, Synapse, Hadoop, Hive, Storm, Presto, and real-time data transformation and processing technologies such as Confluent Kafka, ksqldb, kstream, Apache Flink, and Apache Spark Streaming.
  • 5+ years of experience in implementing data models using dimensional modeling and data vault modeling techniques.
  • Experience with scripting languages such as Shell, Perl or Python
  • Experience with any software development methodologies.

KNOWLEDGE & TECHNICAL SKILLS

  • Strong knowledge of various database technologies (RDBMS, NoSQL, and columnar).
  • Ability to handle and process different types of data (structured, semi-structured, and unstructured).
  • Strong proficiency in at least one programming language such as Python, Java or Scala.
  • Knowledge of MDM, Data Governance tools, and Informatica technologies.
  • Prior experience in the insurance industry is an advantage.
  • Knowledge of data security and privacy best practices, such as encryption and data masking
  • DevOps (CI/CD) and data privacy regulations knowledge.

Good to Have

  • Experience in API development and integration. E.g. SOAP, RestAPI
  • Build and modify APIs(Restful) and programs using Phyton or Java
  • Please share your updated resume along with the below details.

 👤 Preferred Candidate:

  • Nationality: Malaysians preferred
  • Availability: Candidates who can join immediate or 30-60days notice.

📧 How to Apply:
Send your updated resume to [email protected] 


New Era Technology, LLC., and its subsidiaries (“New Era” “we”, “us”, or “our”) in its operating regions worldwide are committed to respecting your privacy and recognize the need for appropriate protection and management of any Personal Data that you may provide us. In this, we are also committed to providing you with a positive experience on our websites and while using our products, services and solutions (“Solutions”).

View our Privacy Policy here https://www.neweratech.com/us/privacy-policy/

We never ask candidates to pay any fees at any point in our hiring process. If you are ever asked to provide payment for training, certification, equipment, or any other purpose, it is not from our company. Only communications from our official company channels should be trusted. Please note our official email domain is @neweratech.com. If you suspect fraudulent activity, please contact us immediately at [email protected]

Top Skills

Azure,Aws,Azure Data Factory,Databricks,Synapse,Hadoop,Hive,Storm,Presto,Confluent Kafka,Ksqldb,Kstream,Apache Flink,Apache Spark Streaming,Python,Java,Scala,Shell,Perl,Rdbms,Nosql,Columnar Databases,Etl,Elt,Data Lake,Data Mart,Data Warehouse,Data Vault,Dimensional Modeling,Mdm,Data Governance,Informatica,Power Bi,Tableau,Devops (Ci/Cd),Rest Api,Soap,Data Masking,Encryption
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: New York, NY
1,535 Employees

What We Do

New Era Technology is a global managed technology service provider. New Era serves as a trusted adviser to more than 14,500 customers worldwide. Customers rely on New Era’s seamless blend of solutions that securely connect people, places, and information in a rapidly changing digital world. New Era has offices in the Americas, the United Kingdom, APAC, and Europe.

New Era provides solutions and services to diverse industries including Global Enterprise, Banking & Finance, Smart Buildings & IoT, Healthcare, Education, and Government.

Solutions and Services:
• Collaboration & Unified Communications
• Data Networking
• Digital Transformation
• SecureBlu Security Services
• CloudBlu Cloud Services
• Physical Security & Life Safety
• Managed Services
• Professional Services

Similar Jobs

MoneyHero Group Logo MoneyHero Group

Senior Data Engineer

Insurance • Financial Services
Easy Apply
In-Office
Kuala Lumpur, Wilayah Persekutuan Kuala Lumpur, MYS
296 Employees
In-Office
Kuala Lumpur, Wilayah Persekutuan Kuala Lumpur, MYS
5814 Employees

Lalamove Logo Lalamove

Senior Data Engineer

Logistics • Software • Transportation
In-Office or Remote
Kuala Lumpur, Wilayah Persekutuan Kuala Lumpur, MYS
4387 Employees
In-Office
KL Eco City, Kuala Lumpur, Wilayah Persekutuan Kuala Lumpur, MYS
9995 Employees

Similar Companies Hiring

Axle Health Thumbnail
Logistics • Information Technology • Healthtech • Artificial Intelligence
Santa Monica, CA
19 Employees
Scrunch AI Thumbnail
Software • SEO • Marketing Tech • Information Technology • Artificial Intelligence
Salt Lake City, Utah
Standard Template Labs Thumbnail
Software • Information Technology • Artificial Intelligence
New York, NY
15 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account