Senior Data Engineer

Posted 27 Days Ago
Be an Early Applicant
Kuala Lumpur, Wilayah Persekutuan Kuala Lumpur, MYS
In-Office
Senior level
Aerospace • Transportation • Travel
The Role
Provides operational support, troubleshooting, data quality assurance, pipeline optimization, automation, infrastructure redesign, governance, and compliance. Collaborates with product, engineering, and business teams to deliver reliable data solutions and maximize data value. Requires experience with Python or Spark, Airflow, Terraform, ETL, databases, distributed computing, cloud services, workflow tools, version control, and big data frameworks.
Summary Generated by Built In


Job Description

WHAT YOU’LL CHAMPION:

As a Senior Data Engineer, your day-to-day duties will encompass the following areas: 

  • Operational Excellence: Provide essential operational support, including system troubleshooting and implementing technical fixes. 

  • Data Quality Assurance: Ensure absolute data integrity and data quality across environments. 

  • Process Optimization: Continuously improve internal processes through automation, pipeline optimization, and infrastructure re-design. 

  • Cross-Functional Collaboration: Support and collaborate closely with cross-functional and multidisciplinary teams in a fast-paced environment. 

  • Data Impact: Leverage data visualization tools and techniques to maximize the business impact and intrinsic value of data. 

  • Internal Stakeholder Management: Manage technical communication, alignment, and relationships with internal business units, product managers, and engineering teams to ensure data deliverables align with organizational goals. 

  • Governance & Compliance: Contribute to improving data governance policies and maintaining data compliance standards. 

  • Continuous Learning: Keep continuously current with the latest technical and industry developments. 

WHO YOU ARE:

  • BS/MS/PhD in IT, Mathematics, Science or Engineering discipline Up to 4+ yrs relevant experience beyond first degree
  • Experience with one of the following languages: Python, Spark
  • Experience with DAG, airflow, terraform
  • Familiar with data ETL from a wide variety of data sources.
  • Experience with SQL and NoSQL databases.
  • Experience with pipeline and workflow management tools.
  • Experience with various messaging and stream processing.
  • Experience with object-oriented/object function scripting languages.
  • Familiar with containerisation and orchestration tools.
  • Familiar with one of the following cloud-based services: GCP and its tools and services.
  • Ability to work under pressure and change, and balance among speed, reliability, and interpretability.
  • Good working knowledge of productivity tools such as G Suite, Git, Jira, Confluence.
  • Experience with code versioning, code review and documentation.
  • Proficient understanding of distributed computing principles.
  • Able to select and integrate big data tools and frameworks.
  • Familiar or prone to adopt design thinking methods.
  • Openness to experimenting with new techniques and new ways of working.
    ​

WHAT YOU’LL ENJOY:

  • Physical Wellbeing: Key medical and insurance benefits, maternity expenses, flexible work arrangement, and health and fitness amenities.
  • Emotional Wellbeing: Paid time off, wellness programmes, and childcare amenities. 
  • Financial Wellbeing: Resources relating to financial, personal skills and career growth programmes.
  • Allstars Specials: Free flights, unlimited discounted flights, and exclusive discounts with partners. 
  • A unique Allstar culture like no other 

OUR HIRING PROCESS:

  • Application received
  • Candidate screening
  • Interview(s) and assessment(s)
  • Background check and/or other assessments
  • Offer and negotiation

Skills Required

  • BS, MS, or PhD in IT, Mathematics, Science, or Engineering
  • Up to 4+ years of relevant experience beyond the first degree
  • Experience with Python or Spark
  • Experience with DAG, Airflow, and Terraform
  • Experience with ETL from a wide variety of data sources
  • Experience with SQL and NoSQL databases
  • Experience with pipeline and workflow management tools
  • Experience with messaging and stream processing
  • Experience with object-oriented or functional scripting languages
  • Familiarity with containerization and orchestration tools
  • Familiarity with GCP cloud services and tools
  • Working knowledge of G Suite, Git, Jira, and Confluence
  • Experience with code versioning, code review, and documentation
  • Understanding of distributed computing principles
  • Ability to select and integrate big data tools and frameworks
  • Ability to work under pressure and adapt to change
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Sepang, Selangor Darul Ehsan
13,132 Employees
Year Founded: 2001

What We Do

It all starts here. 23 years ago, a dream took flight - shaping and forever changing the travel industry in Asia. The idea was simple: Make flying affordable for everyone. We made that dream happen. We started an airline in 2001. Today, we’ve evolved to become something much bigger. We’re now a world-class brand, a leading Asean airline, a digital travel and lifestyle platform; and we’re not stopping. If you’re passionate about connecting people and transforming lives, we want you onboard. When it comes to your career, your Allstar journey will be an adventure. Find your dream career destination with us

Similar Jobs

Cognite Logo Cognite

Senior Data Engineer

Artificial Intelligence • Machine Learning • Software • Analytics • Industrial • Generative AI • Big Data Analytics
Remote or Hybrid
Malaysia
751 Employees

Ultra Tendency Logo Ultra Tendency

Senior Data Engineer

Artificial Intelligence • Big Data • Cloud • Consulting
In-Office
Kuala Lumpur, Wilayah Persekutuan Kuala Lumpur, MYS
98 Employees

Encora Logo Encora

Senior Data Engineer

Software • Consulting
In-Office
Kuala Lumpur, Wilayah Persekutuan Kuala Lumpur, MYS
7456 Employees

Guidewire Software Logo Guidewire Software

Senior Site Reliability Engineer

Cloud • Information Technology • Insurance • Software • Analytics
In-Office
Kuala Lumpur, Wilayah Persekutuan Kuala Lumpur, MYS
3400 Employees

Similar Companies Hiring

Outpost Space Thumbnail
Aerospace • Defense
Los Angeles, California
38 Employees
Revel Thumbnail
Aerospace • Hardware • Robotics • Software
Marina Del Rey, California
70 Employees
Vega Thumbnail
Artificial Intelligence • Automotive • Insurance • Transportation
US
65 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account