Senior Data Engineer

Posted Yesterday
Be an Early Applicant
Kuala Lumpur, Wilayah Persekutuan Kuala Lumpur, MYS
In-Office
Senior level
Aerospace • Transportation • Travel
The Role
Provides operational support, troubleshooting, data quality assurance, pipeline optimization, automation, infrastructure redesign, governance, and compliance. Collaborates with product, engineering, and business teams to deliver reliable data solutions and maximize data value. Requires experience with Python or Spark, Airflow, Terraform, ETL, databases, distributed computing, cloud services, workflow tools, version control, and big data frameworks.
Summary Generated by Built In


Job Description

WHAT YOU’LL CHAMPION:

As a Senior Data Engineer, your day-to-day duties will encompass the following areas: 

  • Operational Excellence: Provide essential operational support, including system troubleshooting and implementing technical fixes. 

  • Data Quality Assurance: Ensure absolute data integrity and data quality across environments. 

  • Process Optimization: Continuously improve internal processes through automation, pipeline optimization, and infrastructure re-design. 

  • Cross-Functional Collaboration: Support and collaborate closely with cross-functional and multidisciplinary teams in a fast-paced environment. 

  • Data Impact: Leverage data visualization tools and techniques to maximize the business impact and intrinsic value of data. 

  • Internal Stakeholder Management: Manage technical communication, alignment, and relationships with internal business units, product managers, and engineering teams to ensure data deliverables align with organizational goals. 

  • Governance & Compliance: Contribute to improving data governance policies and maintaining data compliance standards. 

  • Continuous Learning: Keep continuously current with the latest technical and industry developments. 

WHO YOU ARE:

  • BS/MS/PhD in IT, Mathematics, Science or Engineering discipline Up to 4+ yrs relevant experience beyond first degree
  • Experience with one of the following languages: Python, Spark
  • Experience with DAG, airflow, terraform
  • Familiar with data ETL from a wide variety of data sources.
  • Experience with SQL and NoSQL databases.
  • Experience with pipeline and workflow management tools.
  • Experience with various messaging and stream processing.
  • Experience with object-oriented/object function scripting languages.
  • Familiar with containerisation and orchestration tools.
  • Familiar with one of the following cloud-based services: GCP and its tools and services.
  • Ability to work under pressure and change, and balance among speed, reliability, and interpretability.
  • Good working knowledge of productivity tools such as G Suite, Git, Jira, Confluence.
  • Experience with code versioning, code review and documentation.
  • Proficient understanding of distributed computing principles.
  • Able to select and integrate big data tools and frameworks.
  • Familiar or prone to adopt design thinking methods.
  • Openness to experimenting with new techniques and new ways of working.

WHAT YOU’LL ENJOY:

  • Physical Wellbeing: Key medical and insurance benefits, maternity expenses, flexible work arrangement, and health and fitness amenities.
  • Emotional Wellbeing: Paid time off, wellness programmes, and childcare amenities. 
  • Financial Wellbeing: Resources relating to financial, personal skills and career growth programmes.
  • Allstars Specials: Free flights, unlimited discounted flights, and exclusive discounts with partners. 
  • A unique Allstar culture like no other 

OUR HIRING PROCESS:

  • Application received
  • Candidate screening
  • Interview(s) and assessment(s)
  • Background check and/or other assessments
  • Offer and negotiation

Skills Required

  • BS, MS, or PhD in IT, Mathematics, Science, or Engineering
  • Up to 4+ years of relevant experience beyond the first degree
  • Experience with Python or Spark
  • Experience with DAG, Airflow, and Terraform
  • Experience with ETL from a wide variety of data sources
  • Experience with SQL and NoSQL databases
  • Experience with pipeline and workflow management tools
  • Experience with messaging and stream processing
  • Experience with object-oriented or functional scripting languages
  • Familiarity with containerization and orchestration tools
  • Familiarity with GCP cloud services and tools
  • Working knowledge of G Suite, Git, Jira, and Confluence
  • Experience with code versioning, code review, and documentation
  • Understanding of distributed computing principles
  • Ability to select and integrate big data tools and frameworks
  • Ability to work under pressure and adapt to change
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Sepang, Selangor Darul Ehsan
13,132 Employees
Year Founded: 2001

What We Do

It all starts here. 23 years ago, a dream took flight - shaping and forever changing the travel industry in Asia. The idea was simple: Make flying affordable for everyone. We made that dream happen. We started an airline in 2001. Today, we’ve evolved to become something much bigger. We’re now a world-class brand, a leading Asean airline, a digital travel and lifestyle platform; and we’re not stopping. If you’re passionate about connecting people and transforming lives, we want you onboard. When it comes to your career, your Allstar journey will be an adventure. Find your dream career destination with us

Similar Jobs

In-Office or Remote
2 Locations
27791 Employees

Binance Logo Binance

Data Engineer

Blockchain • Fintech • Software • Cryptocurrency • Metaverse
In-Office or Remote
19 Locations
7696 Employees

Binance Logo Binance

Artificial Intelligence Engineer

Blockchain • Fintech • Software • Cryptocurrency • Metaverse
In-Office or Remote
19 Locations
7696 Employees

Mudah.my Logo Mudah.my

Senior Data Engineer

Marketing Tech • Software
Hybrid
Kuala Lumpur, Wilayah Persekutuan Kuala Lumpur, MYS
234 Employees

Similar Companies Hiring

Toro TMS Thumbnail
Cloud • Enterprise Web • Sales • Software • Transportation
Chicago, IL
80 Employees
Outpost Space Thumbnail
Aerospace • Defense
US
24 Employees
Revel.io Thumbnail
Aerospace • Hardware • Robotics • Software
US
50 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account