Involve Asia is seeking a Data Engineer who will be responsible for supporting data analysts and software engineers by providing maintainable infrastructure and tooling to deliver end-to-end solutions to business problems. The successful candidate will work with terabytes of data in a complex data environment supporting multiple products and data stakeholders.
As a Data Engineer, you will be responsible for designing and implementing an analytical environment using in-house and third-party tools. You will use Python and/or Java to automate data activities and enable efficient processing of data that is growing in both volume and complexity. You will also design and implement complex data pipelines and data models for analytical consumption, using tools such as EMR, Kubernetes, Airflow and more.
You will write scalable and performant queries running over billions of rows of data, and help simplify these processing to enable insights to be more easily extractable from them. You should have deep experience in designing and managing large datasets and pipelines to enable business use-cases.
Key Responsibilities:
● Design, implement, operate, and improve the analytics platform
● Design data solutions using various big data technologies and low latency architectures
● Collaborate with data scientists, data analysts, product managers, software engineers, and other data engineers to develop, implement, and validate deployed data solutions
● Maintain the data warehouse with timely and quality data
● Build and maintain data pipelines from internal databases and SaaS applications
● Understand and implement data engineering best practices
● Improve, manage, and teach standards for code maintainability and performance in code submitted and reviewed
● Plan and build application to acquire the data
Qualifications:
● 0 - 3 years of professional experience in data engineering, software engineering, or related fields. Fresh graduates with strong academic projects, internships, or demonstrable skills in Python, SQL, and data systems are encouraged to apply
● Bachelor's degree in a quantitative field (e.g., statistics, mathematics, computer science, engineering)
● Expert at writing and optimizing SQL queries
● Proficiency in Python, Java or similar languages
● Familiarity with data warehousing concepts
● Experience in Airflow or other workflow orchestrators
● Familiarity with basic principles of distributed computing
● Experience with big data technologies like Spark, Delta Lake or others
● Proven ability to innovate and leading delivery of a complex solution
● Excellent verbal and written communication - proven ability to communicate with technical teams and summarize complex analyses in business terms
● Ability to work with shifting deadlines in a fast-paced environment
Desirable Qualifications:
● Authoritative in ETL optimisation, designing, coding, and tuning big data processes using Spark
● Knowledge of big data architecture concepts like Lambda or Kappa
● Experience with streaming workflows to process datasets at low latencies
● Experience in managing data - ensuring data quality, tracking lineages, improving data discovery and consumption
● Sound knowledge of distributed systems - able to optimize partitioning, distribution and MPP of high-level data structures
● Experience in working with large databases, efficiently moving billions of rows, and complex data modeling
● Familiarity with AWS is a big plus
● Experience in planning day-to-day tasks, knowing how and what to prioritize, and overseeing their execution
● Have experience as backend or full stack software engineer
Top Skills
What We Do
Involve Asia Technologies Sdn Bhd (1017157-V) is a business headquartered in Kuala Lumpur, Malaysia.
We provide a platform for advertisers to measure, manage and scale their marketing partnerships by automating workflows and providing attribution to marketing campaigns. Using its proprietary cookie-less tracking technology, for highly accurate, future-proofed digital marketing.
Founded in 2014, Involve is backed by major venture capital firms such as Bintang Capital Partners, 500 Global, OSK Technology Ventures, and Cradle Seed Ventures and has an established presence with teams across Southeast Asia including Malaysia, Indonesia, the Philippines, Singapore, Thailand, and Vietnam.
Here in Involve, we are looking for creative and ambitious talents to join our team on this upward and onward journey. We lead with a growth mindset and the belief that the combination of each individual’s passions and skills carry the company upward and forward. At Involve, all ideas are listened to, and brainstorming means that job titles get left at the door. This is where self-starters can really make their mark, thriving and evolving as they go.
If making an impact gives you a reason to roll out of bed in the mornings, come join us
.jpeg)
