Associate Data Engineer

Associate Data Engineer

Maersk, the world's largest shipping company, is transforming into an industrial digital giant that enables global trade with its land, sea and port assets. We are the digital and software development organization that builds products in the areas of predictive science (forecasting, customer and market analytics), optimization and IoT. This position offers the opportunity to build your engineering career in a data and analytics intensive environment, delivering work that has direct and significant impact on the success of our company. Global data analytics delivers internal apps to grow revenue and optimize costs across Maersk's Transport & Logistics companies. We practice agile development in teams empowered to deliver products end-to-end, for which data and analytics are crucial assets. This is an extremely exciting time to join a fast paced, growing and dynamic team that solves some of the toughest problems in the industry and builds the future of trade & logistics. We are an open-minded, friendly and supportive group who strive for excellence together A.P. Moller - Maersk maintains a strong focus on career development, and strong team members regularly have broad possibilities to expand their skill set and impact in an environment characterized by change and continuous progress.

Job location: Bangalore, India

What we are looking for:

We are seeking a highly motivated Data Engineer to join our growing team. In this role, you will take ownership of designing, developing, and implementing robust data pipelines on leading cloud platforms. You will not only excel in technical execution but also receive guidance and mentorship to senior engineers, fostering a collaborative and high-performing team environment.

Responsibilities:

• Development and implementation of scalable and secure data pipelines on leading cloud platforms (e.g., AWS, GCP, Azure) using services like Data Factory, Databricks, Synapse Analytics, or similar offerings.
• Develop and maintain robust data processing solutions using big data technologies like Spark, Python, and SQL.
• Optimize data pipelines for performance, efficiency, and cost-effectiveness.
• Build data models in Dremio, SQL End point or AAS and present data visually.
• Ensure good data modelling practices are followed to ensure optimized tables.
• Partner with data scientists to define data requirements for machine learning models and ensure high-quality data for training and analysis.
• Conduct exploratory data analysis (EDA) and feature engineering to identify and extract relevant features for model training.
• Proactively monitor, deploy robust data quality frameworks and troubleshoot data pipelines to identify and resolve issues before they impact operations.
• Contribute to the development and documentation of technical standards and best practices including data flow diagrams, Logical designs, physical designs

Qualifications:

• 2+ years of experience in data engineering with a strong focus on cloud platforms. Awareness about azure services is a plus.
• Proven track record of designing, developing, and deploying complex data pipelines at scale.
• In-depth expertise in data ingestion, transformation, and cleansing techniques.
• Mastery of programming languages like Python and SQL, with experience in big data frameworks like Spark (a plus).
• Experience with data warehousing, data lakes, and containerization technologies (Docker, Kubernetes) (a plus).
• Experience with DevOps principles and practices for continuous integration and delivery (CI/CD).
• Excellent communication, collaboration, and problem-solving skills.

Maersk is committed to a diverse and inclusive workplace, and we embrace different styles of thinking. Maersk is an equal opportunities employer and welcomes applicants without regard to race, colour, gender, sex, age, religion, creed, national origin, ancestry, citizenship, marital status, sexual orientation, physical or mental disability, medical condition, pregnancy or parental leave, veteran status, gender identity, genetic information, or any other characteristic protected by applicable law. We will consider qualified applicants with criminal histories in a manner consistent with all legal requirements.

We are happy to support your need for any adjustments during the application and hiring process. If you need special assistance or an accommodation to use our website, apply for a position, or to perform a job, please contact us by emailing [email protected].