Senior Data Engineer

Organization:

At CommBank, we never lose sight of the role we play in other people’s financial wellbeing. Our focus is to help people and businesses move forward to progress. To make the right financial decisions and achieve their dreams, targets, and aspirations. Regardless of where you work within our organisation, your initiative, talent, ideas, and energy all contribute to the impact that we can make with our work. Together we can achieve great things.

Job Title: Senior Data Engineer

Location: Bangalore

Business & Team:

Retail Technology is responsible for the world leading application of technology and operations across every aspect of CommBank, from innovative product platforms for our customers to essential tools within our business. We also use technology to drive efficient and timely processing, an essential component of great customer service.

You will be working as a part of Retail Technology to achieve their strategic objectives through planning, prioritising, delivering and supporting projects and initiatives. Your team’s success will be realised through partnering with business and IT teams across both business domain and Technology to deliver beautiful experiences and exceptional capabilities to our branch applications

Impact & contribution:

• Utilise advanced expertise and a broad range of concepts, technology and domain knowledge to develop and deliver world class software solutions to meet business needs.
• You will contribute to the financial well-being of our customers by ensuring that our team builds the best solutions possible using modern development practices that ensure both functional and non-functional needs are met.

• Conduct incident analysis and triage to minimize downtime effectively.
• Design and implement and support scalable, cloud-native systems and APIs.
• Serve as a Full Stack Developer with strong coding capabilities in .NET and related technologies.
• Work extensively with Oracle Database, focusing on architecture and performance tuning.
• Monitor and resolve issues using tools like Splunk, Grafana, and AppDynamics and .net skill
• Collaborate with cross-functional teams to enhance workflows and reliability.
• Participate in 24/7 on-call support approximately twice every two months, ensuring zero downtime for critical banking applications.
• Be fully engaged during major incidents to restore service promptly.

Key Responsibilities:

• Design and develop highly reliable and scalable data pipelines and data platforms with comprehensive test coverage.
• Collaborate with stakeholders to analyse and translate requirements to technical implementation. Identify and drive opportunities for continuous improvement within the team and in delivery of products.
• Provide mentoring and technical assistance to other members of the team, including more junior Data Engineers.
• Produce high quality, sustainable solutions to meet business requirements, leveraging approved delivery frameworks and by applying industry best practice. Provide technical governance of product delivery to ensure successful delivery and adoption.
• Deliver data engineering solutions aligned to core concepts of data design, preparation, transformation, and load.
• Build and implement data pipelines in distributed data platforms including warehouses, databases, data lakes and cloud lakehouses to enable data predictions and models, and reporting and visualisation analysis via data integration tools and frameworks.
• Contribute to domain planning, providing guidance to ensure that technical deliveries are aligned to engineering direction and strategy.

Essential Skills:

• Apache Spark;
• Big Data; Data Engineering; Design (Job Details);
• Python (Programming Language);
• Spark SQL (Worker Profiles);
• Structured Query Language (SQL); Teamwork

Education Qualifications:

Bachelor’s degree in engineering in Computer Science/Information Technology