The work
- The Senior Data Engineer will have the responsibility for the design and maintenance of enterprise data warehouse for various projects, as well as providing on-going support for activities impacting all enterprise databases. The ideal candidate will have hands-on experience with Azure Data Factory, Azure Data Lake, Azure Function App, Logic App, REST APIs, mapping dataflow, and Event Hub. As a key member of our team, you will collaborate with various stakeholders to ensure efficient data flow, storage, and integration, while employing best practices in data engineering.
The core responsibilities
- Design, develop, and maintain scalable Synapse pipelines for data ingestion, processing, and transformation in Azure data platform.
- Develop and optimize T-SQL and Python-based data processing scripts and integrate them with Synapse pipelines for ETL tasks and data transformations.
- Design and develop mapping dataflow solutions for complex data transformations.
- Develop and maintain data storage solutions, ensuring efficient data retrieval and storage on Azure Data Lake and databases.
- Implement and maintain API integrations, including REST APIs, for seamless data flow between systems.
- Design and test the end-to-end process for data ingestion, data transformation, data cleansing, data delivery, data quality and data timeliness.
- Implement and ensure data security and privacy measures, complying with industry standards and regulations.
- Monitor and optimize the performance of Azure data services, Azure Synapse pipelines, Function Apps, and Logic Apps.
- Improve the scalability, efficiency, and cost-effectiveness of data pipelines.
- Participate in Joint Application Development sessions with business units to gather and understand their data and reporting requirements.
- Create and maintain technical documentations for tools, development, and procedures.
- Provide inputs and assist in enablement of Cloud based data solutions.
- Develop and recommend innovative approaches to solve business and technical problems.
- Work and collaborate with the larger team to exchange knowledge, solutions, and practices to build a more consistent, robust approach to development.
- Continuously improve performance and proactively identify and resolve bottlenecks that will reduce time to build and deliver our products.
- Troubleshoot and resolve data-related issues in a timely manner.
Let's talk about you!!
- Bachelor's degree or equivalent in the field of Computer Science or Engineering
- 5+ years of Proven experience as a Data Engineer, specifically working with Microsoft Azure technologies.
- Proficient in T-SQL, Mapping Dataflow and Python programming language
- Hands-on experience with Azure data services, including Azure Data Factory, Azure Data Lake, Azure Function App, Azure Logic App, Azure SQL Database, Azure Synapse Analytics, mapping dataflow, and Event Hub.
- Solid understanding of data warehousing concepts and best practices.
- Experience with Data modeling.
- Experience in working with structured, semi-structured and unstructured data.
- Excellent written and verbal communication skills
- Excellent multi-tasking and organizational skills
- Microsoft Certified: Azure Data Engineer Associate or Azure Solutions Architect Expert
- Experience in DevOps pipelines and CI/CD.
- Experience in writing data quality routines for cleansing of data and capturing confidence score.
- Project/Program/Portfolio management experience
- Experience working in financial industry.
- Experience with Agile and Waterfall SDLC methodologies
- Experience with Atlassian (Confluence and JIRA)
- Knowledge of big data technologies such as Apache Spark
Similar Jobs
What We Do
MakeBank on everyday banking: Earn high interest on every dollar Say no to fees No minimum balances Powered by Equitable Bank, a Schedule I Canadian Bank EQB Inc. (formerly Equitable Group Inc.) trades on the Toronto Stock Exchange (TSX: EQB and EQB.PR.C), directly serves over 607,000 Canadians through its wholly owned subsidiary Equitable Bank, Canada's Challenger Bank™, and serves over 200 Canadian credit unions that serve over 6 million of their members with products and services. Equitable Bank has grown to become Canada's 7th largest independent Schedule I bank with over a $119 billion in assets under management and assets under administration, and a clear mandate to drive real change in Canadian banking to enrich people's lives. At Equitable Bank, we are as invested in our employees as we are in our business. That’s why we are consistently recognized as one of Canada's Top Employers – a rating that comes from our 1,800 employees. Equitable Bank’s inclusive, welcoming, and pride-inducing workplace earned it the honour of being recognized as one of the top 50 organizations on the 2023 list of Canada’s Best Workplaces™. Founded over 50 years ago, Equitable Bank provides diversified personal and commercial banking, and through its EQ Bank platform (eqbank.ca), which has been named #1 Bank in Canada for three consecutive years on the Forbes World's Best Banks list for 2021, 2022, and 2023. Equitable Bank website: www.equitablebank.ca EQ Bank website: www.eqbank.ca Specialties Lending, Mortgages, Residential Lending, Commercial Lending, Reverse mortgages, Insurance lending, Equipment leasing , Credit Union, Trust, and Funds Management
