Senior Consultant, Data Developer

Posted 5 Days Ago
Be an Early Applicant
Toronto, ON, CAN
In-Office
Senior level
Fintech • Payments • Financial Services
The Role
Lead design, development, and optimization of Databricks/Spark-based ETL/ELT pipelines on Azure. Drive architecture decisions for lakehouse and data warehouse layers, improve performance, enforce data quality and governance, mentor junior engineers, and collaborate across stakeholders to deliver production-ready data solutions.
Summary Generated by Built In

We’re building a relationship-oriented bank for the modern world. We need talented, passionate professionals who are dedicated to doing what’s right for our clients.

At CIBC, we embrace your strengths and your ambitions, so you are empowered at work. Our team members have what they need to make a meaningful impact and are truly valued for who they are and what they contribute.

To learn more about CIBC, please visit CIBC.com

What You'll Be Doing

You’ll join a team focused on building modern, scalable data solutions that power analytics, reporting, and enterprise data transformation. As a Senior Consultant, Databricks Developer, you’ll lead the design, development, and optimization of data engineering solutions using Azure Databricks, Apache Spark, and cloud-based data services. You’ll translate business and analytics needs into reliable technical solutions, supporting batch and near real-time data processing across complex environments. In this role, you’ll drive engineering excellence by improving performance, strengthening data quality and security controls, and contributing to architecture decisions across lakehouse and enterprise data platforms. You’ll also collaborate closely with architects, analysts, DevOps partners, and business stakeholders while mentoring junior team members and supporting successful delivery across the full development lifecycle.

At CIBC we enable the work environment most optimal for you to thrive in your role. You’ll have the flexibility to manage your work activities within a hybrid work arrangement where you’ll spend 1-3 days per week on-site, while other days will be remote.

How You'll Succeed

  • Design and development - Lead the design, build, and maintenance of scalable ETL and ELT pipelines using Databricks, Apache Spark, PySpark, Python, and SQL. Develop reusable frameworks, utilities, and components that improve consistency, efficiency, and maintainability.
  • Solution architecture - Translate business requirements into practical data solutions and contribute to architecture decisions across lakehouse, data warehouse, and enterprise integration environments. Support the implementation of bronze, silver, and gold data layers and promote sound data modeling and storage practices.
  • Performance optimization - Tune Spark jobs, Databricks clusters, notebooks, and workflows to improve scalability, reliability, and cost efficiency. Strengthen monitoring, logging, alerting, and error-handling practices to support stable production operations.
  • Data quality and governance - Implement validation, reconciliation, and data quality controls across pipelines and datasets. Ensure solutions align with enterprise expectations for governance, lineage, privacy, access control, and secure development practices.
  • Delivery leadership - Partner with architects, analysts, data scientists, application teams, and business stakeholders to deliver complex data initiatives. Review code, uphold engineering standards, provide technical guidance, and contribute to agile planning, estimation, releases, and production support.
  • Continuous improvement - Investigate incidents, resolve defects, and perform root cause analysis to improve long-term platform health. Recommend enhancements to deployment pipelines, testing practices, and operational readiness that increase development productivity and solution resilience.

Who You Are

  • You have deep Databricks and Spark expertise. You bring strong hands-on experience building and optimizing data engineering solutions with Databricks, Apache Spark, PySpark, Python, and SQL in cloud-based environments.
  • You’re a solution-focused technical leader. You can turn complex business and analytics requirements into scalable, secure, and practical data solutions. You make thoughtful design decisions and understand the trade-offs between speed, quality, cost, and risk.
  • You have strong engineering and optimization skills, at least 4+ years. You understand distributed data processing, Data Lake, data lakes, lakehouse architecture, performance tuning, and pipeline optimization. You’re comfortable improving jobs, workflows, and platform performance across development and production environments.
  • You know how to build with control and care. You have experience with data quality practices, governance requirements, metadata management, and secure development approaches, including access controls and auditability. Experience working in regulated environments such as banking or financial services is an asset.
  • You work well with others and elevate the team. You communicate clearly with technical and non-technical partners, collaborate effectively across cross-functional teams, and enjoy mentoring developers to support strong delivery outcomes and shared engineering standards.
  • You have modern delivery experience. You’re familiar with orchestration and delivery tools such as Azure Data Factory, Feed Hub, Autosys Airflow, GitHub, Powershell Scripts and DevSecOps or CI/CD practices using GIT Hub Actions, Artifactory and Vaults experience with Structured Streaming, Unity Catalog, or machine learning pipelines on Databricks is considered an asset, Knowledge of Giene and Claude  on Data Bricks is an Asset.
  • Values matter to you. You bring your real self to work and live our values of trust, teamwork, and accountability.

What CIBC Offers

At CIBC, your goals are a priority. We start with your strengths and ambitions as an employee and strive to create opportunities to tap into your potential. We aspire to give you a career, rather than just a paycheck.

  • We work to recognize you in meaningful, personalized ways including a competitive salary, incentive pay, banking benefits, a benefits program*, defined benefit pension plan*, an employee share purchase plan, a vacation offering, wellbeing support, and MomentMakers, our social, points-based recognition program.

  • Our spaces and technological toolkit will make it simple to bring together great minds to create innovative solutions that make a difference for our clients.

  • We cultivate a culture where you can express your ambition through initiatives like Purpose Day; a paid day off dedicated for you to use to invest in your growth and development.

*Subject to plan and program terms and conditions

What you need to know

  • CIBC is committed to creating an inclusive environment where all team members and clients feel like they belong. We seek applicants with a wide range of abilities and we provide an accessible candidate experience. If you need accommodation, please contact [email protected]

  • CIBC is committed to clarity in our hiring process. All roles posted are opportunities we’re actively recruiting for, unless stated otherwise.

  • You need to be legally eligible to work at the location(s) specified above and, where applicable, must have a valid work or study permit.

  • We may ask you to complete an attribute-based assessment and other skills test (such as simulation, coding, French proficiency).

  • We use artificial intelligence tools during the recruitment process. Our goal for the application process is to get to know more about you, all that you have to offer, and give you the opportunity to learn more about us.

Job Location

Toronto-81 Bay, 11th Floor

Employment Type

Regular

Weekly Hours

37.5

Skills

Automation, Automation, Azure Data Factory, Cloud Platform, Collaboration, Database Modeling, Databricks Platform, Data Engineering, Data Governance, Data Integration, Data Lake, Data Pipelines, Data Solutions, Design, DevOps, DevSecOps, Enterprise Data, Enterprise Data Integration, Integration Solutions, Judgement, Microsoft Azure, Microsoft Azure Databricks, Performance Tuning, Problem Solving, Programming Languages {+ 4 more}

Skills Required

  • Hands-on experience with Azure Databricks and Databricks platform
  • Proficient with Apache Spark and PySpark
  • Strong Python and SQL skills
  • At least 4+ years relevant data engineering experience
  • Experience designing and building scalable ETL/ELT pipelines
  • Experience with performance tuning of Spark jobs, clusters, and workflows
  • Experience with data quality, validation, reconciliation, and governance practices
  • Familiarity with Azure Data Factory, Feed Hub, Autosys, or Airflow
  • Familiarity with GitHub, PowerShell scripting, CI/CD and DevSecOps practices
  • Experience with monitoring, logging, alerting, and production support
  • Ability to translate business requirements into data solutions and contribute to architecture
  • Mentoring, code review, and delivery leadership experience
  • Experience with Structured Streaming, Unity Catalog, or ML pipelines on Databricks
  • Experience in regulated environments such as banking/financial services
  • Knowledge of Giene and Claude on Databricks
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Toronto, Ontario
43,351 Employees

What We Do

CIBC is here to help all our clients reach their goals. We know the importance of reliable financial products and services, and we’re dedicated to providing them in a way that lets you bank however you want, whenever you want. With innovative tools designed around your priorities and a team fully focused on your success, you’ll get the insights you need to get even closer to achieving your goals. This culture of innovation and shared values of trust, teamwork and accountability are why we’ve been named a top employer in Canada. They’re also why a career at CIBC is more than a job—it’s an opportunity to grow and work alongside some of the brightest in Canada. La Banque CIBC est là pour aider tous nos clients à atteindre leurs objectifs. Nous connaissons l'importance de produits et services financiers fiables, et nous nous engageons à les fournir d'une manière qui vous permette d'effectuer vos opérations bancaires comme vous le souhaitez, quand vous le souhaitez. Avec des outils innovants conçus autour de vos priorités et une équipe entièrement centrée sur votre réussite, vous obtiendrez les informations dont vous avez besoin pour vous rapprocher encore plus de vos objectifs. Cette culture de l'innovation et les valeurs partagées de confiance, de travail d'équipe et de responsabilité sont la raison pour laquelle nous avons été nommés l'un des meilleurs employeurs au Canada. C'est aussi pourquoi une carrière à la Banque CIBC est plus qu'un emploi : c'est une occasion de grandir et de travailler aux côtés de certaines des personnes plus brillantes au Canada

Similar Jobs

Arm Logo Arm

Senior SoC Verification Engineer

Artificial Intelligence • Internet of Things • Semiconductor
Hybrid
Toronto, ON, CAN
8314 Employees
126K-170K Annually

Samsara Logo Samsara

Staff Software Engineer

Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Easy Apply
Remote or Hybrid
CA
4000 Employees
162K-290K Annually

Samsara Logo Samsara

Senior Data Engineer

Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Easy Apply
Remote or Hybrid
Canada
4000 Employees
136K-160K Annually

Samsara Logo Samsara

Senior Security Operations Engineer I

Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Easy Apply
Remote or Hybrid
Canada
4000 Employees
133K-172K Annually

Similar Companies Hiring

Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account