Databricks Engineer

About the team:

Capco is a fully independent, global management and technology consultancy. For nearly 20 years we have combined innovative thinking with deep industry knowledge to deliver business consulting, digital transformation and technology services to Finance and Energy markets. Our collaborative and efficient approach helps clients reduce costs and manage risk and regulatory change while increasing revenues. We are thinkers, innovators, and disruptors. We are small enough to care but large enough to matter

About the Job:

As a member of our Data Team, you will design and implement a comprehensive data strategy, ensuring high-quality data management, transformation, and integration to meet project goals. You will need a strong background in data migration from RDBMS to Databricks, and a deep understanding of modern data architecture principles. You will collaborate with stakeholders, and leverage best practices in data governance, analytics, and process optimization.

What You’ll Get to Do:

• Implement scalable data solutions on Databricks to drive business insights and operational efficiency
• Translate complex business requirements into technical solutions, leveraging Databricks and modern data platforms
• Lead strategic data migrations from legacy RDBMS systems to cloud-native Databricks environments with minimal disruption
• Design and optimize data pipelines that support enterprise-wide analytics, reporting, and machine learning initiatives
• Develop robust ETL frameworks using Databricks to ensure high-quality, timely, and secure data delivery
• Continuously improve data workflows for performance, scalability, and cost-efficiency, aligning with business KPIs
• Collaborate with cross-functional teams—including product, analytics, and IT—to align data solutions with organizational goals
• Establish and enforce data engineering best practices, ensuring consistency, quality, and compliance across projects.
• Evaluate emerging technologies and recommend tools that enhance data capabilities and business values
• Mentor junior engineers, fostering a culture of continuous learning and technical excellence
• Operationalize machine learning pipelines on Databricks, from data preparation to model deployment and monitoring
• Partner with DevOps and infrastructure teams to ensure reliable and secure deployment of data systems
• Ensure compliance with data governance, privacy, and regulatory standards, integrating controls into data workflows
• Align data architecture with enterprise IT strategy, working closely with architects and leadership to support long-term scalability

What You’ll Bring With You:

• Proven experience delivering data-driven solutions using Databricks, with a focus on business impact and scalability
• Databricks certifications and hands-on expertise in building ETL pipelines, data lakes, and ML workflows
• Experience with cloud platforms such as AWS, Azure, or GCP, and understanding of their data ecosystems
• Strong grasp of big data technologies (e.g., Spark, Delta Lake) and modern data architecture principles
• Proficient in machine learning lifecycle management using tools like MLflow, scikit-learn, and Spark MLlib
• Deep understanding of data modeling, warehousing, and SQL, with experience in both traditional and cloud-native environments
• Skills in Python and SQL, with the ability to write clean, maintainable, and efficient code
• Knowledge of data governance, quality frameworks, and security best practices
• Familiarity with containerization (Docker) and orchestration (Kubernetes) for scalable deployments
• Strong analytical and problem-solving skills, with a consulting mindset for identifying opportunities and delivering value
• Excellent communication and stakeholder management skills, with experience presenting technical concepts to non-technical audiences
• Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field

Why Capco? 

A career at Capco is a chance to help reshape the competitive landscape in financial services.  We launch new banks, transform existing ones, and help our clients navigate complex change.  As consultants, we work on the front-end business design all the way through to technology implementation.

We are the largest Financial Services focused consultancy in the world, serving everyone from global banks to emerging FinTechs, from strategy through digital transformation, design, business consulting, data and analytics, cyber, cloud, technology architecture, and engineering.

Capco is a young and growing firm. We maintain an entrepreneurial spirit and growth mindset and have minimal bureaucracy. We have no internal silos that get in the way of your career opportunities or ability to focus on our clients and make a difference to the business.  We offer the opportunity for everyone to learn rapidly, take on tough challenges, and get promoted quickly. We take pride in our creative, collaborative, diverse, and inclusive culture, where everyone can #BYAW.

We offer highly competitive benefits, including medical, dental and vision insurance, a 401(k) plan, tuition reimbursement, and a work culture focused on innovation and creation of lasting value for our clients and employees

Ready to get started?

If this sounds like you, we would love to hear from you. This is an opportunity to make a difference and contribute to a highly successful company with a significant growth trajectory.

We have been informed of several recruitment scams targeting the public. We strongly advise you to verify identities before engaging in recruitment related communication. All official Capco communication will be conducted via a Capco recruiter.