Senior Data Engineer – Databricks, dbt & GenAI

Posted An Hour Ago
Be an Early Applicant
2 Locations
In-Office
Senior level
Cloud • Information Technology • Consulting
The Role
Design and maintain scalable enterprise data platforms supporting analytics, machine learning, and Generative AI. Build Databricks and dbt pipelines, dimensional models, semantic layers, RAG and vectorized data workflows, ingestion frameworks, governance controls, and CI/CD processes. Optimize platform performance, reliability, security, and data quality while collaborating with AI engineers, data scientists, architects, cloud teams, and business stakeholders.
Summary Generated by Built In

Who We Are

At Kyndryl, we run and reimagine the mission-critical technology systems that drive advantage for the world’s leading businesses.  We are at the heart of progress; with proven expertise and a continuous flow of AI-powered insight, enabling smarter decisions, faster innovation, and a lasting competitive edge. For our people—Kyndryls—that means doing purposeful work that powers human progress. Join us and experience a flexible, supportive environment where your well-being is prioritized and your potential can thrive.


The Role

Your Role


As a Senior Data Engineer – Databricks, dbt & GenAI at Kyndryl, you will design and build the advanced data platforms that power next-generation AI and Generative AI solutions. You will leverage your expertise in Databricks, dbt, Python, and modern data architectures to create scalable, intelligent, and high-performing data ecosystems that enable AI-driven innovation across the enterprise.

You will work with large volumes of structured and unstructured data, developing robust data pipelines, semantic data layers, and retrieval frameworks that support Generative AI, advanced analytics, and business transformation initiatives. By ensuring data quality, accessibility, governance, and operational excellence, you will help organizations unlock the full potential of AI-ready data platforms.

Join Kyndryl and gain the trust, autonomy, and collaboration needed to help shape the future of data engineering and Generative AI.


What You Will Do


  • Design and build scalable data pipelines supporting Generative AI, advanced analytics, and enterprise data initiatives.
  • Develop and optimize Retrieval-Augmented Generation (RAG) frameworks by preparing, transforming, and managing large volumes of enterprise data for AI-driven applications.
  • Create and maintain vectorized data processing pipelines that enable fast and accurate retrieval of information for AI and agentic workflows.
  • Build semantic data layers, knowledge frameworks, and contextual datasets that improve the effectiveness and accuracy of AI-powered solutions.
  • Develop and manage dbt models, macros, tests, documentation, and deployment pipelines to ensure trusted and reusable data assets.
  • Leverage Databricks Lakehouse capabilities, including Delta Lake, Databricks SQL, Unity Catalog, and Workflows, to deliver scalable and secure data solutions.
  • Implement automated data quality controls, governance frameworks, and validation processes to identify data inconsistencies, bias, duplication, and compliance risks.
  • Collaborate with AI Engineers, Data Scientists, Architects, and Business Stakeholders to translate business requirements into scalable technical solutions.
  • Build, deploy, and maintain CI/CD pipelines that support continuous integration, testing, and delivery of data engineering solutions.
  • Monitor, troubleshoot, and optimize data platform performance, reliability, scalability, and operational efficiency.
  • Drive engineering best practices in data modeling, version control, testing, documentation, security, and cloud-native development.

If you are passionate about modern data engineering, Databricks, dbt, cloud technologies, and Generative AI, this is the role for you. You will work alongside talented professionals on innovative projects that help organizations accelerate data-driven transformation and unlock new business opportunities through AI.


Your Future at Kyndryl


As a Senior Data Engineer – Databricks, dbt & GenAI, you will collaborate closely with AI specialists, Data Scientists, Data Architects, Cloud Engineers, and Business Leaders to solve complex data and AI challenges. Whether you aspire to become a Lead Data Engineer, Data Architect, AI Platform Engineer, GenAI Solutions Architect, or Data Engineering Manager, Kyndryl provides the opportunities, mentorship, and resources to accelerate your professional growth and help shape the future of enterprise AI and modern data platforms.


Who You Are

You're good at what you do and possess the required experience to prove it. However, equally important, you have a growth mindset and are committed to continuous learning and professional development. You are customer-focused, passionate about building modern data platforms, and thrive in collaborative, fast-paced environments. You enjoy solving complex data challenges, enabling AI-driven innovation, and delivering scalable, production-grade solutions that create business value.


Required Technical and Professional Expertise


  • 7+ years of hands-on experience in Data Engineering, with a proven track record of designing, developing, deploying, and supporting enterprise-scale data solutions in production environments.
  • Expert-level proficiency in dbt Core, including project structuring, model development, macros, testing, documentation, source management, environment configuration, CI/CD integration, and production troubleshooting.
  • Strong hands-on experience with the Databricks Lakehouse Platform, including Databricks SQL, Unity Catalog, Delta Lake, Databricks Workflows, and performance optimization techniques.
  • Advanced proficiency in SQL, including complex transformations, query optimization, dimensional modeling, partitioning strategies, data warehousing concepts, and large-scale analytical workloads.
  • Strong experience designing and implementing dimensional models (SCD Type 1 and Type 2), enterprise reporting layers, and scalable data products.
  • Proficiency in Python for data engineering, automation, orchestration, and ingestion frameworks.
  • Experience developing and supporting data ingestion pipelines from diverse sources including REST APIs, SFTP, relational databases, cloud storage platforms, and large-scale file-based datasets.
  • Strong understanding of Generative AI concepts, including Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), embeddings, vector databases, semantic layers, and AI-ready data architectures.
  • Experience preparing, governing, and optimizing enterprise data for AI, machine learning, and GenAI use cases.
  • Hands-on experience implementing and enforcing enterprise data governance, security, lineage, and quality frameworks using Databricks Unity Catalog and dbt testing capabilities.
  • Experience designing and building governed, reusable, and scalable data products that support analytics, AI, and business transformation initiatives.
  • Strong understanding of cloud services including object storage (ADLS/GCS), secret management (Azure Key Vault/GCP Secret Manager), compute services, containers, and serverless architectures.
  • Experience establishing and supporting CI/CD pipelines for data platforms using GitHub Actions and modern DevOps practices.
  • Strong troubleshooting, performance tuning, monitoring, and operational support experience within cloud-based data platforms.
  • Excellent communication, collaboration, and stakeholder management skills with the ability to work effectively across global teams.

Preferred Technical and Professional Experience


  • Experience working in multi-cloud environments, including Azure and Google Cloud Platform (GCP).
  • Hands-on experience with dlt (Data Load Tool) or similar modern ingestion and orchestration frameworks.
  • Knowledge of enterprise data governance, metadata management, data cataloging, and lineage best practices.
  • Experience developing data products that support Agentic AI, GenAI, machine learning, or advanced analytics initiatives.
  • Familiarity with vector databases and semantic data architectures supporting AI-driven applications.
  • Advanced Python development experience including Object-Oriented Programming (OOP), decorators, multi-threading, and optimization techniques.
  • Experience with Infrastructure as Code (IaC) tools such as Terraform.
  • Familiarity with Power BI integration, semantic modeling, and performance optimization within Databricks environments.
  • Experience mentoring junior engineers through code reviews, pair programming, technical coaching, and engineering best practices.


Being You

The “Kyn” in Kyndryl means kinship, which represents the strong bonds we have with each other, our customers and our communities. We focus on ensuring all Kyndryls feel included and we welcome people of all cultures, backgrounds, and experiences. Even if you don’t meet every requirement, we encourage you to apply. We believe in growth, and we’re excited to see what you can bring. At Kyndryl, employee feedback has told us that our number one driver of employee engagement is belonging. That sense of belonging — being a valued, respected, trusted member of the team — is fundamental to our culture and fueling great experiences for our customers. This dedication to welcoming everyone into our company means that Kyndryl gives you the ability to thrive and contribute to our culture of empathy and shared success. That’s The Kyndryl Way.

What You Can Expect

Your career with us isn’t just a job—it’s an adventure with purpose.  We offer a dynamic, hybrid-friendly culture that supports your well-being and empowers you to grow. Our Be Well programs are thoughtfully designed to support your financial, mental, physical, and social health—because we know that when you feel your best, you do your best.
From your very first day, you’ll dive into impactful work that powers the systems our customers rely on every day. You won’t just contribute—you’ll make a difference, tackling meaningful projects that sharpen your skills and fuel your growth.
We’re here to champion your journey. With powerful tools to chart your career path, personalized development goals aligned with your ambitions, and continuous feedback to keep you inspired and on track, you’ll have everything you need to thrive and evolve. You’ll develop in-demand skills to grow your career and achieve your ambitions with access to cutting-edge learning opportunities—from certifications with Microsoft, Google, and Amazon to coaching and hands-on experiences. And through it all, you’ll be part of a culture that values empathy, restless learning, and a devotion to shared success.
We want you to thrive here—and we’re committed to helping you do just that. Ready to make an impact? Join us and help shape what’s next.

Get Referred!

If you know someone that works at Kyndryl, when asked ‘How Did You Hear About Us’ during the application process, select ‘Employee Referral’ and enter your contact's Kyndryl email address.

Skills Required

  • 7+ years of hands-on experience in data engineering, including enterprise-scale production data solutions
  • Expert proficiency in dbt Core, including models, macros, testing, documentation, source management, configuration, CI/CD, and troubleshooting
  • Strong hands-on experience with Databricks Lakehouse, Databricks SQL, Unity Catalog, Delta Lake, and Databricks Workflows
  • Advanced SQL proficiency, including complex transformations, query optimization, dimensional modeling, partitioning, and data warehousing
  • Experience designing dimensional models, including SCD Type 1 and Type 2, reporting layers, and scalable data products
  • Proficiency in Python for data engineering, automation, orchestration, and ingestion frameworks
  • Experience building ingestion pipelines from REST APIs, SFTP, relational databases, cloud storage, and large-scale file datasets
  • Understanding of Generative AI, LLMs, RAG, embeddings, vector databases, semantic layers, and AI-ready data architectures
  • Experience preparing, governing, and optimizing enterprise data for AI, machine learning, and Generative AI use cases
  • Experience implementing data governance, security, lineage, and quality frameworks using Unity Catalog and dbt testing
  • Experience building governed, reusable, scalable data products for analytics, AI, and business transformation
  • Strong understanding of cloud services, including object storage, secret management, compute, containers, and serverless architectures
  • Experience establishing and supporting CI/CD pipelines using GitHub Actions and modern DevOps practices
  • Strong troubleshooting, performance tuning, monitoring, and operational support experience for cloud data platforms
  • Excellent communication, collaboration, and stakeholder management skills across global teams
  • Experience with multi-cloud environments, including Azure and Google Cloud Platform
  • Experience with dlt or similar ingestion and orchestration frameworks
  • Knowledge of metadata management, data cataloging, and lineage best practices
  • Experience developing data products for Agentic AI, Generative AI, machine learning, or advanced analytics
  • Advanced Python development, including object-oriented programming, decorators, multithreading, and optimization
  • Experience with Infrastructure as Code tools such as Terraform
  • Familiarity with Power BI integration, semantic modeling, and Databricks performance optimization
  • Experience mentoring junior engineers through code reviews, pair programming, and technical coaching

Kyndryl Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Kyndryl and has not been reviewed or approved by Kyndryl.

  • Fair & Transparent Compensation — Pay is considered good in some roles, with mentions of “good pay,” “great pay and benefits,” and an “acceptable salary range” paired with bonuses. Certain senior or consulting tracks are described as market-competitive.
  • Leave & Time Off Breadth — Vacation, paid time off, holidays, and a dedicated volunteer day are highlighted as positives. Parental leave exists companywide alongside sick leave and disability coverage.
  • Wellbeing & Lifestyle Benefits — Remote and hybrid flexibility is emphasized, including 100% remote roles and a formal flexible workplace policy. Well‑being resources such as the Be Well program and an EAP are available.

Kyndryl Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: New York, NY
46,070 Employees
Year Founded: 2021

What We Do

We have the world’s best talent that design, run, and manage the most advanced and reliable technology infrastructure each day. Together, we think holistically about the health of these vital technology ecosystems. We are a focused, independent company that builds on our foundation of excellence by creating systems in new ways. Bringing in the right partners, investing in our business, and working side-by-side with our customers to unlock potential. We're raising the bar. Our experience speaks for itself: We have 90,000 highly skilled employees around the world serving 75 of the Fortune 100. But our purpose is what drives us: Advancing the vital systems that power human progress. Because when a digital ecosystem is healthy, it can more readily adapt and support continuous growth and that opens up a world of possibility for everyone.

Similar Jobs

Mondelēz International Logo Mondelēz International

Platform Engineer

Big Data • Food • Hardware • Machine Learning • Retail • Automation • Manufacturing
Remote or Hybrid
India
90000 Employees

TransUnion Logo TransUnion

Windows Server Administrator

Big Data • Fintech • Information Technology • Business Intelligence • Financial Services • Cybersecurity • Big Data Analytics
Hybrid
Chennai, Tamil Nadu, IND
13000 Employees

McCain Foods Logo McCain Foods

Business Development Exec RTL Chennai

Food • Retail • Agriculture • Manufacturing
In-Office
Chennai, Tamil Nadu, IND
20000 Employees

Tapestry - Coach and Kate Spade Logo Tapestry - Coach and Kate Spade

Manager, Production Operations

eCommerce • Fashion • Retail • Sales • Wearables • Design
Remote or Hybrid
India
16000 Employees

Similar Companies Hiring

NODA AI Thumbnail
Artificial Intelligence • Information Technology • Software • Cybersecurity • Defense • Defense Technology
Austin, TX
54 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
567 Employees
RapidScale Thumbnail
Cloud • Information Technology • Consulting
Raleigh, NC
600 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account