Principal Data Engineer - Databricks

Job Posted 4 Days Ago Posted 4 Days Ago
Be an Early Applicant
Bengaluru, Karnataka
Hybrid
Senior level
Healthtech • Software • Analytics • Biotech • Pharmaceutical • Manufacturing
Takeda exists to create better health for people, brighter future for the world.
The Role
The Principal Data Engineer is responsible for designing and implementing Databricks solutions to support data transformation initiatives, focusing on scalability, governance, and collaboration with cross-functional teams.
Summary Generated by Built In

By clicking the "Apply" button, I understand that my employment application process with Takeda will commence and that the information I provide in my application will be processed in line with Takeda's Privacy Notice and Terms of Use. I further attest that all information I submit in my employment application is true to the best of my knowledge.
Job Description
The Future Begins Here
At Takeda, we are leading digital evolution and global transformation. By building innovative solutions and future-ready capabilities, we are meeting the need of patients, our people, and the planet.
Bengaluru, the city, which is India's epicenter of Innovation, has been selected to be home to Takeda's recently launched Innovation Capability Center. We invite you to join our digital transformation journey. In this role, you will have the opportunity to boost your skills and become the heart of an innovative engine that is contributing to global impact and improvement.
At Takeda's ICC we Unite in Diversity
Takeda is committed to creating an inclusive and collaborative workplace, where individuals are recognized for their backgrounds and abilities they bring to our company. We are continuously improving our collaborators journey in Takeda, and we welcome applications from all qualified candidates. Here, you will feel welcomed, respected, and valued as an important contributor to our diverse team.
The Opportunity
The Principal Data Engineer - Databricks is responsible for designing, building, and delivering Databricks platform capabilities and solutions to enable Takeda's Data & Digital Transformation, paving the way for an AI-powered intelligent platform. This role requires a deep understanding of Databricks architecture, cloud computing, and modern data platform strategies to drive efficiency, scalability, and innovation.
A Databricks Platform Architect creates an end-to-end vision for Enterprise Data Platforms, integrating evolving technology and business needs into a cohesive, user-centric framework. A product-centric mindset, focus on reducing time to market, and ability to develop reusable frameworks and automation patterns are essential.
The architect will collaborate with fellow architects, product owners, and engineering teams to define the roadmap for Databricks infrastructure, automation, governance, and patterns supporting complex data use cases aligned with Takeda's Data & Digital strategy.
Responsibilities

  • Develop and execute a strategic roadmap for Databricks platform capabilities, ensuring alignment with Takeda's data transformation initiatives.
  • Design and implement scalable, serverless, and well-architected Databricks solutions to support data products, AI/ML workloads, and analytics use cases.
  • Enable data access, governance, and self-service analytics through Unity Catalog, Delta Sharing, and data mesh principles.
  • Define reusable frameworks, automation patterns, and DevOps practices for infrastructure as code (IaC), CI/CD, and monitoring.
  • Drive data platform observability, implementing Databricks Lakehouse Monitoring and cost optimization strategies.
  • Establish and enforce data quality, compliance, security, and privacy policies, aligning with HIPAA, SOX, and GxP requirements.
  • Collaborate with Data Engineers, Scientists, and Analysts to optimize workflows and performance within Databricks.
  • Develop integration strategies with Informatica, AWS services (S3, Glue, Lambda, IAM), and streaming technologies like Kafka.
  • Lead Proof of Concepts (PoCs) and innovation initiatives in Generative AI, LLMs, and Databricks AI/ML capabilities.
  • Partner with vendors and service providers to evaluate new tools and technologies that enhance Databricks capabilities.
  • Define KPIs and dashboards for monitoring Databricks platform health, performance, and cost


Skills and Qualifications

  • Bachelor's degree in Computer Science, Engineering, or a related field with 8+ years of relevant experience; Master's degree with 6+ years of experience.
  • 12+ years of hands-on experience in enterprise/data platform architecture, strategy, and solution development.
  • 5+ years of experience in the pharmaceutical/life sciences industry (preferred), including technical architecture, data management, and AI/ML integration.


Core Technical Expertise:

  • Databricks Expert: 5+ years of experience in Databricks, including Unity Catalog, Delta Lake, Delta Sharing, Photon, MLflow, and Data Engineering/Science workloads.
  • Cloud Platforms & Infrastructure: Deep expertise in AWS (preferred) with experience in GCP/Azure being a plus. Must have experience with serverless architectures, security, identity management, and governance (IAM, AD, encryption, privacy policies).
  • Data & AI/ML Platforms: Strong knowledge of GenAI, LLMs, MLOps, Deep Learning, Data Science, and Model Deployment. Experience with Dataiku, DataRobot, Hugging Face, and AI frameworks is a plus.
  • Infrastructure Automation & DevOps: 3+ years of experience implementing IaC (Terraform preferred, CloudFormation, Ansible, Chef) and CI/CD pipelines for data platforms.
  • Data Management & Engineering: Hands-on experience with Data Lakes, Data Mesh, Data Fabric, Streaming (Kafka), ETL/ELT, Data Warehousing, Advanced Analytics, GraphQL, and Orchestration (Airflow, Tidal, databricks workflow).
  • Programming & Automation: Strong coding skills in Python, Spark, SQL, Shell scripting; experience with GitHub Actions, Ansible, and Terraform for platform automation is required.
  • Security, Governance & Compliance: Deep knowledge of Unity Catalog, data privacy (HIPAA, GDPR, GxP, SOX), access control, encryption, auditing, FinOps, and observability (Splunk, AppDynamics, Wiz, SonarCloud).


Enterprise Architecture & Leadership:

  • Familiarity with TOGAF (preferred), Zachman, or other EA frameworks.
  • Experience designing self-service data platforms, modern API-based architectures, and enterprise governance frameworks.
  • Ability to translate complex business problems into scalable, high-performing architectures.
  • Strong stakeholder management, presentation, and leadership skills, with the ability to align cross-functional teams on technical decisions.


Added Value:

  • Databricks Certifications
  • AWS Certifications


BENEFITS
It is our priority to provide competitive compensation and a benefit package that bridges your personal life with your professional career. Amongst our benefits are:

  • Competitive Salary + Performance Annual Bonus
  • Flexible work environment, including hybrid working
  • Comprehensive Healthcare Insurance Plans for self, spouse, and children
  • Group Term Life Insurance and Group Accident Insurance programs
  • Health & Wellness programs including annual health screening, weekly health sessions for employees.
  • Employee Assistance Program
  • 3 days of leave every year for Voluntary Service in additional to Humanitarian Leaves
  • Broad Variety of learning platforms
  • Diversity, Equity, and Inclusion Programs
  • Reimbursements - Home Internet & Mobile Phone
  • Employee Referral Program
  • Leaves - Paternity Leave (4 Weeks) , Maternity Leave (up to 26 weeks), Bereavement Leave (5 calendar days)


ABOUT ICC IN TAKEDA:

  • Takeda is leading a digital revolution. We're not just transforming our company; we're improving the lives of millions of patients who rely on our medicines every day.
  • As an organization, we are committed to our cloud-driven business transformation and believe the ICCs are the catalysts of change for our global organization.


Locations
IND - Bengaluru
Worker Type
Employee
Worker Sub-Type
Regular
Time Type
Full time

Top Skills

Ansible
AWS
Azure
Chef
CloudFormation
Databricks
Dataiku
Datarobot
GCP
Hugging Face
Kafka
Python
Shell Scripting
Spark
SQL
Terraform

What the Team is Saying

Person1
Christina Alves
Head of Biotherapeutics Process Development
“Along with incredibly passionate colleagues, there's a clear commitment to invest in the best facilities and the right equipment needed to successfully perform world-class science.“
Christina Alves
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Cambridge, MA
50,000 Employees
Hybrid Workplace
Year Founded: 1781

What We Do

For over 240 years, Takeda’s propensity to evolve has driven the next generation of innovation, and as a future-focused organization, we’re continuing to drive forward with endurance in our steadfast pursuit to achieve the best outcomes for our patients in a rapidly changing world. 

We have been preparing for this period of value creation by investing in data, digital and technology, and we’re proud of our employees and their commitment to turning groundbreaking ideas into life-changing impacts.  

Since our founding in Japan, integrity and putting patients first have been at the heart of our identity, and we will emerge ready for our future as one of the most trusted and science-driven digital biopharmaceutical companies. Join a team where your innovation impacts lives.  

Together, we’ll realize improved outcomes by improving data quality, enhancing launch execution and improving the patient journey. You’ll play a critical role in accelerating data collection and increasing accuracy across all parts of the business. Patients across the globe will benefit from access to treatments afforded by greater opportunities and efficiency in our research and development.  

Why Work With Us

We connect to our history and Japanese heritage through everything we do to bring our purpose, values, vision, and imperatives to life. We are committed to bringing better health and a brighter future to patients. Being a part of Takeda means having the opportunity to be a part of something bigger than yourself.

Gallery

Gallery
Gallery
Gallery
Gallery
Gallery
Gallery
Gallery
Gallery
Gallery
Gallery

Takeda Teams

Team
Product + Tech
About our Teams
Option 1 of 1

Takeda Offices

Hybrid Workspace

Employees engage in a combination of remote and on-site work.

Takeda's hybrid policy varies by role. Be sure to ask your recruiter about the requirements for the role that you are applying for.

Typical time on-site: Flexible
Company Office Image
HQTakeda United States Headquarters
Company Office Image
HQTakeda Global Headquarters
Company Office Image
HQTakeda Europe Headquarters
Company Office Image
Innovation Capability Center
Lexington, MA
Toronto, Ontario
Learn more
Option 1 of 5

Similar Jobs

Takeda Logo Takeda

Control Tower Lead

Healthtech • Software • Analytics • Biotech • Pharmaceutical • Manufacturing
Hybrid
Bengaluru, Karnataka, IND
50000 Employees

Takeda Logo Takeda

Data Engineer

Healthtech • Software • Analytics • Biotech • Pharmaceutical • Manufacturing
Hybrid
Bengaluru, Karnataka, IND
50000 Employees

Takeda Logo Takeda

Sr. Data Engineer - Informatica IICS

Healthtech • Software • Analytics • Biotech • Pharmaceutical • Manufacturing
Hybrid
Bengaluru, Karnataka, IND
50000 Employees

Takeda Logo Takeda

Data Product Consultant - Commercial

Healthtech • Software • Analytics • Biotech • Pharmaceutical • Manufacturing
Hybrid
Bengaluru, Karnataka, IND
50000 Employees
Not Eligible
Save
By clicking Apply you agree to share your profile information with the hiring company.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account