Senior Data Platform Engineer

Posted 2 Days Ago
Be an Early Applicant
4 Locations
In-Office
155K-175K Annually
Senior level
Pharmaceutical
The Role
Designs and manages enterprise Databricks data platforms, including workspaces, clusters, Unity Catalog, SQL warehouses, Terraform infrastructure, and secure data ingestion pipelines. Builds medallion architecture with Delta Lake, supports Genie dashboards and self-service analytics, implements governance and access controls, and maintains CI/CD, testing, documentation, and operational processes. Partners with technical and business stakeholders and supports MCP connectors and agentic data integrations.
Summary Generated by Built In

Arrowhead Pharmaceuticals, Inc. (Nasdaq ARWR) is a commercial stage biopharmaceutical company that develops medicines that treat intractable diseases by silencing the genes that cause them. Using a broad portfolio of RNA chemistries and efficient modes of delivery, Arrowhead therapies trigger the RNA interference mechanism to induce rapid, deep, and durable knockdown of target genes. RNA interference, or RNAi, is a mechanism present in living cells that inhibits the expression of a specific gene, thereby affecting the production of a specific protein. Arrowhead’s RNAi-based therapeutics leverage this natural pathway of gene silencing.

Arrowhead is focused on developing innovative drugs for diseases with a genetic basis, typically characterized by the overproduction of one or more proteins that are involved with disease. The depth and versatility of our RNAi technologies enables us to potentially address conditions in virtually any therapeutic area and pursue disease targets that are not otherwise addressable by small molecules and biologics. Arrowhead is leading the field in bringing the promise of RNAi to address diseases outside of the liver, and our clinical pipeline includes disease targets in the liver and lung with a promising pipeline of preclinical candidates.

Arrowhead’s corporate headquarters is in Pasadena, CA with research and development teams in Madison, WI & San Diego, CA, and a state of the art manufacturing facility in Verona, WI.  Our employees are nimble, science-driven innovators who are collaborating to bring new therapies to patients in need. 

The Position

The Senior Data Platform Engineer is responsible for designing, building, and managing the organization's Databricks environments, with end-to-end ownership of the data platform's infrastructure, security, and performance. This role leads the ingestion of data from internal systems and external third-party providers into the lakehouse, partners with business and analytics stakeholders to build and support Genie dashboards, and manages the Databricks platform (workspaces, clusters, Unity Catalog, jobs) as infrastructure-as-code using Terraform. The ideal candidate has hands-on experience administering Databricks in production, writing Terraform for infrastructure changes, and building data pipelines that hold up at enterprise scale.

Responsibilities

  • Design, build, and manage Databricks environments (workspaces, clusters, Unity Catalog, SQL warehouses) supporting enterprise analytics and data science workloads
  • Develop and maintain Terraform modules and pipelines to provision, configure, and version-control all Databricks infrastructure and related cloud resources
  • Design and build data ingestion pipelines to bring in data from internal systems and external third-party data providers (APIs, SFTP, batch files, streaming sources) into the lakehouse.
  • Architect and maintain medallion (bronze/silver/gold) data layers using Delta Lake, ensuring data quality, lineage, and governance via Unity Catalog
  • Partner with business and analytics end users to design, build, and support Genie dashboards and enable self-service, natural-language data exploration
  • Implement platform security, access controls, and partner with data stewards.
  • Work with data engineers, analysts, data scientists, AI engineers, and cloud DevOps engineers to build and maintain CI/CD pipelines, automated tests, and Terraform infrastructure-as-code for the data platform
  • Document platform architecture, ingestion pipelines, and operational runbooks
  • Assist AI engineers by building and maintaining MCP (Model Context Protocol) connectors and other data/tool integrations that power agentic workflows

Requirements

  • Bachelor's degree in Computer Science, Data Engineering, Information Systems, or related field, or equivalent practical experience
  • 5+ years of experience in data engineering or platform engineering roles, including extensive hands-on experience administering and building on Databricks (clusters, jobs, Unity Catalog, Delta Lake, SQL warehouses)
  • Demonstrated experience managing Databricks infrastructure as code using Terraform
  • Strong proficiency in Python and SQL for building and optimizing data pipelines
  • Experience designing and building data ingestion pipelines from diverse internal and external data sources (APIs, SFTP, third-party vendor feeds, streaming)
  • Working knowledge of cloud platforms (AWS, Azure ) and associated data/storage services
  • Experience supporting business intelligence or natural-language dashboarding tools (e.g., Databricks Genie )
  • Experience implementing data governance, security, and access controls in Databricks (e.g., Unity Catalog permissions, row/column-level security, service principals, secrets management)
  • Ability to explain pipeline and dashboard design decisions to non-technical stakeholders, e.g., when scoping Genie dashboard requirements with business users

Preferred

  • Databricks certifications (e.g., Databricks Certified Data Engineer Professional, Databricks Certified Associate/Professional Platform Administrator)
  • Experience with Databricks Genie and building natural-language / self-service analytics experiences for business users
  • Experience integrating data from external data providers or vendor APIs at enterprise scale
  • Familiarity with CI/CD tooling (e.g., GitHub Actions, Azure DevOps, GitLab CI) for automated deployment of Terraform-managed infrastructure
  • Experience with data orchestration tools (e.g., Databricks Workflows, Airflow, dbt)
  • Experience building and supporting agentic workloads on Databricks, including managing model/tool access and governance via the Unity Catalog AI Gateway
  • Expertise in pharma or pharma-related data (e.g., clinical, R&D, regulatory, or commercial pharma data) and the compliance considerations that come with it
Wisconsin pay range
$155,000—$175,000 USD
California pay range
$175,000—$190,000 USD

Arrowhead provides competitive salaries and an excellent benefit package.   

Candidates must have current, valid authorization to work in the country where this role is located.

California Applicant Privacy Policy

Skills Required

  • Bachelor’s degree in Computer Science, Data Engineering, Information Systems, or a related field, or equivalent practical experience
  • 5+ years of experience in data engineering or platform engineering roles
  • Extensive hands-on experience administering and building on Databricks, including clusters, jobs, Unity Catalog, Delta Lake, and SQL warehouses
  • Experience managing Databricks infrastructure as code using Terraform
  • Strong proficiency in Python and SQL for building and optimizing data pipelines
  • Experience designing and building ingestion pipelines from APIs, SFTP, third-party vendor feeds, and streaming sources
  • Working knowledge of AWS, Azure, and associated data and storage services
  • Experience supporting business intelligence or natural-language dashboarding tools such as Databricks Genie
  • Experience implementing Databricks data governance, security, and access controls, including Unity Catalog permissions, row- and column-level security, service principals, and secrets management
  • Ability to explain pipeline and dashboard design decisions to non-technical stakeholders
  • Databricks certifications
  • Experience with Databricks Genie and self-service analytics experiences
  • Experience integrating external data providers or vendor APIs at enterprise scale
  • Familiarity with CI/CD tools such as GitHub Actions, Azure DevOps, or GitLab CI
  • Experience with data orchestration tools such as Databricks Workflows, Airflow, or dbt
  • Experience building and supporting agentic workloads on Databricks
  • Expertise in pharmaceutical or pharma-related data and compliance considerations
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Pasadena, CA
352 Employees
Year Founded: 2004

What We Do

Arrowhead Pharmaceuticals is a clinical stage, Nasdaq listed (ticker ARWR) company developing medicines that treat intractable diseases by silencing the genes that cause them. Using a broad portfolio of RNA chemistries and efficient modes of delivery, our therapies trigger the RNA interference mechanism to induce rapid, deep and durable knockdown of target genes. RNA interference, or RNAi, is a mechanism present in living cells that inhibits the expression of a specific gene, thereby affecting the production of a specific protein. Our RNAi-based therapeutics are at the leading edge of genetic-based therapy with the potential to bring life changing treatments for patients. Our Targeted RNAi Molecule (TRiMTM) platform utilizes ligand-mediated delivery and is designed to enable tissue-specific targeting while being structurally simple. The TRiM platform builds on more than a decade of work on actively targeted drug delivery and offers several advantages including simplified manufacturing and reduced costs; multiple routes of administration; and potential for improved safety. Our employees are nimble, science-driven, and innovative professionals. A career at Arrowhead offers the opportunity to collaborate with top notch scientists to rapidly discover and develop RNAi-based therapeutics to add to our growing pipeline. Research and development activities are located in Madison, WI. Our R&D group includes fully-integrated capabilities for chemistry, biology, and toxicology. Madison is an exciting and sophisticated city that includes state government, the flagship campus of the University of Wisconsin, and major research organizations. Our HQ, clinical and regulatory operations are located in Pasadena, CA. Just north of Los Angeles and resting in the foothills of the San Gabriel Mountains, Pasadena is known for its natural scenic beauty, vibrant cultural and academic environment and rich architectural setting.

Similar Jobs

CrowdStrike Logo CrowdStrike

Senior Engineer

Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Remote or Hybrid
USA
11000 Employees
140K-215K Annually
In-Office or Remote
51 Locations
22000 Employees

Photon Logo Photon

Platform Engineer

Agency • Information Technology
In-Office or Remote
2 Locations
5017 Employees
38K-133K Annually

Atlas Logo Atlas

Senior Engineer

Big Data • Cloud • HR Tech • Payments • Software
Remote or Hybrid
United States of America
375 Employees

Similar Companies Hiring

Formation Bio Thumbnail
Artificial Intelligence • Big Data • Healthtech • Biotech • Pharmaceutical
New York, NY
150 Employees
Pfizer Thumbnail
Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
New York, NY
121990 Employees
Cencora Thumbnail
Healthtech • Logistics • Pharmaceutical
Conshohocken, PA
51000 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account