Data Engineer – Databricks (IBU Consumer)

Posted 24 Days Ago
Indianapolis, IN, USA
In-Office
Mid level
Artificial Intelligence • Software • Consulting • Automation
The Role
Build and maintain scalable consumer data pipelines on Databricks using PySpark, Spark SQL, and Delta Lake. Implement medallion architecture, Unity Catalog, and Workflows. Optimize cluster performance and costs, and monitor and troubleshoot production jobs.
Summary Generated by Built In

Build and maintain scalable data pipelines on Databricks for consumer-facing IBU data products.

  • Develop ETL/ELT pipelines using PySpark, Spark SQL and Delta Lake
  • Implement medallion architecture (bronze/silver/gold), Unity Catalog and Workflows
  • Optimize cluster performance and cost; monitor and troubleshoot jobs in production

Requirements
  • Must have: 4+ yrs data engineering, Databricks, PySpark, SQL, Git/CI-CD.
  • Nice to have: pharma/consumer data, Databricks certification


Skills Required

  • 4+ years of data engineering experience
  • Databricks experience
  • PySpark experience
  • SQL experience
  • Git and CI/CD experience
  • Pharmaceutical or consumer data experience
  • Databricks certification
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Indianapolis, IN
96 Employees
Year Founded: 2015

What We Do

RADcube is a technology consulting and software development firm founded in 2015 and headquartered in Carmel, Indiana. It helps organizations turn enterprise ideas into practical innovations through digital transformation, custom software, data analytics, artificial intelligence, cloud computing, cybersecurity, and intelligent automation. The company serves healthcare, finance, government, and manufacturing clients, combining human-centric delivery with responsible, accountable technology solutions designed to produce measurable business outcomes.

Similar Jobs

PNC Bank Logo PNC Bank

Infrastructure Engineer

Machine Learning • Payments • Security • Software • Financial Services
Remote or Hybrid
USA
55000 Employees
91K-203K Annually

PNC Bank Logo PNC Bank

Infrastructure Engineer

Machine Learning • Payments • Security • Software • Financial Services
Remote or Hybrid
USA
55000 Employees
91K-203K Annually

PNC Bank Logo PNC Bank

Head Of Product

Machine Learning • Payments • Security • Software • Financial Services
Remote or Hybrid
USA
55000 Employees
123K-275K Annually

PNC Bank Logo PNC Bank

Infrastructure Engineer

Machine Learning • Payments • Security • Software • Financial Services
Remote or Hybrid
USA
55000 Employees
91K-203K Annually

Similar Companies Hiring

Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
33 Employees
Vega Thumbnail
Artificial Intelligence • Automotive • Insurance • Transportation
US
65 Employees
RapidScale Thumbnail
Cloud • Information Technology • Consulting
Raleigh, NC
600 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account