The Role
Build and maintain scalable consumer data pipelines on Databricks using PySpark, Spark SQL, and Delta Lake. Implement medallion architecture, Unity Catalog, and Workflows. Optimize cluster performance and costs, and monitor and troubleshoot production jobs.
Summary Generated by Built In
Build and maintain scalable data pipelines on Databricks for consumer-facing IBU data products.
- Develop ETL/ELT pipelines using PySpark, Spark SQL and Delta Lake
- Implement medallion architecture (bronze/silver/gold), Unity Catalog and Workflows
- Optimize cluster performance and cost; monitor and troubleshoot jobs in production
Requirements
- Must have: 4+ yrs data engineering, Databricks, PySpark, SQL, Git/CI-CD.
- Nice to have: pharma/consumer data, Databricks certification
Skills Required
- 4+ years of data engineering experience
- Databricks experience
- PySpark experience
- SQL experience
- Git and CI/CD experience
- Pharmaceutical or consumer data experience
- Databricks certification
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
RADcube is a technology consulting and software development firm founded in 2015 and headquartered in Carmel, Indiana. It helps organizations turn enterprise ideas into practical innovations through digital transformation, custom software, data analytics, artificial intelligence, cloud computing, cybersecurity, and intelligent automation. The company serves healthcare, finance, government, and manufacturing clients, combining human-centric delivery with responsible, accountable technology solutions designed to produce measurable business outcomes.
