Senior Data Engineer (Databricks Specialist)

Posted 6 Days Ago
Be an Early Applicant
7 Locations
In-Office or Remote
Senior level
Software • Design • App development
Accelerate Your Digital Transformation
The Role
The role involves architecting data pipeline solutions, managing Azure Databricks environments, optimizing performance, and leading data projects for a Fortune 500 client.
Summary Generated by Built In
About Coderio

Coderio designs and delivers scalable digital solutions for global businesses. With a strong technical foundation and a product mindset, our teams lead complex software projects from architecture to execution. We value autonomy, clear communication, and technical excellence. We work closely with international teams and partners, building technology that makes a difference.

🌍 Learn more: http://coderio.com
 
In this role, you will take ownership of large-scale data pipeline solutions for a Fortune 500 client, working with extremely high-volume datasets in a fully Azure Databricks environment. You will lead the design and evolution of Lakehouse architectures, optimize platform performance end-to-end, and guide teams through all phases of the SDLC. You will operate as a technical leader, solving problems with high ambiguity and continuously improving simplicity, reliability, and performance across the platform.
 
What to Expect in This Role (Responsibilities)

Architect and implement scalable Lakehouse solutions using Delta Tables and Delta Live Tables to ensure performance, consistency, and reliability.
Design and orchestrate complex data workflows using Databricks Workflows and Jobs, leveraging Databricks Asset Bundles for deployment management.
Manage platform internals, including low-level Cluster Configuration, optimization through the Databricks CLI, and environment tuning.
Implement secure data governance and sharing using Unity Catalog and Delta Sharing.
Develop production-grade Python and PySpark code, including custom Python libraries to standardize logic across pipelines.
Collaborate with engineering and platform teams to drive improvements in scalability, maintainability, and operational efficiency.
Act as a technical leader who supports decision-making, provides clarity under ambiguity, and drives continuous improvement.
 
Requirements

3+ years of hands-on experience across the full Databricks ecosystem, including Notebooks, Workflows, Jobs, Asset Bundles, Cluster Configuration, CLI usage, Unity Catalog, Delta Sharing, and Delta Live Tables.
4+ years of deep experience in Data Engineering fundamentals, including Data Modeling, Data Warehouse principles, ETL processes, and pipeline orchestration.
4+ years of proficiency in Python, PySpark, and SQL building production-grade data solutions.
3+ years working with Azure services such as Storage Accounts, Azure Active Directory, and Azure Data Factory.
2+ years of experience using GitHub SaaS and GitHub Actions for version control and deployment.
Strong communication, collaboration, and problem-solving abilities, with a demonstrated capacity to operate effectively under ambiguity.
 
Nice to Have

Experience developing internal Python libraries for reuse across pipelines.
Experience implementing automated testing strategies for data pipelines.
Experience collaborating with cross-functional teams to establish best practices and technical standards.
 
Benefits

100% remote
Long-term commitment, with autonomy and impact
Strategic and high-visibility role in a modern engineering culture
Collaborative international team and strong technical leadership
Clear path to growth and leadership within Coderio

Why join Coderio?

At Coderio, we value talent regardless of location. We are a remote-first company, passionate about technology, collaborative work, and fair compensation. We offer an inclusive, challenging environment with real opportunities for growth. If you are motivated to build solutions with impact, we are waiting for you.
Apply now.

Top Skills

Azure
Azure Data Factory
Databricks
Delta Live Tables
Delta Tables
Git
Pyspark
Python
SQL
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Miami, FL
223 Employees
Year Founded: 2017

What We Do

Accelerate your digital transformation with our expert nearshore engineering teams.
From experienced Software Engineers to augment your tech team, to fully managed expert Development Squads. We design, engineer, and deliver customized technology solutions for companies of every size.

We can assemble your enterprise-level dev squad within 7 days. Scale fast with our on-demand timezone-aligned software development talent.

Contact us: [email protected]

Similar Jobs

Samsara Logo Samsara

Account Executive

Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Easy Apply
Remote or Hybrid
CO
4000 Employees
119K-158K Annually

Samsara Logo Samsara

Account Executive

Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Easy Apply
Remote or Hybrid
CO
4000 Employees
119K-158K Annually

Rubrik Logo Rubrik

Join Our Engineering Talent Community

Artificial Intelligence • Big Data • Cloud • Information Technology • Software • Cybersecurity • Data Privacy
Remote
15 Locations
3000 Employees

Rubrik Logo Rubrik

Join Our Talent Community

Artificial Intelligence • Big Data • Cloud • Information Technology • Software • Cybersecurity • Data Privacy
Remote
15 Locations
3000 Employees

Similar Companies Hiring

Standard Template Labs Thumbnail
Software • Information Technology • Artificial Intelligence
New York, NY
10 Employees
PRIMA Thumbnail
Travel • Software • Marketing Tech • Hospitality • eCommerce
US
15 Employees
Scotch Thumbnail
Software • Retail • Payments • Fintech • eCommerce • Artificial Intelligence • Analytics
US
25 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account