Sr. Manager, Engineering - Storage Platform

Reposted 48 Minutes Ago
Be an Early Applicant
San Francisco, CA
In-Office
222K-300K Annually
Senior level
Big Data • Machine Learning • Software • Analytics • Big Data Analytics
The Role
Lead a team building and maintaining client components for core storage systems across cloud platforms. Drive schema and query best practices, data migration/version upgrades, intelligent debugging and operational tooling, hire and mentor engineers, and manage long-term architecture and reliability for mission-critical storage infrastructure.
Summary Generated by Built In

RDQ326R425


At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to improve their business.

The Storage Platform is a mission-critical function, provisioning and managing the thousands of storage systems that power the majority of Databricks services. We ensure unparalleled high availability, scalability, and performance for thousands of instances across all three major cloud platforms—GCP, AWS, and Azure—in 75+ production regions globally.

This team is responsible for managing the intelligent gateway entry points to these storage systems. Furthermore, we are pioneering a proprietary, AI-backed system for smart diagnosis and new operational innovations. For more detail on our work, please see this blog: how-we-debug-1000s-databases-ai-databricks.

We are seeking an Engineering Leader to lead this team, a role that demands driving innovation in a high-stakes environment, championing operational excellence, and developing talented individuals. This position reports directly to the Director of Engineering.

The main responsibilities include:

  • Lead the development and maintenance of client components that interface with core storage systems.
  • Champion and enforce best practices for schema and query design across the organization; drive innovation in data migration and schema version upgrades.
  • Deliver innovative solutions for intelligent debugging and operational activities to significantly boost developer productivity.
  • Hire and lead top-tier engineering talent, fostering a highly synergistic team structure and collaborating effectively with internal and external stakeholders.

The impact you will have:

  • Drive the development and successful deployment of mission-critical services and infrastructure.
  • Directly impact Databricks' core reliability, performance, and operational efficiency.
  • Mentor and grow a world-class team of software engineers.
  • Evolve the organizational structure to align with long-term technology roadmaps, fostering effective communication and high-performing team models.
  • Manage long-term technical architecture decisions while strategically balancing the product roadmap.

What we look for:

  • B.S. in Computer Science (M.S. or Ph.D. preferred).
  • 5+ years of industry experience in infrastructure, with a strong preference for expertise in storage technologies and databases.
  • Deep working knowledge of database systems, storage systems, distributed systems, language design, query optimization, and performance tuning.
  • Proven track record of leading and scaling teams to build and operate high-quality, reliable infrastructure services in fast-paced environments.
  • Extensive experience collaborating with multiple engineering teams across different locations.

Pay Range Transparency

Databricks is committed to fair and equitable compensation practices. The pay range(s) for this role is listed below and represents the expected salary range for non-commissionable roles or on-target earnings for commissionable roles.  Actual compensation packages are based on several factors that are unique to each candidate, including but not limited to job-related skills, depth of experience, relevant certifications and training, and specific work location. Based on the factors above, Databricks anticipates utilizing the full width of the range. The total compensation package for this position may also include eligibility for annual performance bonus, equity, and the benefits listed above. For more information regarding which range your location is in visit our page here.


Local Pay Range
$222,000$300,000 USD

About Databricks

Databricks is the data and AI company. More than 10,000 organizations worldwide — including Comcast, Condé Nast, Grammarly, and over 50% of the Fortune 500 — rely on the Databricks Data Intelligence Platform to unify and democratize data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache Spark™, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook.
Benefits
At Databricks, we strive to provide comprehensive benefits and perks that meet the needs of all of our employees. For specific details on the benefits offered in your region, please visit https://www.mybenefitsnow.com/databricks. 

Our Commitment to Diversity and Inclusion

At Databricks, we are committed to fostering a diverse and inclusive culture where everyone can excel. We take great care to ensure that our hiring practices are inclusive and meet equal employment opportunity standards. Individuals looking for employment at Databricks are considered without regard to age, color, disability, ethnicity, family or marital status, gender identity or expression, language, national origin, physical and mental ability, political affiliation, race, religion, sexual orientation, socio-economic status, veteran status, and other protected characteristics.

Compliance

If access to export-controlled technology or source code is required for performance of job duties, it is within Employer's discretion whether to apply for a U.S. government license for such positions, and Employer may decline to proceed with an applicant on this basis alone.

Top Skills

AWS
Azure
Databases
Distributed Systems
GCP
Query Optimization
Storage Systems
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
New York, NY
2,200 Employees
Year Founded: 2013

What We Do

As the leader in Unified Data Analytics, Databricks helps organizations make all their data ready for analytics, empower data science and data-driven decisions across the organization, and rapidly adopt machine learning to outpace the competition. By providing data teams with the ability to process massive amounts of data in the Cloud and power AI with that data, Databricks helps organizations innovate faster and tackle challenges like treating chronic disease through faster drug discovery, improving energy efficiency, and protecting financial markets.

Similar Jobs

In-Office or Remote
13 Locations
2449 Employees
139K-229K Annually

Granica Logo Granica

Product Manager

Artificial Intelligence • Big Data • Cloud • Machine Learning • Software • Business Intelligence • Data Privacy
In-Office
Mountain View, CA, USA
37 Employees
160K-250K Annually

Granica Logo Granica

Senior Software Engineer

Artificial Intelligence • Big Data • Cloud • Machine Learning • Software • Business Intelligence • Data Privacy
In-Office
Mountain View, CA, USA
37 Employees
190K-250K Annually

GRAIL Logo GRAIL

Staff Software Engineer

Artificial Intelligence • Big Data • Healthtech • Machine Learning • Software • Biotech
Hybrid
2 Locations
918 Employees
142K-200K Annually

Similar Companies Hiring

Fairly Even Thumbnail
Software • Sales • Robotics • Other • Hospitality • Hardware
New York, NY
Bellagent Thumbnail
Artificial Intelligence • Machine Learning • Business Intelligence • Generative AI
Chicago, IL
20 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account