Databricks Architect - R01573990

Posted Yesterday
Be an Early Applicant
San Francisco, CA, USA
Hybrid
140-150 Annually
Senior level
Information Technology
The Role
Designs scalable Databricks and cloud data-platform architectures; develops and optimizes SQL and Python ETL pipelines, data models, warehouses, and automated workflows. Ensures data quality, security, and performance while troubleshooting distributed environments. Collaborates with business and technical teams, documents architecture and data flows, and supports analytics and reporting outcomes.
Summary Generated by Built In
Data Architect

Primary Skills

  • ETL Fundamentals, SQL, SQL (Basic + Advanced), Python, Data Warehousing, Modern Data Platform Fundamentals, Data Modelling Fundamentals, PLSQL, T-SQL, Stored Procedures

Specialization

  • Databricks Engineering: Data Architect

Job requirements

  •  
  • Location: San Jose, CA
  • Looking for candidate local to CA 
  • Full-time role, does not open for a sponsorship.
  • Experience Range: With at least 7 years of experience in data architecture and engineering, including substantial hands-on expertise with Databricks and modern data platforms

    Key Responsibilities:
      1. Design and architect scalable, high-performance data solutions utilizing Databricks and leading cloud data platforms
      2. Develop, optimize, and maintain ETL pipelines with SQL, Python, and Databricks to ensure efficient data ingestion, transformation, and loading
      3. Implement robust data models and data warehousing solutions to drive analytics, reporting, and business intelligence outcomes
      4. Automate and streamline data workflows to enhance system efficiency and minimize processing times
      5. Monitor, troubleshoot, and resolve performance bottlenecks in data pipelines and platform components
      6. Ensure data quality, consistency, and security across all data assets and platforms
      7. Collaborate with cross-functional teams to translate business requirements into technical data architecture solutions
      8. Document architecture designs, data flows, and best practices to support operational excellence and knowledge sharing

    Required Skills:
      1. Advanced proficiency with Databricks platform and ecosystem
      2. Expertise in designing and developing ETL pipelines using SQL and Python
      3. Expert-level SQL, including advanced query optimization
      4. Proficiency in Python for data engineering and automation
      5. Comprehensive knowledge of data warehousing concepts and design patterns
      6. Experience with data modeling techniques and best practices
      7. Hands-on experience with PLSQL and T-SQL
      8. Ability to develop and maintain stored procedures for data transformation
      9. Experience with performance tuning and troubleshooting in distributed data environments

    Preferred Skills:
      1. Experience with Azure Data Lake, AWS S3, or Google BigQuery
      2. Familiarity with Delta Lake and lakehouse architecture concepts
      3. Knowledge of CI/CD practices for data engineering pipelines
      4. Working experience with Scala or Java in data engineering contexts
      5. Exposure to data governance, cataloging, and lineage tools

    Desired Qualifications:
      1. Bachelor's degree in Computer Science, Information Technology, Data Engineering, or a closely related discipline
      2. Databricks Certified Data Engineer Associate or Professional certification
      3. Certification in cloud data platforms such as Microsoft Azure Data Engineer Associate, AWS Certified Data Analytics, or Google Professional Data Engineer

Skills Required

  • At least 7 years of experience in data architecture and engineering
  • Local to California, with the role located in San Jose, CA
  • Advanced proficiency with the Databricks platform and ecosystem
  • Expertise developing ETL pipelines using SQL and Python
  • Expert-level SQL, including query optimization
  • Proficiency in Python for data engineering and automation
  • Knowledge of data warehousing concepts and design patterns
  • Experience with data modeling techniques and best practices
  • Hands-on experience with PL/SQL and T-SQL
  • Ability to develop and maintain stored procedures
  • Experience with performance tuning and troubleshooting in distributed data environments
  • Experience with Azure Data Lake, AWS S3, or Google BigQuery
  • Familiarity with Delta Lake and lakehouse architecture
  • Knowledge of CI/CD practices for data engineering pipelines
  • Experience with Scala or Java in data engineering
  • Exposure to data governance, cataloging, and lineage tools
  • Bachelor's degree in Computer Science, Information Technology, Data Engineering, or a related discipline
  • Databricks Certified Data Engineer Associate or Professional certification
  • Certification in a cloud data platform such as Azure, AWS, or Google Cloud

Brillio Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Brillio and has not been reviewed or approved by Brillio.

  • Healthcare Strength — Healthcare is considered comprehensive, including medical coverage for employees and dependents alongside life, disability, and accidental death protections. Feedback suggests these protections are a core strength of the package.
  • Leave & Time Off Breadth — Time-off options include paid leave and parental leave, with flexible or ‘flexible PTO’ approaches cited in some contexts. Feedback suggests this breadth helps support work-life balance when team norms permit usage.
  • Wellbeing & Lifestyle Benefits — Wellbeing offerings span counseling, financial-management sessions, fitness programs, and travel insurance, plus region-specific extras like discounted IT hardware and work-from-home essentials. Feedback suggests these add-ons enhance perceived value beyond core insurance.

Brillio Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Santa Clara, CA
2,676 Employees
Year Founded: 2014

What We Do

Brillio is the leader in global digital business transformation, applying technology with a human touch. We help businesses define internal and external transformation objectives, and translate those objectives into actionable market strategies using proprietary technologies. With 2600+ experts and 13 offices worldwide, Brillio is the ideal partner for enterprises that want to quickly increase their core business productivity, and achieve a competitive edge, with the latest digital solutions.

Similar Jobs

The Aerospace Corporation Logo The Aerospace Corporation

Manufacturing Engineer

Aerospace • Artificial Intelligence • Cloud • Machine Learning • Software • Cybersecurity • Defense
Hybrid
Torrance, CA, USA
4600 Employees
98K-147K Annually

The Aerospace Corporation Logo The Aerospace Corporation

Architect

Aerospace • Artificial Intelligence • Cloud • Machine Learning • Software • Cybersecurity • Defense
Hybrid
3 Locations
4600 Employees
153K-210K Annually

The Aerospace Corporation Logo The Aerospace Corporation

Manufacturing Engineer

Aerospace • Artificial Intelligence • Cloud • Machine Learning • Software • Cybersecurity • Defense
Hybrid
Torrance, CA, USA
4600 Employees
98K-147K Annually

The Aerospace Corporation Logo The Aerospace Corporation

Project Engineer

Aerospace • Artificial Intelligence • Cloud • Machine Learning • Software • Cybersecurity • Defense
Hybrid
2 Locations
4600 Employees
122K-182K Annually

Similar Companies Hiring

NODA AI Thumbnail
Artificial Intelligence • Information Technology • Software • Cybersecurity • Defense • Defense Technology
Austin, TX
54 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
567 Employees
RapidScale Thumbnail
Cloud • Information Technology • Consulting
Raleigh, NC
600 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account