Data Architect (Databricks Scalability)

Reposted 6 Days Ago
Be an Early Applicant
Colômbia, São Paulo, BRA
In-Office
Senior level
Mobile • Software
The Role
Assess and document current and target Databricks architecture to improve scalability, performance, cost efficiency, and resilience. Identify bottlenecks across pipelines, clusters, storage, and consumption layers. Define scalable patterns for ingestion, transformation, orchestration, and data serving. Recommend workload optimization, autoscaling, compute governance, and performance tuning. Enable AI/ML and Generative AI capabilities on Databricks, and collaborate with cross-functional stakeholders to produce architecture documentation and implementation plans.
Summary Generated by Built In
Why Join Exadel

We’re an AI-first global tech company with 25+ years of engineering leadership, 2,000+ team members, and 500+ active projects powering Fortune 500 clients, including HBO, Microsoft, Google, and Starbucks.

From AI platforms to digital transformation, we partner with enterprise leaders to build what’s next.
What powers it all? Our people are ambitious, collaborative, and constantly evolving.

About the Client

A global technology company headquartered in the United States, specializing in personal computing, printing solutions, and related services. It focuses on secure, sustainable, and high-performance solutions that enable productivity and support digital transformation across industries.

What You’ll Do
  • Assess the current Databricks environment, including workspace design, compute usage, workloads, dependencies, and data processing patterns.
  • Document current-state and target-state architecture to improve scalability, resilience, and operational efficiency.
  • Identify performance bottlenecks, scalability constraints, cost inefficiencies, and architectural gaps across pipelines, clusters, storage, and consumption layers.
  • Define scalable platform patterns for ingestion, transformation, orchestration, and data serving aligned with enterprise standards.
  • Establish recommendations for workload optimization, autoscaling, compute governance, and performance tuning to support increasing data volumes and concurrency.
  • Design and enable AI-ready Databricks capabilities, including reusable patterns for GenAI, retrieval, vector search, model serving, and enterprise knowledge workflows. Define integration and deployment approaches that improve reliability, maintainability, and release consistency across environments.
  • Work with architecture, engineering, data, security, and operations stakeholders to translate business and platform needs into practical technical decisions.
  • Contribute to implementation planning, technical governance, and execution sequencing for Databricks scalability initiatives.
  • Produce clear architecture documentation, engineering guidance, and dependency views to support execution teams and long-term platform sustainability.
What You Bring
  • Strong experience in Databricks architecture, data engineering, or platform engineering roles.
  • Hands-on expertise in Apache Spark, Delta Lake, cluster tuning, workload optimization, and scalable lakehouse design.
  • Proven ability to design and optimize high-scale data platforms with a focus on performance, reliability, cost efficiency, and operational excellence.
  • Experience enabling AI/ML and Generative AI solutions on Databricks, including AI-ready data foundations and production deployment patterns.
  • Working knowledge of governance and secure platform design, including workspace strategy, access controls, and enterprise data management practices.
  • Ability to work across technical and business teams and communicate clearly.
English level

Intermediate/Upper-Intermediate

Legal & Hiring Information
  • Exadel is proud to be an Equal Opportunity Employer committed to inclusion across minority, gender identity, sexual orientation, disability, age, and more
  • Reasonable accommodations are available to enable individuals with disabilities to perform essential functions
  • Please note: this job description is not exhaustive. Duties and responsibilities may evolve based on business needs
Your Benefits at Exadel

Exadel benefits vary by location and contract type. Your recruiter will fill you in on the details.

  • International projects
  • In-office, hybrid, or remote flexibility
  • Medical healthcare
  • Recognition program
  • Ongoing learning & reimbursement 
  • Well-being program
  • Team events & local benefits 
  • Sports compensation 
  • Referral bonuses 
  • Top-tier equipment provision
Exadel Culture

We lead with trust, respect, and purpose. We believe in open dialogue, creative freedom, and mentorship that helps you grow, lead, and make a real difference. Ours is a culture where ideas are challenged, voices are heard, and your impact matters.

Skills Required

  • Strong experience in Databricks architecture, data engineering, or platform engineering roles.
  • Hands-on expertise in Apache Spark, Delta Lake, and scalable lakehouse design.
  • Experience with cluster tuning, workload optimization, autoscaling, and cost/performance tuning.
  • Proven ability to design and optimize high-scale data platforms for performance, reliability, and cost efficiency.
  • Experience enabling AI/ML and Generative AI solutions on Databricks, including AI-ready data foundations and production deployment patterns.
  • Knowledge of governance and secure platform design, including workspace strategy and access controls.
  • Ability to work across architecture, engineering, data, security, and operations teams and communicate clearly.
  • English level: Intermediate/Upper-Intermediate.

Exadel Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Exadel and has not been reviewed or approved by Exadel.

  • Fair & Transparent Compensation Pay is considered competitive for certain roles and locations, with timely and predictable payroll practices. Compensation ranges align to market in higher‑cost geographies and senior tracks, indicating offers can be strong when role and market justify it.
  • Healthcare Strength U.S. medical insurance options are described positively, with health coverage and PTO called out as standouts. Company materials and third‑party listings consistently include comprehensive healthcare as a core benefit.
  • Wellbeing & Lifestyle Benefits Flexible, remote‑first norms and outcome‑based work are positioned as core benefits. Learning support such as paid certifications, courses, and conferences is emphasized, alongside a well‑being program.

Exadel Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Walnut Creek, CA
1,549 Employees
Year Founded: 1998

What We Do

For more than 20 years, Exadel has been delivering Digital Transformation services, enterprise and custom software solutions for Fortune 500 clients, including HPE, Deloitte, Home Depot and McKesson. With 20+ locations and delivery centers across the US and Europe, Exadel solves the most complex engineering problems using Agile methodologies, offering a scalable and skilled mix of multi-shore resources at the industry's most competitive price. Exadel’s digital transformation solutions and services help chart new strategies that are built upon creative thinking, cutting-edge design, and technical innovation, designed for the growing digital landscape of business. Enterprise Services - Digital Transformation Experts - Developing mission-critical software and mobile applications - Advising companies on how best to leverage open source technology - Helping companies plan and implement migrations to better technology stacks - Providing QA, automation, and testing services for application development - Supporting and maintaining applications and systems for companies - Providing on-line training and mentoring to companies - Assisting companies in evaluating their current enterprise software architecture and planning for improvements or new systems.

Similar Jobs

ZS Logo ZS

Architect

Artificial Intelligence • Healthtech • Professional Services • Analytics • Consulting
Hybrid
2 Locations
15000 Employees

ZS Logo ZS

Salesforce Technical Architect

Artificial Intelligence • Healthtech • Professional Services • Analytics • Consulting
Hybrid
2 Locations
15000 Employees

ZS Logo ZS

Salesforce Technical Architect

Artificial Intelligence • Healthtech • Professional Services • Analytics • Consulting
Hybrid
2 Locations
15000 Employees

Mastercard Logo Mastercard

Sr Payroll Analyst

Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Remote or Hybrid
São Paulo, BRA
38800 Employees

Similar Companies Hiring

Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account