Senior Data Engineer (Databricks, Spark)

Posted 10 Days Ago
Be an Early Applicant
São Paulo, BRA
In-Office
Senior level
Mobile • Software
The Role
Design, build, and maintain scalable, incremental Databricks/Spark data pipelines and dimensional models. Optimize large-scale Spark workloads, ensure data quality and reconciliation, produce documentation, and collaborate with stakeholders to deliver trusted analytical datasets and metrics.
Summary Generated by Built In
Why Join Exadel

We’re an AI-first global tech company with 25+ years of engineering leadership, 2,000+ team members, and 500+ active projects powering Fortune 500 clients, including HBO, Microsoft, Google, and Starbucks.

From AI platforms to digital transformation, we partner with enterprise leaders to build what’s next.
What powers it all? Our people are ambitious, collaborative, and constantly evolving.

About the Client

A leading global digital banking platform and one of the largest neobanks in Latin America, headquartered in Brazil. The company provides a mobile-first suite of financial services—including credit cards, savings accounts, and investments—designed to eliminate bureaucracy and high fees. By leveraging advanced data analytics and a customer-centric digital infrastructure, the organization delivers transparent and accessible financial solutions to millions of users across Brazil, Mexico, and Colombia.

What You’ll Do
  • Design, develop, and maintain scalable data transformation pipelines integrating SaaS platforms, APIs, batch processing, and enterprise data sources.
  • Process, standardize, and optimize structured and semi-structured (JSON) datasets from heterogeneous systems.
  • Design and implement dimensional data models, including Fact, Dimension, and Event tables following Data Warehouse best practices.
  • Build trusted analytical datasets and business metrics that serve as the organization's Single Source of Truth.
  • Develop incremental, idempotent, and scalable data pipelines using Databricks and Apache Spark.
  • Optimize Spark workloads for large-scale distributed data processing.
  • Implement automated data quality validation, monitoring, alerting, and operational support processes.
  • Validate data reconciliation between legacy and modern cloud platforms throughout migration initiatives.
  • Produce technical documentation and facilitate knowledge transfer to internal engineering teams.
  • Collaborate with cross-functional stakeholders to deliver scalable, high-quality data solutions.
What You Bring
  • Extensive professional experience in Data Engineering or Analytics Engineering.
  • Strong hands-on experience with Databricks, including Workflows, Jobs, and Unity Catalog.
  • Advanced experience developing with Apache Spark (PySpark or Scala).
  • Experience processing large-scale datasets containing hundreds of millions of records.
  • Strong knowledge of Delta Lake and/or Apache Iceberg.
  • Advanced SQL skills with experience writing highly optimized queries.
  • Strong understanding of dimensional data modeling, including: Fact and Dimension tables, Slowly Changing Dimensions (SCD), Grain definition.
  • Experience building incremental and idempotent data pipelines.
  • Experience with Git, CI/CD pipelines, automated testing, and modern software engineering best practices.
  • Strong analytical and problem-solving skills.
Nice to have
  • Experience supporting multi-cloud migration initiatives (GCP to AWS).
  • Experience with AWS services including S3, Glue, and Lake Formation.
  • Familiarity with Google Cloud Platform (GCP).
  • Experience working with sensitive HR or People data while ensuring compliance with LGPD, GDPR, or similar regulations.
  • Understanding of Semantic Layer architecture and modern Lakehouse concepts.
  • Experience integrating REST APIs and processing JSON data.
English level

Advanced English proficiency

Work Type: Hybrid

Location: São Paulo, Brazil

Legal & Hiring Information
  • Exadel is proud to be an Equal Opportunity Employer committed to inclusion across minority, gender identity, sexual orientation, disability, age, and more
  • Reasonable accommodations are available to enable individuals with disabilities to perform essential functions
  • Please note: this job description is not exhaustive. Duties and responsibilities may evolve based on business needs
  • Compensation details are shared with candidates at the early stage of the recruitment process.
  • The offer is not binding until a signed contract is in place.
Your Benefits at Exadel

Exadel benefits vary by location and contract type. Your recruiter will fill you in on the details.

  • International projects
  • In-office, hybrid, or remote flexibility
  • Medical healthcare
  • Recognition program
  • Ongoing learning & reimbursement 
  • Well-being program
  • Team events & local benefits 
  • Sports compensation 
  • Referral bonuses 
  • Top-tier equipment provision
Exadel Culture

We lead with trust, respect, and purpose. We believe in open dialogue, creative freedom, and mentorship that helps you grow, lead, and make a real difference. Ours is a culture where ideas are challenged, voices are heard, and your impact matters.

Skills Required

  • Extensive professional experience in Data Engineering or Analytics Engineering.
  • Hands-on experience with Databricks, including Workflows, Jobs, and Unity Catalog.
  • Advanced experience developing with Apache Spark (PySpark or Scala).
  • Experience processing large-scale datasets containing hundreds of millions of records.
  • Strong knowledge of Delta Lake and/or Apache Iceberg.
  • Advanced SQL skills with experience writing highly optimized queries.
  • Strong understanding of dimensional data modeling (Fact/Dimension tables, SCD, grain definition).
  • Experience building incremental and idempotent data pipelines.
  • Experience with Git, CI/CD pipelines, automated testing, and modern software engineering best practices.
  • Strong analytical and problem-solving skills.
  • Advanced English proficiency.

Exadel Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Exadel and has not been reviewed or approved by Exadel.

  • Fair & Transparent Compensation Pay is considered competitive for certain roles and locations, with timely and predictable payroll practices. Compensation ranges align to market in higher‑cost geographies and senior tracks, indicating offers can be strong when role and market justify it.
  • Healthcare Strength U.S. medical insurance options are described positively, with health coverage and PTO called out as standouts. Company materials and third‑party listings consistently include comprehensive healthcare as a core benefit.
  • Wellbeing & Lifestyle Benefits Flexible, remote‑first norms and outcome‑based work are positioned as core benefits. Learning support such as paid certifications, courses, and conferences is emphasized, alongside a well‑being program.

Exadel Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Walnut Creek, CA
1,549 Employees
Year Founded: 1998

What We Do

For more than 20 years, Exadel has been delivering Digital Transformation services, enterprise and custom software solutions for Fortune 500 clients, including HPE, Deloitte, Home Depot and McKesson. With 20+ locations and delivery centers across the US and Europe, Exadel solves the most complex engineering problems using Agile methodologies, offering a scalable and skilled mix of multi-shore resources at the industry's most competitive price. Exadel’s digital transformation solutions and services help chart new strategies that are built upon creative thinking, cutting-edge design, and technical innovation, designed for the growing digital landscape of business. Enterprise Services - Digital Transformation Experts - Developing mission-critical software and mobile applications - Advising companies on how best to leverage open source technology - Helping companies plan and implement migrations to better technology stacks - Providing QA, automation, and testing services for application development - Supporting and maintaining applications and systems for companies - Providing on-line training and mentoring to companies - Assisting companies in evaluating their current enterprise software architecture and planning for improvements or new systems.

Similar Jobs

bet365 Logo bet365

Gaming Country Lead - Brazil

Digital Media • Gaming • Software • Esports • Automation
In-Office
Barueri, São Paulo, BRA
10000 Employees

Wise Logo Wise

Finance Manager

Fintech • Mobile • Payments • Software • Financial Services
Hybrid
São Paulo, BRA
9000 Employees

Cargill Logo Cargill

Senior Front-end Engineer

Food • Greentech • Logistics • Sharing Economy • Transportation • Agriculture • Industrial
Hybrid
São Paulo, BRA
155000 Employees

Cargill Logo Cargill

Senior Engineer

Food • Greentech • Logistics • Sharing Economy • Transportation • Agriculture • Industrial
Hybrid
São Paulo, BRA
155000 Employees

Similar Companies Hiring

Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account