Lead Data Platform Engineer (Brazil Based)

Posted 2 Days Ago
Be an Early Applicant
Hiring Remotely in São Carlos, São Paulo, BRA
In-Office or Remote
Senior level
Big Data • Marketing Tech • Analytics
The Role
Lead the design, implementation, and evolution of a petabyte-scale AWS data platform. Build and optimize scalable data pipelines (Spark, JVM languages, Python), drive architecture decisions, mentor engineers, ensure operational readiness, and adopt modern data technologies to support analytics and downstream products.
Summary Generated by Built In
Company Description

Experian is a global data and technology company that powers opportunities for people and businesses around the world. We operate across a wide range of markets, including financial services, healthcare, automotive, agribusiness, insurance, among others. Experian invests in people and in advanced new technologies to unlock the power of data. We have an incredible team of 25,200 employees across 32 countries.

Our uniqueness is valuing yours. Experian’s people-centric, inclusive, and purpose-driven culture has been recognized with several awards — including World’s Best Workplaces™ 2025 (Fortune Global Top 25) and Great Place To Work™ in 26 countries, among others. Check out Experian Life on social media or explore our careers site to understand why. Experian is also proud to be an equal opportunity and affirmative action employer.

Job Description

We are looking for a Lead (Senior) Data | Sofware Engineer to lead the evolution of a petabyte-scale data platform on AWS. In this role, you will design and build highly scalable, resilient, and high‑performance data pipelines and services, applying advanced software and data engineering practices. You will collaborate closely with product, engineering, and operations teams to enable next‑generation data‑driven marketing solutions, accelerate innovation, and ensure long‑term platform scalability and reliability.

Your key responsibilities

  • Design, implement, and evolve a petabyte‑scale AWS data platform, applying advanced engineering, distributed systems principles, and cloud‑native practices to ensure performance, reliability, and scalability.
  • Build and optimize highly scalable data pipelines using JVM languages (Java, Scala, Kotlin, etc...), Spark, Python, and cloud‑native services, ensuring efficient, resilient, and production‑ready data processing that supports analytics and downstream products.
  • Act as a principal‑level technical leader, mentoring engineers, driving high‑quality code reviews, and promoting best practices to elevate engineering maturity across the organization.
  • Contribute to architectural and design decisions, working closely with architects, product owners, and engineering leadership to guide platform evolution aligned with business strategy.
  • Plan and deliver complex technical initiatives, ensuring high‑quality outcomes, predictable execution, and effective collaboration within agile value‑stream teams.
  • Ensure operational readiness by following coding standards, testing practices, monitoring strategies, and release procedures, supporting production deployments to maintain platform stability.
  • Explore and adopt modern technologies, such as GraphQL integrations, vector databases, and AI/LLM‑based techniques, enhancing data access, platform usability, and development efficiency.

Qualifications

What we expect from you

  • Expert‑level software and data engineering experience in large‑scale data platforms.
  • Deep experience building petabyte‑scale systems using Java-based languages such as Scala and Apache Spark.
  • Strong expertise across the AWS data ecosystem (Glue, S3, Athena, Managed Airflow, Iceberg).
  • Advanced understanding of distributed systems and highly parallelized workloads.
  • Strong skills in query optimization, data partitioning, and efficient storage patterns.
  • Cloud ecosystem mastery (AWS required; Azure/GCP are pluses).
  • Experience influencing long‑term architecture and platform design.
  • Excellent code review, mentorship, and technical leadership capabilities.
  • Hands‑on experience working in agile environments and collaborating across multiple engineering teams.
  • Strong version control and multi‑repo collaboration skills (Git, GitHub, Bitbucket).
  • Bachelor’s degree in Computer Science, Engineering, or related field, or equivalent experience.
  • Relevant experience.
  • + Advanced English and availability to travel to São Carlos/SP when need it.

Nice to have

  • Experience with DBT or modern transformation frameworks.
  • Knowledge of concurrent and parallel programming.
  • Familiarity with Python, Angular and TypeScript.
  • Experience with vector databases (pgvector, Redis vector fields, etc.).
  • Practical experience applying AI/LLM techniques to data platforms, data access, or software quality.

Additional Information

At Serasa Experian, we believe that diversity is essential for a healthier and more innovative work environment, where everyone can share experiences and express their ideas. That’s why we promote several initiatives to support inclusive recruitment and the professional development of our people.

We also have our affinity groups, created to empower and support individuals from underrepresented groups: ExperianPride (LGBTQIAPN+ community), Ubuntu (racial equity), Women in Experian (gender equity), Aspire (people with disabilities), and Connecting Generations (generations).

Experian Careers - Creating a better tomorrow together

Find out what its like to work for Experian by clicking here

Skills Required

  • Expert-level software and data engineering experience in large-scale data platforms.
  • Deep experience building petabyte-scale systems using Java-based languages (Scala) and Apache Spark.
  • Experience building and optimizing data pipelines using Python and JVM languages.
  • Strong expertise across the AWS data ecosystem (Glue, S3, Athena, Managed Airflow, Iceberg).
  • Advanced understanding of distributed systems and highly parallelized workloads.
  • Strong skills in query optimization, data partitioning, and efficient storage patterns.
  • Cloud ecosystem mastery (AWS required; Azure/GCP are pluses).
  • Experience influencing long-term architecture and platform design.
  • Excellent code review, mentorship, and technical leadership capabilities.
  • Hands-on experience working in agile environments and collaborating across multiple engineering teams.
  • Strong version control and multi-repo collaboration skills (Git, GitHub, Bitbucket).
  • Bachelor's degree in Computer Science, Engineering, or related field, or equivalent experience.
  • Advanced English and availability to travel to São Carlos/SP when needed.
  • Relevant experience.
  • Experience with DBT or modern transformation frameworks.
  • Knowledge of concurrent and parallel programming.
  • Familiarity with Python, Angular, and TypeScript.
  • Experience with vector databases (pgvector, Redis vector fields, etc.).
  • Practical experience applying AI/LLM techniques to data platforms, data access, or software quality.

Experian Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Experian and has not been reviewed or approved by Experian.

  • Healthcare Strength Medical and dental coverage is described as strong, with expanded mental health resources and telemedicine options. Coverage includes inclusive services such as gender transition and fertility support.
  • Leave & Time Off Breadth Time-off offerings are generous, including substantial PTO/vacation, paid holidays, and paid volunteer days with options to purchase additional leave. Parental leave is available for birth and non-birth parents alongside flexible working arrangements that support work-life balance.
  • Retirement Support Retirement programs include a 401(k) with company matching and contributory pension schemes in some regions. These elements complement base pay and bonuses to form a competitive total rewards package.

Experian Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Dublin
16,292 Employees
Year Founded: 1980

What We Do

Experian unlocks the power of data to create opportunities for consumers, businesses and society. During life’s big moments – from buying a home or car, to sending a child to college, to growing a business exponentially by connecting it with new customers – we empower consumers and our clients to manage data with confidence so they can maximize every opportunity. We gather, analyse and process data in ways others can’t. We help individuals take financial control and access financial services, businesses make smarter decision and thrive, lenders lend more responsibly, and organizations prevent identity fraud and crime. For more than 125 years, we’ve helped consumers and clients prosper, and economies and communities flourish – and we’re not done. Our 20,600 people in 43 countries believe the possibilities for you, and our world, are growing. We’re investing in new technologies, talented people and innovation so we can help create a better tomorrow. About Experian: Bringing data to life requires creativity, passion, flexibility and expertise. We want you to share in our success. That's why we offer rewards that recognise great performance. Working in a culture of collaboration, achievement and respect we will give you the support and encouragement you need to develop your skills and talents and progress your career. Everyday our people bring enthusiasm, innovation and inspiration to work and if this sounds like you connect with us at Experian.

Similar Jobs

Teya Logo Teya

Senior Machine Learning Engineer

Fintech • Payments • Financial Services
Remote or Hybrid
2 Locations
1000 Employees

Teya Logo Teya

Artificial Intelligence Engineer

Fintech • Payments • Financial Services
Remote or Hybrid
2 Locations
1000 Employees

Mastercard Logo Mastercard

Senior Analyst, Legal Compliance (Data Analysis)

Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Remote or Hybrid
São Paulo, BRA
38800 Employees

Mastercard Logo Mastercard

Specialist, Implementation

Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Remote or Hybrid
São Paulo, BRA
38800 Employees

Similar Companies Hiring

Scotch Thumbnail
Artificial Intelligence • eCommerce • Fintech • Payments • Retail • Software • Analytics
US
35 Employees
Milestone Systems Thumbnail
Artificial Intelligence • Security • Software • Analytics • Big Data Analytics
Lake Oswego, OR
1500 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account