Data Engineer

Posted 2 Days Ago
Be an Early Applicant
Sawo Pålo, São Paulo, BRA
Hybrid
Entry level
Information Technology • Consulting
The Role
Designs and maintains secure, scalable cloud data pipelines for insurance use cases including underwriting, risk management, fraud prevention, and customer experience. Integrates structured and unstructured data, builds data lakes and warehouses, automates ingestion and quality processes, and implements governance, lineage, and regulatory compliance. The role also develops datasets for machine learning and analytics while collaborating with data scientists, architects, and business stakeholders.
Summary Generated by Built In

Who We Are

Building the AI-first frontier enterprise.

We are a global technology consultancy with a trademarked, AI-first approach—Gen-e2™. It redefines how enterprises build digital products and transform their organizations with AI. We do the right thing, and we do it right. We're proud to be a World Economic Forum New Champion, and a B Corp-certified company.

  • We are small enough to care locally, big enough to deliver globally (10 countries, 450+ experts from 50+ nationalities)

  • We are becoming an agentic organization, adopting the AI-native operating model we bring to our clients.

  • We are robust and resilient (100% independent, 0 debt, founded 2009)

  • We are AI-native professionals who invest in what we believe and work as a collective intelligence

We are positive, courageous and deliver at the leading edge.

Your Role

As a Data Engineer for a leading insurance company, you will play a key role in building a data-driven decision-making culture. You will design resilient and secure solutions that transform raw data into strategic insights for underwriting, risk management, fraud prevention, and customer experience.

  • Design, build, and maintain scalable and secure data pipelines in cloud environments (AWS, GCP, or Azure).

  • Integrate large volumes of structured and unstructured data from core insurance systems (such as policies, claims, CRM, ERP).

  • Automate data ingestion, transformation, and quality processes using tools such as Apache Spark, dbt, Kafka, and Airflow.

  • Build and maintain modern data lakes and warehouses (Snowflake, BigQuery, Redshift).

  • Implement data quality, lineage, and governance validations (Great Expectations, Deequ, OpenMetadata).

  • Ensure compliance with data regulations (GDPR, SOC2, etc.) and internal security policies.

  • Design optimized datasets to enable machine learning models, predictive analytics, and dashboards (Power BI, Looker, Tableau).

  • Collaborate with data scientists, architects, and business stakeholders to democratize access to trusted data.

  • Document data architectures, pipelines, transformation standards, and lineage.

Who You Are.

  • Experience with modern data processing frameworks: Spark, databricks, dbt, Kafka, Apache Beam.

  • Strong command of Python and advanced SQL.

  • Hands-on experience with Azure cloud platforms (Data Factory, Synapse).

  • Knowledge of modern Data Lake / Data Warehouse design (Snowflake, Redshift, BigQuery).

  • Familiarity with DataOps, testing, and CI/CD practices in data pipelines.

  • Experience with workflow orchestration systems such as Airflow or Dagster.

  • Understanding of data quality and governance frameworks: Great Expectations, Deequ, DataHub, OpenLineage.

  • Upper-intermediate English level (B2 or higher) for global collaboration.

Nice to Have

  • Knowledge of streaming technologies: Kafka, Pub/Sub, Kinesis.

  • Familiarity with event-driven architectures and microservices.

  • Previous experience in the financial or insurance sector.

  • Certifications such as Azure Data Engineer or Fabric Data Engineer.

  • Experience with MLOps solutions (Vertex AI, SageMaker, MLFlow).

More About PALO IT

Our clients include some of the world’s most successful companies. We collaborate with leading enterprises, next-generation businesses and frontier partners, shaping what comes next, helping them scale AI and solve complex business and technology challenges.

What We Offer

  • Stimulating working environments

  • Unique career path

  • International mobility

  • Internal R&D projects (including Gen-e2™)

  • Knowledge sharing

  • Personalized training via PALO IT Academy

  • Entrepreneurship & intrapreneurship

For more on our team culture and benefits, check out our careers page.

Skills Required

  • Experience with modern data processing frameworks including Spark, Databricks, dbt, Kafka, and Apache Beam
  • Strong command of Python and advanced SQL
  • Hands-on experience with Azure Data Factory and Azure Synapse
  • Knowledge of modern data lake and data warehouse design, including Snowflake, Redshift, or BigQuery
  • Familiarity with DataOps, testing, and CI/CD practices in data pipelines
  • Experience with workflow orchestration systems such as Airflow or Dagster
  • Understanding of data quality and governance frameworks including Great Expectations, Deequ, DataHub, and OpenLineage
  • Upper-intermediate English proficiency at B2 level or higher
  • Knowledge of streaming technologies such as Kafka, Pub/Sub, or Kinesis
  • Familiarity with event-driven architectures and microservices
  • Previous experience in the financial or insurance sector
  • Azure Data Engineer or Fabric Data Engineer certification
  • Experience with MLOps solutions such as Vertex AI, SageMaker, or MLflow
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Hong Kong
583 Employees

What We Do

PALO IT is a global innovation consultancy and Agile software development company dedicated to helping organizations embrace tech as a force for good. We have a team of more than 700 experts across 16 offices in design, tech development and Agile who work with clients in all regions: Europe, Asia-Pacific and the Americas, to rapidly create new business models, launch innovative products and services with positive impact at their core, and prepare leadership and culture for the future. We are proud to be B Corp-certified in Singapore, Hong Kong, Mexico and Thailand, and working towards certifications across all other locations. Certified B Corporations are a leaders of a worldwide movement of people using business as a force for good. There are currently 8,600+ B Corps from 162 industries across 98 countries. We are also honored to be a World Economic Forum New Champion since 2021, a network of high-growth companies chosen by the World Economic Forum who are applying new business models, emerging technologies and sustainable growth strategies into every arm of their organization. We can all act for change, both as individuals and as organizations

Similar Jobs

In-Office or Remote
18 Locations
49681 Employees
105K-148K Annually

Fortive Logo Fortive

Software Engineer

Hardware • Other • Software • Appliances • Industrial • Manufacturing
In-Office or Remote
2 Locations
13486 Employees

Apply Digital Logo Apply Digital

Senior Data Engineer

Information Technology
In-Office or Remote
13 Locations
449 Employees

Zartis Logo Zartis

Senior Data Engineer

Information Technology • Software • Consulting
Remote or Hybrid
11 Locations
237 Employees

Similar Companies Hiring

Standard Template Labs Thumbnail
Artificial Intelligence • Information Technology • Software
New York, NY
25 Employees
NODA AI Thumbnail
Artificial Intelligence • Information Technology • Software • Cybersecurity
Sydney, AU
54 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account