2101 Data Engineer

Posted 2 Days Ago
Be an Early Applicant
Hiring Remotely in Brazil
Remote
Senior level
Digital Media • Consulting
The Role
Build and maintain secure HR data pipelines, warehouses, and data marts using dbt, Python, Snowflake, BigQuery, Airflow, and AWS. Design semantic layers and ontology models for BI and AI agents, deploy Snowflake Cortex and MCP workflows, monitor pipeline reliability, enforce data quality and PII security, and document technical processes. Collaborate remotely with distributed teams aligned to EST.
Summary Generated by Built In

📌 Position: Senior Data Engineer

Location: Remote from LATAM

Contract Type: Full-time vendor

Time Zone Alignment: EST (±2 hours overlap)

🧭 About Inallmedia.com

Inallmedia.com is a global technology and design firm focused on building impactful digital solutions through remote, distributed teams across LATAM. We partner with international clients across industries, providing long-term technical expertise, product innovation, and team augmentation.

🚀 Project Overview

This role is embedded within a centralized Human Resources Data Mart (HRDM) engineering team, specifically supporting the Analytics product area. The primary objective is to maintain a secure, high-quality HR data warehouse that powers workforce analytics across international enterprise Centers of Excellence (COEs) and executive leadership.

As a Senior Data Engineer, you will build data pipelines and cloud infrastructure using dbt, AWS, Snowflake, and BigQuery, bridging traditional data architecture with modern AI capabilities. You will construct a dbt-based semantic layer and establish Model Context Protocol (MCP) and Snowflake Cortex workflows, enabling business leaders to query certified workforce data via natural-language AI agents.

🔍 Key Responsibilities

  • Data Pipeline Engineering & ETL/ELT: Develop, optimize, and maintain secure data pipelines using dbt, PySpark, Python, and Apache Airflow to ingest HR data sources from REST APIs, real-time streams (e.g., Google Sheets, web APIs), and external platforms.
  • Infrastructure & Cloud Resource Tooling: Provision, configure, and maintain scalable infrastructure for extraction, transformation, and loading processes utilizing Terraform, AWS Glue, AWS EMR, and AWS S3.
  • Data Warehouse & Data Mart Modeling: Design and maintain optimized data models, data marts, and warehouse structures across Snowflake and Google BigQuery.
  • Semantic Layer & Ontology Architecture: Build semantic views and ontology layers (mapping CORE → SEMANTIC → METRICS) on top of dbt models to provide business-friendly entity abstractions for BI tools and LLM agents.
  • AI Agent & MCP Deployment: Configure and deploy generative AI query agents using Snowflake Cortex (Cortex Analyst, Cortex Search) and maintain MCP (Model Context Protocol) connections between Snowflake and internal AI tools for secure, natural-language data querying.
  • Pipeline Monitoring, Quality & Compliance: Monitor data pipelines to enforce 99.5% uptime, build automated tests within a Data Quality Framework, ensure secure handling of sensitive data (PII), and produce comprehensive technical documentation.

💡 Must-Have Skills

  • Experience Level: 5+ years of dedicated, hands-on data engineering experience.
  • Data Warehousing & Transformation: Deep expertise in Snowflake (data modeling, datamarts, warehouse design), Google BigQuery (querying and optimization), and dbt (data transformations).
  • Programming & Ingestion: Strong object-oriented Python scripting capabilities and hands-on experience with REST API integrations and real-time data ingestion.
  • Orchestration & Querying: Proficiency in Apache Airflow for pipeline orchestration and advanced, highly optimized SQL writing skills.
  • Governance & Security: Demonstrated experience in the secure handling of large-scale, sensitive data (PII) and writing comprehensive technical documentation.
  • Experience working in Agile teams and remote, distributed environments.
  • Advanced/Fluent English communication skills for daily interaction.

🌟 Nice-to-Have Skills

  • Semantic Layer Design: Experience in semantic modeling design to provide business-object abstractions over dbt and warehouse models.
  • LLM-Native Query Layers: Hands-on experience with Snowflake Cortex (Cortex Analyst, Cortex Search) or equivalent LLM query frameworks.
  • Agentic Frameworks: Exposure to MCP (Model Context Protocol) or similar tool-calling and context-exposure frameworks.
  • Context Engineering: Familiarity with prompt and context engineering to ground AI agents in certified enterprise data sources.

🌐 Time Zone & Collaboration

The role requires collaboration with teams aligned to US Eastern Standard Time (EST). Flexibility to overlap a minimum of 4 core working hours with US time zones is expected.

💬 Language

All interviews, documentation, and daily communication will be in English.

#LI

Skills Required

  • 5+ years of dedicated, hands-on data engineering experience
  • Deep expertise in Snowflake, including data modeling, data marts, and warehouse design
  • Experience with Google BigQuery querying and optimization
  • Experience with dbt data transformations
  • Strong object-oriented Python scripting skills
  • Hands-on experience with REST API integrations and real-time data ingestion
  • Proficiency with Apache Airflow for pipeline orchestration
  • Advanced SQL writing and query optimization skills
  • Experience securely handling large-scale sensitive data, including PII
  • Ability to write comprehensive technical documentation
  • Experience working in Agile teams and remote distributed environments
  • Advanced or fluent English communication skills
  • Experience designing semantic layers and business-object abstractions
  • Experience with Snowflake Cortex, Cortex Analyst, Cortex Search, or equivalent LLM query frameworks
  • Exposure to Model Context Protocol or similar agentic frameworks
  • Familiarity with prompt and context engineering
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: London
208 Employees
Year Founded: 2013

What We Do

In All Media is a cutting-edge technology and innovation consulting organization, facilitating digital transformation in multiple industries. We have partnered with top-tier organizations such as NBCUniversal, Sony DADC, Aclara Technologies, and Dun & Bradstreet, among other leading companies worldwide. In All Media harnesses the collaborative synergy of all our international talent pool using Agile methodologies, to deliver excellence efficiently and with the utmost quality. At In All Media, we believe in diversity and autonomy. Our new model brings together a global managed community, with experts guiding and managing talented engineers; working to bring together the best talent in the world, regardless of where they are. We are not only evolving in terms of technology, but also in terms of In All Media as a re-imagined technology consultancy in step with the Fourth Industrial Revolution. Our community of 200+ experts and engineers are very motivated by different challenges in their field, and apply continuous learning to stay ahead of the curve in their expertise on new developments and innovative technologies. Our delivery model is based on Agile, On-site, and Near Shore capabilities to maximize team integration and provide the best value to our clients. We partner holistically with our clients in the co-creation of services and products, and follow streamlined Agile processes throughout. This makes In All Media a truly global company driven by a community of dedicated, talented individuals self-organizing into multi-disciplinary teams, producing the best possible output for our world-class clients. We're hiring! Email us your CV: [email protected] Contact Us: [email protected]

Similar Jobs

Mastercard Logo Mastercard

Manager, Customer Success

Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Remote or Hybrid
São Paulo, BRA
38800 Employees

Circle Logo Circle

VP of Ecosystem Growth, Brazil

Blockchain • Fintech • Payments • Financial Services • Cryptocurrency • Web3
In-Office or Remote
São Paulo, BRA
1050 Employees

Mondelēz International Logo Mondelēz International

Sr. Analyst, Reporting & Analytics — LA

Big Data • Food • Hardware • Machine Learning • Retail • Automation • Manufacturing
Remote or Hybrid
3 Locations
90000 Employees

Milestone Systems Logo Milestone Systems

Inside Channel Manager - Brazil

Artificial Intelligence • Security • Software • Analytics • Big Data Analytics
Remote or Hybrid
2 Locations
1500 Employees

Similar Companies Hiring

Bankrate Thumbnail
Artificial Intelligence • Consumer Web • Digital Media • Fintech • Marketing Tech • Software • Financial Services
US
160 Employees
Northslope Thumbnail
Artificial Intelligence • Information Technology • Software • Analytics • Consulting • Generative AI
London, GB
100 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account