Data Engineer (Salesforce / Snowflake Focus) 2153/2154

Posted 7 Days Ago
Be an Early Applicant
Hiring Remotely in Colombia
Remote
Senior level
Digital Media • Consulting
The Role
Build and modernize enterprise data platforms focused on Salesforce data flows. Migrate Hive datasets to Apache Iceberg on AWS S3, scale Airflow DAGs, manage multi-region Kafka streams, optimize Snowflake models and queries, and ensure data quality throughout migrations. Diagnose distributed Spark, Kafka, and AWS performance issues independently while maintaining production-grade pipelines and supporting enterprise VDI compliance requirements.
Summary Generated by Built In

📌 Position: Data Engineer (Salesforce & Snowflake Focus)

📍 Location: Remote (Aligned with US Central Time)

📄 Contract Type: Full-time Contractor (Contract directly with In All Media)

🕒 Time Zone Alignment: US Central Time (CT)

🧭 About In All Media

In All Media is a global technology and design firm focused on building impactful digital solutions through remote, distributed teams worldwide. We partner with international clients across industries, providing long-term technical expertise, product innovation, and team augmentation.

Contract Details: This is a 100% remote contractor position. Your contract and engagement will be directly managed with In All Media.

🚀 Project Overview

In this role, you will architect, build, and scale reliable data pipelines and analytical data models that power Go-To-Market (GTM) operations, enterprise reporting, and Data Science initiatives. Operating within an AWS and Snowflake ecosystem, you will lead multi-source ETL/ELT integrations—with a strong focus on Salesforce and SaaS data flows—while enforcing rigorous data quality, CI/CD best practices, and high-performance query optimization across high-volume datasets.

🔍 Key Responsibilities
  • Batch ETL/ELT Pipeline Engineering: Design, build, and maintain scalable, reliable batch pipelines (hourly and daily incremental loads) that ingest and integrate multi-source enterprise and SaaS data into Snowflake and AWS data lakes.
  • Data Mesh & Analytical Data Modeling: Design, build, and evolve scalable dimensional and domain-oriented analytical data models—specifically structuring common Data Mesh domain models supporting GTM business functions and Salesforce integrations.
  • Performance & Query Tuning: Optimize large-scale distributed data processing and SQL query performance across tables spanning tens of millions of rows and hundreds of gigabytes (GB) to low terabytes (TB).
  • Data Quality, Testing & Observability: Own end-to-end data reliability by implementing automated data quality validation, pipeline testing, monitoring, and alerting within Git version-controlled CI/CD workflows.
  • ML & Data Science Enablement: Partner with Data Science and Machine Learning teams to productionize curated datasets and feature sets for downstream modeling.
  • Cross-Functional Collaboration: Communicate architectural decisions, data contracts, and delivery progress clearly with both technical engineering peers and non-technical GTM stakeholders.
💡 Must-Have Skills
  • Education & Hands-On Experience: Bachelor’s degree with 5+ years of related data engineering experience, or a Master’s degree with 3+ years of experience.
  • Core Programming & Databases: Strong SQL skills paired with hands-on proficiency in Python, Java, or Scala, plus extensive experience working across relational, SQL, and NoSQL databases.
  • Snowflake & AWS Cloud Platforms: Mandatory production experience with Snowflake and AWS managing modern data warehouses or lakehouses.
  • Workflow Orchestration: Deep expertise in pipeline orchestration frameworks such as Apache Airflow (or equivalent enterprise schedulers).
  • Large-Scale Batch & Distributed Processing: Expert understanding of incremental loading strategies (hourly/daily), query/performance tuning, and distributed processing across datasets with tens of millions of rows (hundreds of GB to low TB).
  • Analytical Data Modeling: Strong foundation in dimensional and analytical data modeling, including designing scalable domain-oriented models.
  • Multi-Source & Salesforce Integration: Hands-on experience building ETL/ELT pipelines integrating diverse data sources across AWS, Snowflake, and Salesforce.
  • Engineering Best Practices & AI Tooling: Proven track record enforcing automated data validation, monitoring/alerting, Git version control, CI/CD pipelines, and leveraging AI-assisted coding tools (Cursor, Claude) to accelerate development, debugging, and documentation.
🌟 Nice-to-Have Skills
  • Salesforce-to-Snowflake Integration (Strongly Preferred): Direct experience extracting Salesforce data into Snowflake at scale—including deep familiarity with the Salesforce object model, API rate limits, incremental extraction, and deleted-record handling.
  • SaaS API Ingestion: Strong Snowflake and Airflow background pulling data from external SaaS APIs (managing rate limits, incremental watermarks, and schema drift).
  • Streaming & Modern Data Stack: Operational familiarity with event streaming (Apache Kafka or similar), dbt, data catalogs, or data observability platforms.
  • ML Infrastructure & Domain Background: Experience supporting ML pipelines or feature stores, or prior background in online marketplaces, search, advertising, or recommendation systems.
  • Infrastructure as Code (IaC) & Containers: Hands-on experience with Terraform and Kubernetes.
🌐 Time Zone & Collaboration

This role requires full-time business-hour alignment with US Central Time (CT) to ensure real-time collaboration with US engineering leadership, active participation in daily standups, and live architectural syncs.

💬 Language

All interviews, technical documentation, architectural reviews, daily team syncs, and operational communications will be conducted in English.

Skills Required

  • 6+ years of hands-on data engineering experience designing, deploying, and maintaining distributed production-grade pipelines on petabyte-scale datasets
  • High proficiency in Python
  • Advanced SQL skills, including CTEs, window functions, schema design, and query optimization
  • Production expertise with Apache Spark and PySpark for batch and streaming transformations
  • Strong hands-on experience authoring and maintaining complex Apache Airflow DAGs
  • Experience configuring cross-regional Apache Kafka event pipelines
  • Experience managing AWS S3 data lakes using Apache Iceberg and Parquet
  • Hands-on Snowflake schema modeling, warehouse configuration, and query tuning experience
  • Ability to independently troubleshoot distributed pipeline failures, network latency, and serialization bottlenecks
  • Ability to operate within an enterprise AWS WorkSpace VDI environment
  • Ability to complete and pass the mandatory AWS network health-check verification
  • Experience migrating legacy on-premises or cloud data warehouses to Snowflake
  • Experience with Airflow platform migrations, major version upgrades, or executor changes
  • Experience using AI-assisted development tools such as GitHub Copilot or Cursor
  • Exposure to Salesforce data architectures, object modeling, and CDC/API ingestion
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: London
208 Employees
Year Founded: 2013

What We Do

In All Media is a cutting-edge technology and innovation consulting organization, facilitating digital transformation in multiple industries. We have partnered with top-tier organizations such as NBCUniversal, Sony DADC, Aclara Technologies, and Dun & Bradstreet, among other leading companies worldwide. In All Media harnesses the collaborative synergy of all our international talent pool using Agile methodologies, to deliver excellence efficiently and with the utmost quality. At In All Media, we believe in diversity and autonomy. Our new model brings together a global managed community, with experts guiding and managing talented engineers; working to bring together the best talent in the world, regardless of where they are. We are not only evolving in terms of technology, but also in terms of In All Media as a re-imagined technology consultancy in step with the Fourth Industrial Revolution. Our community of 200+ experts and engineers are very motivated by different challenges in their field, and apply continuous learning to stay ahead of the curve in their expertise on new developments and innovative technologies. Our delivery model is based on Agile, On-site, and Near Shore capabilities to maximize team integration and provide the best value to our clients. We partner holistically with our clients in the co-creation of services and products, and follow streamlined Agile processes throughout. This makes In All Media a truly global company driven by a community of dedicated, talented individuals self-organizing into multi-disciplinary teams, producing the best possible output for our world-class clients. We're hiring! Email us your CV: [email protected] Contact Us: [email protected]

Similar Jobs

Remote
Colombia
575 Employees

Circle (circle.so) Logo Circle (circle.so)

IT Coordinator

Artificial Intelligence • Consumer Web • Digital Media • Information Technology • Social Impact • Software
Remote
40 Locations
250 Employees

Datadog Logo Datadog

Sales Executive

Artificial Intelligence • Cloud • Security • Software • Cybersecurity
Easy Apply
Remote or Hybrid
Colombia
6500 Employees

Datadog Logo Datadog

Account Executive

Artificial Intelligence • Cloud • Security • Software • Cybersecurity
Easy Apply
Remote or Hybrid
Colombia
6500 Employees

Similar Companies Hiring

Bankrate Thumbnail
Artificial Intelligence • Consumer Web • Digital Media • Fintech • Marketing Tech • Software • Financial Services
US
160 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
567 Employees
RapidScale Thumbnail
Cloud • Information Technology • Consulting
Raleigh, NC
600 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account