Senior Data Engineer
Remote. LATAM-based candidates preferred.
Role Overview
We are seeking a Senior Data Engineer to join one of our client delivery teams. This role focuses on designing, building, and maintaining scalable data platforms and pipelines that support analytics and data-driven products. The position requires strong hands-on experience with modern data stacks, distributed processing, and cloud-based data architectures, with a clear emphasis on data quality, performance, and reliability.
Required Experience
Minimum 5 to 7 years of professional experience in Data Engineering or closely related roles.
At least 4+ years of hands-on experience building and maintaining production-grade data pipelines using Python and SQL.
Demonstrated experience working with cloud-based data platforms and distributed data processing in complex, high-volume environments.
Key Responsibilities
Design, develop, and maintain robust data pipelines using Python and Apache Airflow, including pipeline testing and operational monitoring.
Build and optimize complex SQL transformations, applying advanced techniques such as CTEs, window functions, and query performance tuning.
Model and manage analytical datasets in Snowflake, ensuring scalability, clarity of data models, and cost-efficient usage.
Develop and maintain data processing workflows using Apache Spark for large-scale data transformations.
Integrate and consume streaming data using Apache Kafka, ensuring reliable and scalable data ingestion.
Design and implement testing strategies for data pipelines, including data validation, regression checks, and pipeline reliability controls.
Work with AWS services, primarily S3, to manage data lakes, including partitioning strategies, lifecycle policies, and storage optimization.
Collaborate with cross-functional teams to understand data requirements, ensure data availability, and support downstream analytics and applications.
Contribute to best practices around data architecture, performance optimization, and operational excellence.
Required Platform and Tools
Strong professional experience with Python for data engineering use cases.
Advanced SQL expertise, including complex joins, CTEs, window functions, and performance tuning.
Hands-on experience with Snowflake, focused on data modeling and analytical workloads.
Proven experience developing and testing data pipelines in Apache Airflow using Python.
Experience working with Apache Kafka in data ingestion or streaming architectures.
Solid understanding and practical experience defining and implementing data testing strategies.
Experience with Apache Spark for distributed data processing.
AWS experience, with strong knowledge of S3 for data lakes, including partitioning and lifecycle management.
Nice to Have
Hands-on experience with Snowflake migrations, including data warehouse modernization, performance optimization, and cost optimization initiatives.
Experience leading or supporting Apache Airflow migrations, such as version upgrades, executor changes, or platform migrations.
Seniority Expectations
This role is intended for a senior-level engineer who can operate autonomously, take ownership of data pipelines in production, participate in architectural decisions, and mentor less senior engineers when needed.
What We Offer
Participation in challenging, high-impact projects with international clients.
Remote-first work model with a LATAM-focused team.
Competitive compensation aligned with seniority and expertise.
Opportunity to influence data architecture decisions and best practices within delivery teams.
Top Skills
What We Do
In All Media is a cutting-edge technology and innovation consulting organization, facilitating digital transformation in multiple industries.
We have partnered with top-tier organizations such as NBCUniversal, Sony DADC, Aclara Technologies, and Dun & Bradstreet, among other leading companies worldwide. In All Media harnesses the collaborative synergy of all our international talent pool using Agile methodologies, to deliver excellence efficiently and with the utmost quality.
At In All Media, we believe in diversity and autonomy. Our new model brings together a global managed community, with experts guiding and managing talented engineers; working to bring together the best talent in the world, regardless of where they are. We are not only evolving in terms of technology, but also in terms of In All Media as a re-imagined technology consultancy in step with the Fourth Industrial Revolution.
Our community of 200+ experts and engineers are very motivated by different challenges in their field, and apply continuous learning to stay ahead of the curve in their expertise on new developments and innovative technologies.
Our delivery model is based on Agile, On-site, and Near Shore capabilities to maximize team integration and provide the best value to our clients. We partner holistically with our clients in the co-creation of services and products, and follow streamlined Agile processes throughout.
This makes In All Media a truly global company driven by a community of dedicated, talented individuals self-organizing into multi-disciplinary teams, producing the best possible output for our world-class clients.
We're hiring! Email us your CV: [email protected]
Contact Us: [email protected]
