AWS Data Engineer

Posted 5 Days Ago
Be an Early Applicant
Hiring Remotely in México
Remote
Expert/Leader
Information Technology • Consulting
The Role
Designs and maintains automated AWS data pipelines using Python, Airflow, dbt, SQL, and cloud storage. Responsibilities include pipeline orchestration, error troubleshooting, data imports and exports, Snowflake query optimization, reusable code generation, testing, security, and GitHub-based CI/CD. The role also supports AWS services, API integrations, monitoring, data quality validation, and collaboration with global teams in English and Spanish.
Summary Generated by Built In
Description

At Sequoia Connect, we are a Talent-First Technology Ecosystem that redefines how elite professionals interact with the global digital landscape. We move beyond traditional models to act as a catalyst for the top 1% of global talent, connecting human potential with complex industrial execution. By joining our inner circle, you are not simply taking a position; you are aligning with a strategic partner dedicated to updating your "Human OS" and accelerating your growth through world-class, high-impact projects.

We are currently partnering with a rapidly growing, automation-led powerhouse that serves 31 Fortune 500 companies across the financial, healthcare, and manufacturing sectors. With a global workforce of over 32,000 employees and a presence in 28 countries, our client is a titan of digital transformation. Their "Automate Everything, Cloudify Everything" strategy ensures you will be working at the absolute forefront of AI-driven automation and cloud solutions.

This is your chance to thrive in a "Customer Success, First and Always" environment that prizes continuous learning and radical ownership. You will collaborate within an international network of expertise across 39 delivery centers worldwide, gaining exposure to complex engineering challenges that redefine industrial standards. If you are a driven professional looking for a dynamic, forward-thinking workplace where your growth is the priority, this is where you belong.

We are currently searching for an AWS Data Engineer:

The Challenge (Responsibilities)

  • Design, develop, and maintain automated ETL pipelines using Python and Apache Airflow.
  • Orchestrate different pipelines to run in sequence or parallel, tracking job pipeline runs to reprocess error records.
  • Troubleshoot data pipeline errors and proactively fix issues.
  • Export and Import data to/from various formats (CSV, JSON, XML) primarily from S3 or other cloud storage solutions.
  • Optimize complex SQL queries for performance within data warehouse technologies, preferably Snowflake.
  • Generate code using configurations with Python and Jinja templates.
  • Implement CI/CD processes from scratch using GitHub.

Your Profile (Requirements)

  • 10+ years of Total Experience, with a 100% hands-on approach to the required technical stack.
  • Advanced proficiency in Python concepts (Code Structures, Modules, Packages, Class, SubClass, Inheritance, Multi-Threading, and Functional Programming) and experience developing reusable Python packages.
  • Advanced SQL skills, including complex joins, CTEs, and subqueries.
  • Proficiency in Python unit, integration, and system testing.
  • Proficiency in implementing DBT tests for data validation and quality checks.
  • In-depth understanding of AWS S3, ECS, and IAM, including best practices for organization and security.
  • Knowledge of AWS security best practices (IAM roles, encryption standards, secure coding guidelines, DBT profiles access configurations).
  • Experience utilizing AI IDE tools (e.g., Cursor, GitHub Copilot).
  • High-Performance Mindset: Resilience, emotional intelligence, and a focus on agile delivery.
  • Technologist DNA: A deep understanding of the difference between "coding" and "engineering."

Desired

  • Experience with AWS Lambda for serverless data processing tasks.
  • Proficiency in using Apache Airflow on AWS to design, schedule, and monitor complex data flows, including integration with AWS services and DBT models (e.g., triggering DBT or EMR, reading from S3 to Redshift/Snowflake).
  • Experience in API integrations to Salesforce, SFTP, SharePoint, OneDrive, etc.
  • Experience creating complex DBT models (full refresh, incremental, snapshots) and custom DBT macros using Jinja and Python.
  • Familiarity with AWS CloudWatch and Datadog for pipeline monitoring and workflow failure alerts.
  • Familiarity with cloud-native foundations or AI coding assistants.

Languages

  • Advanced Oral English: For seamless collaboration with global teams.
  • Advanced Spanish.

Work Arrangement

We value flexibility to support your lifestyle. This position is available as:

  • Remote.

If you meet these qualifications and are pursuing new challenges, start your application on our website to join an award-winning employer. Explore all our job openings | Sequoia Career’s Page: https://www.sequoia-connect.com/careers/

Requirements
  • 10+ Years Experience, 100% Hands-on.
  • Advanced Proficiency in Python concepts (Code Structures, Modules, Packages, Class, SubClass, Inheritance, Multi-Threading, Functional Programming).
  • Experience developing reusable Python packages.
  • Ability to write automated ETL processes and scheduling jobs like Airflow DAG.
  • Troubleshoot data pipeline errors and fix issues.
  • Export/Import data to/from CSV, JSON, XML from S3.
  • Experience using AI IDE tools.
  • Advanced SQL skills (complex joins, CTEs, subqueries).
  • Experience optimizing SQL queries for Snowflake.
  • Proficiency in Python unit, integration, and system tests.
  • Proficiency in implementing DBT tests for data validation.
  • Experience generating code using Python and Jinja templates.
  • Experience in GitHub, implementing CI/CD processes from scratch.
  • In-depth understanding of AWS S3, ECS, IAM.
  • Knowledge of AWS security best practices, encryption, secure coding.

Skills Required

  • 10+ years of total professional experience with a hands-on technical approach
  • Advanced Python proficiency, including modules, packages, classes, inheritance, multithreading, and functional programming
  • Experience developing reusable Python packages
  • Experience building automated ETL processes and Apache Airflow DAGs
  • Experience troubleshooting and resolving data pipeline errors
  • Experience importing and exporting CSV, JSON, and XML data from Amazon S3 or cloud storage
  • Advanced SQL skills, including complex joins, CTEs, and subqueries
  • Experience optimizing SQL queries for Snowflake
  • Proficiency in Python unit, integration, and system testing
  • Proficiency implementing dbt tests for data validation and quality checks
  • Experience generating code with Python and Jinja templates
  • Experience implementing CI/CD processes using GitHub
  • In-depth understanding of AWS S3, ECS, and IAM
  • Knowledge of AWS security practices, IAM roles, encryption, and secure coding
  • Experience using AI IDE tools such as Cursor or GitHub Copilot
  • Advanced oral English proficiency
  • Advanced Spanish proficiency
  • Experience with AWS Lambda for serverless data processing
  • Experience using Apache Airflow on AWS with AWS services and dbt models
  • Experience integrating APIs with Salesforce, SFTP, SharePoint, or OneDrive
  • Experience creating complex dbt models and custom dbt macros
  • Familiarity with AWS CloudWatch and Datadog monitoring
  • Familiarity with cloud-native foundations or AI coding assistants
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Austin, TX
30 Employees
Year Founded: 2017

What We Do

From Technologist to Technologist. We are the catalysts of digital evolution. Our core expertise lies in connecting Top Technologists with Top Companies through unparalleled IT headhunting solutions. Our international expertise helps businesses of all sizes innovate and succeed. Our clients are global companies with over 100k employees serving 700+ clients in 50+ countries. Rooted in a profound grasp of technology, our premier IT Headhunting Services drive transformative growth for Fortune 500 corporations. We maintain the highest standards of technological innovation to meet global demands.

Similar Jobs

ON.energy Logo ON.energy

Data Engineer

Artificial Intelligence • Energy • Renewable Energy
Remote
2 Locations
165 Employees

Global Hitss Logo Global Hitss

Data Engineer

Cloud • Information Technology • Software • Consulting
Remote
MX
12500 Employees

ResilientCo Logo ResilientCo

Data Engineer

Professional Services • Consulting
Remote
11 Locations
12 Employees

Perficient Logo Perficient

Data Engineer

Information Technology
In-Office or Remote
6 Locations
3295 Employees

Similar Companies Hiring

Axle Health Thumbnail
Artificial Intelligence • Healthtech • Information Technology • Logistics
Santa Monica, CA
25 Employees
NODA AI Thumbnail
Artificial Intelligence • Information Technology • Software • Cybersecurity
Sydney, AU
54 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account