Big Data Lead

Posted 2 Days Ago
Be an Early Applicant
Hiring Remotely in México
Remote
Expert/Leader
Information Technology • Consulting
The Role
Hands-on Big Data Lead/Data Engineer responsible for designing and building ETL/data pipelines in Python, scheduling orchestrations (Airflow), optimizing SQL in Snowflake, implementing tests (unit, integration, dbt), generating reusable code/packages (Jinja), managing version control/CI-CD, and administering AWS data services (S3, ECS, IAM).
Summary Generated by Built In
Job Description Job Descriptions Data Engineer Must have below: 10+ Years Experience Great Communicator/Client Facing/ Attention to detail Individual Contributor and ability to work as a team. 100% Hands on in the mentioned skills Programming Skills: Python and Data Pipelines: Advanced Proficiency in Python concepts like Code Structures, Modules, Packages, Class, SubClass, Inheritance, Multi-Threading and Functional Programming. Experience in developing reusable Python packages for internal or public usage Ability to write automating ETL processes and scheduling jobs like Airflow DAG. Ability to track job pipeline runs to reprocess error records Ability to orchestration different pipelines to run in sequence or parallel. Troubleshoot data pipeline errors and fix issues Export or Import data to/from various formats like CSV, JSON, XML etc preferably from S3 or other cloud storage. Experience in using AI IDE tool SQL: Advanced SQL skills, including complex joins, CTE's and subqueries Experience in optimizing SQL queries for performance and optimization in data warehouse technologies preferably Snowflake Testing and documentation: Proficiency in Python unit, integration and system test. Proficiency in implementing DBT tests for data validation and quality checks Code Generation: Experience in generating code using configurations using python and jinja templates Version control: Experience in GitHub, including implementing CI/CD process from scratch AWS Expertise: Data Storage solutions: In depth understanding of AWS S3 for data storage, ECS, IAM including best practices for organization and security

Skills Required

  • 10+ years experience
  • Strong communication and client-facing skills
  • Attention to detail
  • Ability to work independently and in a team
  • 100% hands-on with listed skills
  • Advanced Python (modules, packages, OOP, multithreading, functional programming)
  • Experience developing reusable Python packages
  • Ability to write automated ETL processes and schedule jobs (Airflow DAGs)
  • Ability to track pipeline runs and reprocess error records
  • Orchestrate pipelines to run in sequence or parallel
  • Troubleshoot and fix data pipeline errors
  • Export/import data in CSV, JSON, XML (preferably from S3 or cloud storage)
  • Experience using AI IDE tools
  • Advanced SQL skills including complex joins, CTEs, subqueries, and performance optimization
  • Experience with Snowflake or similar data warehouse technologies
  • Proficiency in unit, integration, and system testing for Python code
  • Experience implementing DBT tests for data validation and quality checks
  • Experience generating code via configuration using Python and Jinja templates
  • Experience with GitHub and implementing CI/CD from scratch
  • AWS expertise: S3, ECS, IAM best practices for organization and security

Hexaware Technologies Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Hexaware Technologies and has not been reviewed or approved by Hexaware Technologies.

  • Healthcare Strength Feedback suggests health insurance is a standout element, often described as strong and comparable or better than many employers. Medical coverage and related protections are repeatedly highlighted as reliable pillars of the package.
  • Parental & Family Support Parental leave options, including extended paid leave in some locations, are offered and seen as valuable for family needs. Feedback suggests these policies complement core medical coverage for a more complete family safety net.
  • Wellbeing & Lifestyle Benefits Wellbeing resources such as an Employee Assistance Program, wellness initiatives, on-site gyms, and engagement activities provide lifestyle support. These offerings are reinforced by flexible work options and shift-related extras where applicable.

Hexaware Technologies Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Navi Mumbai, Maharashtra
27,000 Employees
Year Founded: 1990

What We Do

At Hexaware, we're not just a global technology and business process services company; we're a community of 27,000 Hexawarians dedicated to one singular purpose: creating smiles through the power of great people and technology. With a presence in 40+ offices across 19 countries, we empower enterprises worldwide to embark on their digital transformation journey with unparalleled scale and speed. As an employer, we're more than just a workplace. We put our people first, foster diversity and inclusivity, and prioritize their growth through robust learning and development programs. Our culture is a canvas for innovation as we work toward our shared vision of becoming the world’s most loved digital transformation partner. Exciting, isn’t it? Visit www.hexaware.com to join us in embracing the magic of technology, as we passionately advocate for its potential to transform lives today and shape a brighter future. Together, we'll make the digital world a better place.

Similar Jobs

RHS Logo RHS

Big Data Lead - Cloud - Snowflakes Monterrey N.L.

Robotics • Industrial • Automation
Remote
Monterrey, Nuevo León, MEX

RHS Logo RHS

Big Data Lead - Cloud - Snowflakes Guadalajara, Jal.

Robotics • Industrial • Automation
Remote
Guadalajara, Jalisco, MEX

Mondelēz International Logo Mondelēz International

Manager, Sourcing

Big Data • Food • Hardware • Machine Learning • Retail • Automation • Manufacturing
Remote or Hybrid
2 Locations
90000 Employees
103K-128K Annually

Samsara Logo Samsara

Especialista en Sistemas Telemáticos

Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Easy Apply
Remote or Hybrid
México
4000 Employees

Similar Companies Hiring

Amplify Platform Thumbnail
Fintech • Financial Services • Consulting • Cloud • Business Intelligence • Big Data Analytics
Scottsdale, AZ
62 Employees
Standard Template Labs Thumbnail
Artificial Intelligence • Information Technology • Software
New York, NY
25 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account