Big Data Lead

Posted 13 Days Ago
Be an Early Applicant
Hiring Remotely in México
Remote
Expert/Leader
Information Technology • Consulting
The Role
Lead design and implementation of scalable batch and near-real-time AWS data pipelines. Define storage and access patterns, ensure data quality, observability, performance tuning, production troubleshooting, cloud/data migration, CI/CD best practices, and review solution and code readiness while collaborating with architects and stakeholders.
Summary Generated by Built In
- Sr Dev - AWS Data Engineer with 12+ years of software development experience - Architect and implement scalable batch and near-real-time data pipelines using Python, PySpark, Glue, EMR, Lambda, and Step Functions. Define data storage, transformation, and access patterns across S3, Redshift, Athena, RDS, and DynamoDB. - Design event-driven and integration solutions using SNS, SQS, Kinesis, and APIs. - Establish standards for data quality, observability, monitoring, logging, and failure recovery. - Optimize data processing, storage, and query performance across AWS platforms. - Lead troubleshooting of production issues and drive root cause analysis and corrective actions. - Support cloud migration, data migration, and modernization initiatives. - Review solution designs, code quality, and production readiness across projects. - Collaborate with architects, platform teams, and business stakeholders to align technical solutions with business needs. - Drive best practices for CI/CD, deployment automation, and documentation. Required Skills and Qualifications - Solid IT background and experience. - Experience as an application developer for projects similar in scope and responsibility. - Advanced knowledge of AWS services and architecture. - Strong experience with Python object-oriented programming, PySpark, SQL, and ETL frameworks. - Deep experience with AWS services including Glue, EMR, Redshift, RDS, Athena, Lambda, Step Functions, SNS, SQS, S3, CloudWatch, and CloudTrail. - Strong understanding of enterprise data architecture, migration, and support models. - Experience with GitLab and Terraform and release/deployment practices. Preferred Skills - Experience with Kinesis, ECS, Batch, Beanstalk, and DynamoDB. - Exposure to infrastructure-as-code and reusable platform patterns. - Have a good understanding of performance engineering of code pipelines and near real time systems - Good understanding on Agents and MCP

Skills Required

  • 12+ years software development experience
  • Experience as an application developer on similar scoped projects
  • Advanced knowledge of AWS services and architecture
  • Python (object-oriented programming)
  • PySpark
  • SQL
  • Experience with ETL frameworks
  • Deep experience with AWS Glue, EMR, Redshift, RDS, Athena, Lambda, Step Functions, SNS, SQS, S3, CloudWatch, CloudTrail
  • Strong understanding of enterprise data architecture, migration, and support models
  • Experience with GitLab and Terraform and release/deployment practices
  • Experience with Kinesis, ECS, Batch, Beanstalk, and DynamoDB
  • Exposure to infrastructure-as-code and reusable platform patterns
  • Performance engineering of code pipelines and near-real-time systems
  • Understanding of Agents and MCP

Hexaware Technologies Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Hexaware Technologies and has not been reviewed or approved by Hexaware Technologies.

  • Healthcare Strength Feedback suggests health insurance is a standout element, often described as strong and comparable or better than many employers. Medical coverage and related protections are repeatedly highlighted as reliable pillars of the package.
  • Parental & Family Support Parental leave options, including extended paid leave in some locations, are offered and seen as valuable for family needs. Feedback suggests these policies complement core medical coverage for a more complete family safety net.
  • Wellbeing & Lifestyle Benefits Wellbeing resources such as an Employee Assistance Program, wellness initiatives, on-site gyms, and engagement activities provide lifestyle support. These offerings are reinforced by flexible work options and shift-related extras where applicable.

Hexaware Technologies Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Navi Mumbai, Maharashtra
27,000 Employees
Year Founded: 1990

What We Do

At Hexaware, we're not just a global technology and business process services company; we're a community of 27,000 Hexawarians dedicated to one singular purpose: creating smiles through the power of great people and technology. With a presence in 40+ offices across 19 countries, we empower enterprises worldwide to embark on their digital transformation journey with unparalleled scale and speed. As an employer, we're more than just a workplace. We put our people first, foster diversity and inclusivity, and prioritize their growth through robust learning and development programs. Our culture is a canvas for innovation as we work toward our shared vision of becoming the world’s most loved digital transformation partner. Exciting, isn’t it? Visit www.hexaware.com to join us in embracing the magic of technology, as we passionately advocate for its potential to transform lives today and shape a brighter future. Together, we'll make the digital world a better place.

Similar Jobs

Sequoia Connect Logo Sequoia Connect

Big Data Lead

Information Technology • Consulting
Remote
México
30 Employees

Hexaware Technologies Logo Hexaware Technologies

Big Data Lead

Information Technology • Consulting
Remote
México
27000 Employees

Sequoia Connect Logo Sequoia Connect

Big Data Lead

Information Technology • Consulting
Remote
México
30 Employees

Hexaware Technologies Logo Hexaware Technologies

Big Data Lead

Information Technology • Consulting
Remote
México
27000 Employees

Similar Companies Hiring

Standard Template Labs Thumbnail
Artificial Intelligence • Information Technology • Software
New York, NY
25 Employees
NODA AI Thumbnail
Artificial Intelligence • Information Technology • Software • Cybersecurity
Sydney, AU
54 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account