Big Data Engineer

Posted 6 Days Ago
Be an Early Applicant
Hiring Remotely in México
Remote
Senior level
Information Technology • Consulting
The Role
Design, build, and maintain ETL pipelines and near-real-time data systems on AWS using Python and PySpark. Orchestrate workflows, implement event-driven integrations, optimize storage/querying (Redshift, RDS, S3), enforce data quality and monitoring, participate in CI/CD, and collaborate with stakeholders to deliver data solutions.
Summary Generated by Built In
- Mid Level Dev AWS Data Engineer with 4-8 years of software development experience Build and maintain ETL pipelines using Python and PySpark on AWS Glue and related platforms. - Orchestrate workflows using AWS Step Functions and Lambda. - Implement messaging and event-driven integrations using SNS and SQS. - Design and optimize storage and querying solutions in Amazon Redshift, RDS, Oracle and S3-based architectures. - Write efficient SQL for transformations, validation, and reporting. - Integrate data from APIs and process structured and semi-structured JSON data. - Implement data quality checks, monitoring, and operational support processes. - Participate in CI/CD and version control practices for deployment and release management. - Collaborate with cross-functional teams to translate business requirements into technical solutions. - 4-8 years of software development experience across the appropriate platform. - Strong hands-on experience with Python, PySpark, API’s and SQL. - Experience with ETL/data pipeline development and Orchestration using Step functions / AirFlow . - Working knowledge of AWS services including Glue, Lambda, Step Functions, Redshift, S3, SNS, and SQS. - Experience with Athena, EMR, Kinesis, DynamoDB, or RDS. - Good Knowledge on CloudWatch, logging, and production support. - Understanding of data warehousing, data lakes, Lake House and query optimization. - Experience with GitLab/Terraform or similar and CI/CD workflows. - Good understanding of using AI tools like Github Copilot or similar for code productivity - Exposure to enterprise data lake or cloud migration initiatives. - Have an eye to solving complex problems, great communication with stakeholders - Have a good understanding of performance engineering of code pipelines and near real time systems - Good understanding on Agents and MCP"

Skills Required

  • 4-8 years of software development experience
  • Strong hands-on experience with Python
  • Strong hands-on experience with PySpark
  • Experience building and maintaining ETL/data pipelines
  • Orchestration experience using AWS Step Functions or Airflow
  • Experience with APIs and integrating structured and semi-structured JSON data
  • Strong SQL skills for transformations, validation, and reporting
  • Working knowledge of AWS services: Glue, Lambda, Step Functions, Redshift, S3, SNS, SQS
  • Experience with Athena, EMR, Kinesis, DynamoDB, or RDS
  • Knowledge of CloudWatch, logging, and production support
  • Understanding of data warehousing, data lakes, Lake House, and query optimization
  • Experience with GitLab, Terraform or similar, and CI/CD workflows
  • Understanding of performance engineering for code pipelines and near real-time systems
  • Exposure to enterprise data lake or cloud migration initiatives
  • Familiarity with AI coding tools like GitHub Copilot
  • Good communication and ability to translate business requirements into technical solutions
  • Understanding of Agents and MCP

Hexaware Technologies Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Hexaware Technologies and has not been reviewed or approved by Hexaware Technologies.

  • Healthcare Strength Feedback suggests health insurance is a standout element, often described as strong and comparable or better than many employers. Medical coverage and related protections are repeatedly highlighted as reliable pillars of the package.
  • Parental & Family Support Parental leave options, including extended paid leave in some locations, are offered and seen as valuable for family needs. Feedback suggests these policies complement core medical coverage for a more complete family safety net.
  • Wellbeing & Lifestyle Benefits Wellbeing resources such as an Employee Assistance Program, wellness initiatives, on-site gyms, and engagement activities provide lifestyle support. These offerings are reinforced by flexible work options and shift-related extras where applicable.

Hexaware Technologies Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Navi Mumbai, Maharashtra
27,000 Employees
Year Founded: 1990

What We Do

At Hexaware, we're not just a global technology and business process services company; we're a community of 27,000 Hexawarians dedicated to one singular purpose: creating smiles through the power of great people and technology. With a presence in 40+ offices across 19 countries, we empower enterprises worldwide to embark on their digital transformation journey with unparalleled scale and speed. As an employer, we're more than just a workplace. We put our people first, foster diversity and inclusivity, and prioritize their growth through robust learning and development programs. Our culture is a canvas for innovation as we work toward our shared vision of becoming the world’s most loved digital transformation partner. Exciting, isn’t it? Visit www.hexaware.com to join us in embracing the magic of technology, as we passionately advocate for its potential to transform lives today and shape a brighter future. Together, we'll make the digital world a better place.

Similar Jobs

Sequoia Connect Logo Sequoia Connect

Big Data Engineer

Information Technology • Consulting
Remote
México
30 Employees

Hexaware Technologies Logo Hexaware Technologies

Big Data Engineer

Information Technology • Consulting
Remote
México
27000 Employees

Scalepex Logo Scalepex

Data Engineer

Artificial Intelligence • HR Tech • Professional Services • Consulting
Remote
México

Similar Companies Hiring

Standard Template Labs Thumbnail
Artificial Intelligence • Information Technology • Software
New York, NY
25 Employees
NODA AI Thumbnail
Artificial Intelligence • Information Technology • Software • Cybersecurity
Sydney, AU
54 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account