Big Data Engineer

Posted 2 Hours Ago
Hiring Remotely in United States
Remote
Senior level
Information Technology • Consulting
The Role
Build and maintain ETL and data pipelines using Python, PySpark, and AWS services. Orchestrate workflows, develop event-driven integrations, optimize data storage and queries, process API and JSON data, and implement data quality monitoring. Support CI/CD, production operations, cloud migration, data lake and lakehouse initiatives, and near-real-time systems while collaborating with stakeholders to deliver technical solutions.
Summary Generated by Built In

Sr Level Python developer with 8 years of software development experience Build and maintain ETL pipelines using Python and PySpark on AWS Glue and related platforms. - Orchestrate workflows using AWS Step Functions and Lambda. - Implement messaging and event-driven integrations using SNS and SQS. - Design and optimize storage and querying solutions in Amazon Redshift, RDS, Oracle and S3-based architectures. - Write efficient SQL for transformations, validation, and reporting. - Integrate data from APIs and process structured and semi-structured JSON data. - Implement data quality checks, monitoring, and operational support processes. - Participate in CI/CD and version control practices for deployment and release management. - Collaborate with cross-functional teams to translate business requirements into technical solutions. - 4-8 years of software development experience across the appropriate platform. - Strong hands-on experience with Python, PySpark, API’s and SQL. - Experience with ETL/data pipeline development and Orchestration using Step functions / AirFlow . - Working knowledge of AWS services including Glue, Lambda, Step Functions, Redshift, S3, SNS, and SQS. - Experience with Athena, EMR, Kinesis, DynamoDB, or RDS. - Good Knowledge on CloudWatch, logging, and production support. - Understanding of data warehousing, data lakes, Lake House and query optimization. - Experience with GitLab/Terraform or similar and CI/CD workflows. - Good understanding of using AI tools like Github Copilot or similar for code productivity - Exposure to enterprise data lake or cloud migration initiatives. - Have an eye to solving complex problems, great communication with stakeholders - Have a good understanding of performance engineering of code pipelines and near real time systems - Good understanding on Agents and MCP"

Skills Required

  • 4-8 years of software development experience
  • Strong hands-on experience with Python, PySpark, APIs, and SQL
  • Experience developing ETL and data pipelines
  • Experience orchestrating workflows with AWS Step Functions or Apache Airflow
  • Working knowledge of AWS Glue, Lambda, Step Functions, Redshift, S3, SNS, and SQS
  • Experience with Athena, EMR, Kinesis, DynamoDB, or RDS
  • Knowledge of CloudWatch, logging, and production support
  • Understanding of data warehousing, data lakes, lakehouses, and query optimization
  • Experience with GitLab, Terraform, or similar tools and CI/CD workflows
  • Knowledge of AI coding tools such as GitHub Copilot
  • Exposure to enterprise data lake or cloud migration initiatives
  • Understanding of performance engineering for code pipelines and near-real-time systems
  • Understanding of agents and MCP
  • Strong problem-solving and stakeholder communication skills

Hexaware Technologies Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Hexaware Technologies and has not been reviewed or approved by Hexaware Technologies.

  • Healthcare Strength Feedback suggests health insurance is a standout element, often described as strong and comparable or better than many employers. Medical coverage and related protections are repeatedly highlighted as reliable pillars of the package.
  • Parental & Family Support Parental leave options, including extended paid leave in some locations, are offered and seen as valuable for family needs. Feedback suggests these policies complement core medical coverage for a more complete family safety net.
  • Wellbeing & Lifestyle Benefits Wellbeing resources such as an Employee Assistance Program, wellness initiatives, on-site gyms, and engagement activities provide lifestyle support. These offerings are reinforced by flexible work options and shift-related extras where applicable.

Hexaware Technologies Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Navi Mumbai, Maharashtra
27,000 Employees
Year Founded: 1990

What We Do

At Hexaware, we're not just a global technology and business process services company; we're a community of 27,000 Hexawarians dedicated to one singular purpose: creating smiles through the power of great people and technology. With a presence in 40+ offices across 19 countries, we empower enterprises worldwide to embark on their digital transformation journey with unparalleled scale and speed. As an employer, we're more than just a workplace. We put our people first, foster diversity and inclusivity, and prioritize their growth through robust learning and development programs. Our culture is a canvas for innovation as we work toward our shared vision of becoming the world’s most loved digital transformation partner. Exciting, isn’t it? Visit www.hexaware.com to join us in embracing the magic of technology, as we passionately advocate for its potential to transform lives today and shape a brighter future. Together, we'll make the digital world a better place.

Similar Jobs

Agero Logo Agero

Big Data Engineer

Automotive • Big Data • Insurance • Software • Transportation
Easy Apply
Remote or Hybrid
14 Locations
1600 Employees
120K-150K Annually
In-Office or Remote
San Francisco, CA, USA
243K-500K Annually

Hexaware Technologies Logo Hexaware Technologies

Big Data Engineer

Information Technology • Consulting
Remote
United States
27000 Employees

Similar Companies Hiring

Standard Template Labs Thumbnail
Artificial Intelligence • Information Technology • Software
New York, NY
25 Employees
NODA AI Thumbnail
Artificial Intelligence • Information Technology • Software • Cybersecurity
Sydney, AU
54 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account