Data Engineer, AWS Glue

Posted Yesterday
Be an Early Applicant
11 Locations
Remote
22-32 Hourly
Senior level
Big Data • Cloud • Information Technology • Analytics • Consulting
The Role
Designs and supports scalable AWS Glue and PySpark data ingestion pipelines from databases, files, APIs, and streaming sources into Amazon S3. Responsibilities include medallion architecture processing, data catalog management, quality controls, reconciliation, workflow orchestration, performance and cost optimization, production support, incident resolution, and governance collaboration.
Summary Generated by Built In

NTT DATA is a team of more than 190,000 diverse professionals, operating in more than 50 countries throughout the world. The sectors where we have activities include: telecommunications, finance, industry, utilities, energy, public administration and health.

Our mission? Offer technological solutions, business, strategy, development and maintenance of applications, while being a benchmark in consulting. All thanks to the collaboration between teams, the human quality of our people and the fact that we do not conform to what is established, we always seek innovation that brings us closer to the future.

Our essence has led us to the forefront of technology, breaking paradigms and providing solutions that truly respond to the needs of each client. Our talent has led us to be one of the top 6 technology companies in the world.

Because #Greattech, needs #GreatPeople, like you

NTT DATA is looking for high-achieving team players that are quickly adaptable to new challenges and entrepreneurial ventures. We are looking for a Data Engineer, AWS Glue to work with our global client in the U.S. for a remote opportunity in LATAM (including Mexico, Brazil, Chile, Peru).

Rate Range: $22-32/hr USD depending on experience

Overview:

We are seeking a Data Engineer specialized in moving data from heterogeneous source systems into Amazon S3 and processing it across the lake, with AWS Glue as the core engine. The primary focus of the role is ingestion: connectivity to  sources, full and incremental extraction, landing zone design, and reliable, repeatable loads at scale. On top of that foundation, capabilities across every layer of the medallion architecture, from raw landing through cleansed and gold layer. Accountable for pipeline reliability, data quality and processing cost efficiency in enterprise or highly regulated environments.
Responsibilities:

  • Design, build and maintain ingestion pipelines that move data from relational, file, API and streaming sources into Amazon S3, with full, incremental and CDC based loads.
  • Define and maintain the landing and raw zone layout: partitioning, file formats, naming conventions, compression, retention and immutability of source data.
  • Onboard new source systems end to end, covering connectivity and network configuration, credential management, extraction strategy, volume and window analysis, and coordination with source owners.
  • Guarantee load completeness and integrity through reconciliation against the source, control tables, reprocessing procedures and clear handling of failed or partial runs.
  • Implement processing across all layers of the medallion architecture, applying cleansing, standardization, deduplication, conformance and business rules at the appropriate stage.
  • Register and maintain datasets in the Glue Data Catalog, keeping schemas, partitions and metadata aligned with Athena, Redshift and Lake Formation.
  • Tune job performance and cost, monitoring DPU consumption, execution times and file layout, and refactoring jobs that exceed agreed targets.
  • Embed data quality controls into pipelines, define rulesets, handle rejected records and publish quality metrics to stakeholders.
  • Orchestrate multi step pipelines with Glue Workflows, Step Functions and EventBridge, including dependency management, alerting and recovery.
  • Provide L2 and L3 support for production pipelines: incident analysis, root cause investigation, backfills and continuous improvement backlog.
  • Apply and document development standards, naming conventions and promotion procedures across Dev, QA and Production environments, and collaborate with governance and security teams on access policies, lineage capture and metadata quality.

Requirements:

  • 5+ years of data engineering experience.
  • Must have working proficiency in English and Spanish, both written and spoken.
  • Hands-on experience building ETL pipelines with AWS Glue and PySpark.
  • Experience moving data from databases and files into Amazon S3.
  • Strong knowledge of Python, SQL, Spark, and data transformation.
  • Experience designing reliable, scalable, and restartable data pipelines.
  • Understanding of S3 data lakes and layered data architectures.
  • Experience with AWS workflow, monitoring, and data-quality tools.
  • Experience supporting production pipelines and troubleshooting failures.

Nice-to-Have:

  • Experience with additional AWS data services such as DMS, Athena, Redshift, or Lake Formation.
  • Familiarity with Informatica, Denodo, Terraform, or CloudFormation.
  • Experience in enterprise or highly regulated environments.
  • Relevant AWS, data engineering, or database certification.

Why NTT DATA?   

Empowerment and rewards are the cornerstone of our career development model. We are a young, fast-growing company, with a highly innovative and entrepreneurial spirit, because of this professional experience and growth will be unmatched. Our talent and positive attitude allows us to transform our goals into achievements, and projects into realities.

NTT DATA is committed to hiring and retaining a diverse workforce. We are proud to be an Equal Opportunity/Affirmative Action-Employer, making decisions without regard to race, color, religion, creed, sex, sexual orientation, gender identity, marital status, national origin, age, veteran status, disability, or any other protected class. NTT DATA is an Equal Opportunity Employer Male/Female/Disabled/Veteran and a VEVRAA Federal Contractor.

 

Skills Required

  • 5+ years of data engineering experience
  • Working proficiency in English and Spanish, written and spoken
  • Hands-on experience building ETL pipelines with AWS Glue and PySpark
  • Experience moving data from databases and files into Amazon S3
  • Strong knowledge of Python, SQL, Spark, and data transformation
  • Experience designing reliable, scalable, and restartable data pipelines
  • Understanding of S3 data lakes and layered data architectures
  • Experience with AWS workflow, monitoring, and data-quality tools
  • Experience supporting production pipelines and troubleshooting failures
  • Experience with AWS DMS, Athena, Redshift, or Lake Formation
  • Familiarity with Informatica, Denodo, Terraform, or CloudFormation
  • Experience in enterprise or highly regulated environments
  • Relevant AWS, data engineering, or database certification
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Tokyo
24,200 Employees

What We Do

NTT DATA Services is a recognized leader in IT and business services including cloud, data and applications. A division of NTT DATA headquartered in Texas, the company leverages consulting and deep industry expertise to help clients accelerate and sustain value throughout their digital journeys. NTT DATA – a part of NTT Group – is a trusted global innovator of IT and business services headquartered in Tokyo. We help clients transform through consulting, industry solutions, business process services, digital & IT modernization and managed services in over 50 countries.

Similar Jobs

Tapestry - Coach and Kate Spade Logo Tapestry - Coach and Kate Spade

Temporary Sales Support Associate

eCommerce • Fashion • Retail • Sales • Wearables • Design
Remote or Hybrid
14 Locations
16000 Employees
15-20 Hourly

Tapestry - Coach and Kate Spade Logo Tapestry - Coach and Kate Spade

Temporary Sales Associate

eCommerce • Fashion • Retail • Sales • Wearables • Design
Remote or Hybrid
14 Locations
16000 Employees
15-20 Hourly
Remote or Hybrid
2 Locations
289097 Employees

Engine Logo Engine

Salesforce Administrator

Consumer Web • Software • Travel
Easy Apply
Remote
10 Locations
1000 Employees

Similar Companies Hiring

Milestone Systems Thumbnail
Artificial Intelligence • Security • Software • Analytics • Big Data Analytics
Lake Oswego, OR
1500 Employees
NODA AI Thumbnail
Artificial Intelligence • Information Technology • Software • Cybersecurity
Sydney, AU
54 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account