Azure Data Engineer

Posted Yesterday
Be an Early Applicant
Bangalore, Bengaluru Urban, Karnataka, IND
In-Office
Mid level
Information Technology
The Role
Design, build, and automate end-to-end ETL/ELT pipelines and large-scale data processing (batch and streaming) on Azure and AWS. Manage data lakehouse storage, implement data modeling and quality checks, and deploy infrastructure and CI/CD for reliable, observable data platforms.
Summary Generated by Built In

What success looks like in this role:

End-to-End Pipeline Engineering: Build and automate robust ETL/ELT pipelines using Azure Data Factory (ADF), AWS Glue, and Apache Airflow.

· Distributed Computing: Develop large-scale data processing jobs using PySpark and Scala within Databricks or EMR environments.

· Streaming & Real-time Integration: Design and implement real-time data ingestion and processing layers using Apache Kafka, Confluent, or AWS Kinesis.

· Data Lakehouse : Manage and optimize cloud storage using ADLS Gen2 and S3, implementing ACID transactions with Delta Lake or Apache Iceberg.

· Advanced Data Modeling: Design highly performant schemas for cloud data warehouses like Snowflake, Amazon Redshift, or Google BigQuery.

· Data Transformation & Quality: Use dbt (data build tool) for modeling and implement automated quality checks using Great Expectations or Soda.

· Infrastructure & CI/CD: Deploy and manage data infrastructure using Terraform or CloudFormation, and maintain CI/CD pipelines via GitHub Actions or GitLab CI.

Technical Stack Requirements

· Cloud Platforms: Deep hands-on experience with Microsoft Azure (ADF, Synapse, Databricks) and AWS (S3, Glue, Athena, Lambda).

· Programming: Strong proficiency in Python (PySpark, FastAPI), SQL, and familiarity with Java or Scala.

· Big Data Tools: Experience with Apache Spark, Apache Flink, and Hadoop ecosystem.

· Databases: Strong knowledge of both Relational (PostgreSQL, MySQL) and NoSQL (MongoDB, Cassandra, or DynamoDB) databases.

· Containerization: Proficiency with Docker and Kubernetes (K8s) for deploying data services.

· Observability: Familiarity with monitoring tools like Prometheus, Grafana, or Datadog to track pipeline health.

#LI-SS1

You will be successful in this role if you have:

Experience: 2-4years of professional experience in data engineering, backend engineering, or a related field.

· Education: Bachelor’s  Engineering, 

· Methodology: Strong understanding of Agile methodologies and the ability to work in a fast-paced, iterative environment.

· Soft Skills: Excellent problem-solving skills and the ability to explain complex technical concepts to non-technical stakeholders.

Preferred Certifications

· Azure Data Engineer Associate (DP-203).

· AWS Certified Data Engineer – Associate.

· Databricks Certified Professional Data Engineer.

Unisys is proud to be an equal opportunity employer that considers all qualified applicants without regard to age, blood type, caste, citizenship, color, disability, family medical history, family status, ethnicity, gender, gender expression, gender identity, genetic information, marital status, national origin, parental status, pregnancy, race, religion, sex, sexual orientation, transgender status, veteran status or any other category protected by law.

Local employment practices and rights may vary by jurisdiction and are subject to applicable local laws. This commitment includes our efforts to provide for all those who seek to express interest in employment the opportunity to participate without barriers.

 

If you are a US job seeker unable to review the job opportunities herein, or cannot otherwise complete your expression of interest, without additional assistance and would like to discuss a request for reasonable accommodation, please contact our Global Recruiting organization at [email protected]. US job seekers can find more information about Unisys’ EEO commitment here.

Skills Required

  • 2-4 years of professional experience in data engineering or related field
  • Bachelor's degree in Engineering
  • Hands-on experience with Azure (ADF, Synapse, Databricks)
  • Hands-on experience with AWS (S3, Glue, Athena, Lambda)
  • Proficiency in Python and SQL
  • Experience with PySpark and Apache Spark in Databricks or EMR
  • Experience designing and implementing streaming ingestion using Kafka/Confluent or Kinesis
  • Data lakehouse experience with ADLS Gen2 or S3 and Delta Lake or Apache Iceberg
  • Cloud data warehouse modeling experience (Snowflake, Redshift, or BigQuery)
  • Experience with dbt for transformations and Great Expectations or Soda for data quality
  • Infrastructure as Code experience with Terraform or CloudFormation
  • CI/CD pipeline experience (GitHub Actions or GitLab CI)
  • Containerization and orchestration experience with Docker and Kubernetes
  • Familiarity with observability/monitoring tools (Prometheus, Grafana, Datadog)
  • Strong understanding of Agile methodologies and effective communication skills
  • Familiarity with Java or Scala
  • Preferred certifications: Azure Data Engineer Associate (DP-203), AWS Certified Data Engineer - Associate, Databricks Certified Professional Data Engineer

Unisys Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Unisys and has not been reviewed or approved by Unisys.

  • Fair & Transparent Compensation Fair & Transparent Compensation: Compensation terms at hire are often presented clearly and upfront, creating a straightforward “take it or leave it” expectation. Pay outcomes are also described as variable by role and geography, with some pockets viewed as satisfactory or above average.
  • Retirement Support Retirement Support: A 401(k) plan with an employer match is commonly described as part of the core package. The match is often characterized as a meaningful component of total rewards relative to other benefits.
  • Healthcare Strength Healthcare Strength: Core medical, dental, and vision coverage is described as available and broadly in line with a large IT-services employer. The underlying carrier network is sometimes viewed as solid even when cost concerns exist.

Unisys Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
Albany, NY
22,588 Employees
Year Founded: 1986

What We Do

Unisys is a global information technology company that builds high-performance, security-centric solutions for the most demanding businesses and governments on Earth. Unisys offerings include security software and services; digital transformation and workplace services; industry applications and services; and innovative software operating environments for high-intensity enterprise computing. We build better outcomes securely for our clients across the Government, Financial Services and Commercial

Similar Jobs

Photon Logo Photon

Data Engineer

Agency • Information Technology
In-Office
2 Locations
5017 Employees

Unisys Logo Unisys

Data Engineer

Information Technology
In-Office
Bangalore, Bengaluru Urban, Karnataka, IND
22588 Employees

Weekday, Inc. Logo Weekday, Inc.

Data Engineer

Artificial Intelligence • HR Tech • Professional Services • Software
In-Office
4 Locations
500K-2M Annually

Brillio Logo Brillio

Data Engineer

Information Technology
Hybrid
Bangalore, Bengaluru Urban, Karnataka, IND
2676 Employees

Similar Companies Hiring

Scrunch  Thumbnail
Artificial Intelligence • Information Technology • Marketing Tech • Software • SEO
Salt Lake City, Utah
Standard Template Labs Thumbnail
Artificial Intelligence • Information Technology • Software
New York, NY
25 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account