ETL Azure Databricks - Senior Consultant

Posted 6 Days Ago
Be an Early Applicant
Hyderabad, Telangana, IND
In-Office
Senior level
Artificial Intelligence • Cloud • Information Technology • Consulting
The Role
Build and maintain scalable ETL/ELT pipelines and data platforms using Databricks, PySpark, Python, and SQL. Integrate data into lakes and warehouses, implement data quality and error handling, optimize and monitor pipeline performance, and collaborate with engineering, architecture, and business teams. Apply cloud, Git, CI/CD, and deployment best practices.
Summary Generated by Built In
ETL Data / Platform Engineer
Experience: 4–8 Years
Job Summary
We are looking for an experienced ETL Data / Platform Engineer with strong hands-on experience in Databricks to build and maintain scalable data pipelines and data platforms.
Key Responsibilities
  • Develop and maintain ETL/ELT data pipelines using Databricks.
  • Work with PySpark, Python, and SQL for data processing and transformation.
  • Integrate data from multiple sources into data lakes and data warehouses.
  • Develop, optimize, and monitor data pipelines.
  • Implement data quality checks, error handling, and performance optimization.
  • Work with cloud platforms such as Azure, AWS, or GCP.
  • Collaborate with data engineers, architects, and business teams.
  • Follow Git, CI/CD, and deployment best practices.
Mandatory Skills
  • 4–8 years of experience in Data Engineering / ETL.
  • Strong hands-on experience with Databricks – Mandatory.
  • Good experience in PySpark, Python, and SQL.
  • Strong knowledge of ETL/ELT concepts and data pipelines.
  • Experience with Data Lake / Data Warehouse.
  • Experience with Azure, AWS, or GCP.
  • Good understanding of data integration, data modeling, and data quality.
Good to Have
  • Experience with Azure Data Factory / AWS Glue.
  • Knowledge of Delta Lake.
  • Experience with Apache Spark / Kafka.
  • Experience with Airflow.
  • Knowledge of CI/CD and DevOps.

Skills Required

  • 4–8 years of experience in data engineering or ETL
  • Strong hands-on experience with Databricks
  • Experience with PySpark, Python, and SQL
  • Strong knowledge of ETL/ELT concepts and data pipelines
  • Experience with data lakes and data warehouses
  • Experience with Azure, AWS, or GCP
  • Understanding of data integration, data modeling, and data quality
  • Experience with Azure Data Factory or AWS Glue
  • Knowledge of Delta Lake
  • Experience with Apache Spark or Kafka
  • Experience with Airflow
  • Knowledge of CI/CD and DevOps
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
422 Employees
Year Founded: 2015

What We Do

Winfo Solutions is an AI innovation-led digital transformation company that helps organizations modernize operations, accelerate growth, and unlock value from data, automation, cloud, and enterprise technologies. It delivers Oracle transformation, AI-powered innovation, intelligent automation, data engineering, analytics, business intelligence, cloud modernization, managed services, and custom application development for global enterprises across industries seeking stronger business outcomes and modernized technology environments.

Similar Jobs

ServiceNow Logo ServiceNow

Manager, Product Design

Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Hybrid
Hyderabad, Telangana, IND
29000 Employees

Wells Fargo Logo Wells Fargo

Full-stack Engineer

Fintech • Financial Services
Hybrid
Hyderabad, Telangana, IND
205000 Employees

Wells Fargo Logo Wells Fargo

Operations Associate

Fintech • Financial Services
Hybrid
Hyderabad, Telangana, IND
205000 Employees
Hybrid
Hyderabad, Telangana, IND
205000 Employees

Similar Companies Hiring

Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees
Kepler  Thumbnail
Artificial Intelligence • Fintech • Software
New York, New York
9 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account