Sr. Data Engineer

Reposted 18 Days Ago
Be an Early Applicant
Pune, Maharashtra, IND
In-Office
Senior level
Cloud • Information Technology • Software
The Role
Design, build, and maintain scalable ETL/data pipelines using PySpark, Python, SQL and Azure Databricks. Ensure data quality and performance, troubleshoot and optimize workflows, collaborate with data scientists and product teams, and follow data governance and agile practices.
Summary Generated by Built In
We are seeking a highly skilled Senior Data Engineer with 7–8 years of experience to design, develop, and optimize data pipelines and solutions. The ideal candidate will have expertise in PySpark, SQL, and Python, with solid knowledge of Azure Databricks. A strong understanding of agile methodologies will be an added advantage.

Key Responsibilities:

  • Design, build, and maintain scalable data pipelines and ETL processes.

  • Work with large datasets to ensure high data quality, accuracy, and performance.

  • Develop data solutions leveraging Azure Databricks, PySpark, and SQL.

  • Collaborate with cross-functional teams including Data Scientists, Analysts, and Product teams to support data-driven initiatives.

  • Troubleshoot and optimize data workflows to improve reliability and efficiency.

  • Ensure compliance with best practices in data governance, security, and performance.

  • Contribute to agile ceremonies and work in a collaborative, fast-paced environment.

Required Skills & Qualifications:

  • 7–8 years of experience in Data Engineering.

  • Strong programming skills in Python and SQL.

  • Hands-on experience with PySpark for large-scale data processing.

  • Good working knowledge of Azure Databricks.

  • Strong problem-solving and debugging skills.

  • Experience in designing and optimizing ETL pipelines.

  • Knowledge of Agile methodologies (Scrum/Kanban) is a plus.

Nice to Have:

  • Familiarity with other Azure services such as Data Lake, Synapse, or Data Factory.

  • Exposure to CI/CD practices and version control systems (e.g., Git).

  • Experience working in a cloud-first data ecosystem.



Skills Required

  • 7-8 years of experience in Data Engineering
  • Strong programming skills in Python
  • Strong programming skills in SQL
  • Hands-on experience with PySpark for large-scale data processing
  • Working knowledge of Azure Databricks
  • Experience designing and optimizing ETL pipelines
  • Strong problem-solving and debugging skills
  • Knowledge of Agile methodologies (Scrum/Kanban)
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Seattle, WA
1,233 Employees
Year Founded: 2002

What We Do

iLink Digital, a CMMI Level 3 and ISO 9001:2015 Certified Global Software Solution Provider and Systems Integrator, delivers next-generation technology solutions to help clients solve complex business challenges, improve organizational effectiveness, increase business productivity, realize sustainable enterprise value and transform your business inside-out. iLink integrates software systems and develops custom applications, components, and frameworks on the latest platforms for IT departments, commercial accounts, application services providers (ASP) and independent software vendors (ISV). iLink solutions are used in a broad range of industries and functions, including healthcare, telecom, government, oil and gas, education, and life sciences. iLink’s expertise includes Cloud Computing & Application Modernization, Data Management & Analytics, Enterprise Mobility, Portal, collaboration & Social Employee Engagement, Embedded Systems and User Experience design etc. What makes iLink Digital's offerings unique is the fact that we use pre-created frameworks, designed to accelerate software development and implementation of business processes for our clients. iLink has over 60 frameworks (solution accelerators), both industry-specific and horizontal, that can be easily customized and enhanced to meet your current business challenges.

Similar Jobs

Mastercard Logo Mastercard

Senior Data Engineer

Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Hybrid
Pune, Maharashtra, IND
38800 Employees

HERE Technologies Logo HERE Technologies

Senior Data Engineer

Artificial Intelligence • Automotive • Computer Vision • Information Technology • Internet of Things • Logistics • Software
Hybrid
Mumbai, Maharashtra, IND
6000 Employees

Coursera + Udemy  Logo Coursera + Udemy

Senior Data Engineer

Artificial Intelligence • Consumer Web • Edtech • Enterprise Web • HR Tech • Social Impact • Generative AI
Remote or Hybrid
India
1500 Employees

Weekday, Inc. Logo Weekday, Inc.

Senior Data Engineer

Artificial Intelligence • HR Tech • Professional Services • Software
In-Office
Mumbai, Maharashtra, IND

Similar Companies Hiring

Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account