Sr. Data Engineer (Pyspark, SQL, ETL)

Sr. Data Engineer - PySpark, ETL, SQL

Aligned Automation Based in Pune, Maharashtra, India office.

About the job

A ‘Better Together’ philosophy towards building a better world

Aligned Automation is a strategic service provider that partners with Fortune 500 leaders to digitize enterprise operations and enable business strategies. We believe we can create positive, lasting change in the way our clients work while advancing the global impact of their business solutions for a more optimistic and better world. We are passionate about building and sustaining an inclusive and equitable workplace where all people can develop and thrive. Enriched by our “4C’s” – Care, Courage, Curiosity, and Collaboration – our culture supports solutions that empower the possible.

Mid-Level Position based out of Pune (8 -12 years)

Job Description:

Job Summary:

We are looking for a highly experienced and motivated Senior Data Engineer with a strong background in PySpark, ETL processes, and SQL. The ideal candidate should have deep technical expertise in designing and building scalable data pipelines, data integration, and transformation workflows in distributed environments. This role will play a critical part in enabling data-driven decision-making across the organization.

Key Responsibilities:

• Design, develop, and maintain large-scale, distributed data processing systems using PySpark on big data platforms (Hadoop/Spark).
  
• Build and automate ETL/ELT pipelines to extract data from various structured and unstructured sources.
  
• Optimize and troubleshoot SQL queries for performance, scalability, and accuracy.
  
• Work closely with Data Architects, Data Scientists, and Analysts to deliver clean, structured, and reliable data for business use.
  
• Implement best practices for data modeling, data quality, and data governance.
  
• Monitor and enhance data workflows to ensure reliability and performance in production.
  
• Contribute to technical discussions, architectural reviews, and code reviews.
  
• Mentor junior data engineers and support their technical growth.
  

Required Skills & Qualifications:

• 8–12 years of experience in Data Engineering roles.
  
• Strong expertise in PySpark and Apache Spark for large-scale data processing.
  
• Proven experience designing and building ETL pipelines in production environments.
  
• Deep understanding and hands-on experience in writing complex and optimized SQL queries.
  
• Experience working with big data technologies (e.g., Hadoop, Hive, HDFS, Delta Lake).
  
• Familiarity with data warehouse platforms like Snowflake, Redshift, or BigQuery is a plus.
  
• Solid understanding of data architecture, data modeling, and data quality frameworks.
  
• Experience with cloud platforms (AWS, Azure, or GCP) is preferred.
  
• Strong problem-solving and debugging skills.
  
• Excellent communication and collaboration skills.
  

Preferred Qualifications:

• Experience with workflow orchestration tools like Airflow, Apache NiFi, or similar.
  
• Knowledge of DevOps practices and tools for data engineering (CI/CD, Git, Jenkins).
  
• Experience with containerization and orchestration tools (Docker, Kubernetes) is a plus.
  

Education:

• Bachelor’s or Master’s degree in Computer Science, Information Technology, Engineering, or a related field.