PySpark Developer – ETL & SQL

Posted 20 Hours Ago
Be an Early Applicant
Hyderabad, Telangana, IND
In-Office
Senior level
Big Data • Cloud • Analytics • Consulting
The Role
Develop and maintain scalable PySpark data pipelines and ETL processes, write optimized SQL for extraction and transformation, manage large structured and unstructured datasets, ensure data quality, resolve performance bottlenecks, and collaborate with cross-functional teams. The role also involves code reviews and applying data engineering best practices. AWS, Airflow, Hadoop, and modern data lake platform experience are preferred.
Summary Generated by Built In

Experience- 4-9years

Location- Hyderabad

PySpark Developer – ETL & SQL

We're looking for a PySpark Developer who enjoys working with data at scale and has a strong foundation in PySpark, ETL development, and SQL. If you're passionate about building efficient data pipelines, transforming large datasets into meaningful insights, and solving complex data challenges, we'd love to connect with you.



Requirements

What You'll Do

  • Develop and maintain robust data pipelines using PySpark.
  • Design and build scalable ETL processes to support business and analytics needs.
  • Write optimized SQL queries for data extraction, transformation, validation, and reporting.
  • Work with large volumes of structured and unstructured data.
  • Ensure data quality, accuracy, and consistency across various data sources.
  • Identify and resolve performance bottlenecks in existing data workflows.
  • Collaborate with cross-functional teams to understand requirements and deliver reliable data solutions.
  • Participate in code reviews and contribute to data engineering best practices.

What We're Looking For

  • 4–8 years of experience in Data Engineering or related roles.
  • Strong hands-on experience with PySpark and large-scale data processing.
  • Solid expertise in designing and developing ETL pipelines.
  • Advanced SQL skills, including query optimization and performance tuning.
  • Good understanding of data warehousing and data modeling concepts.
  • Strong problem-solving skills and attention to detail.
  • Excellent communication and collaboration skills.

Nice to Have

  • Experience with AWS.
  • Exposure to Airflow or other workflow orchestration tools.
  • Familiarity with Hadoop ecosystem technologies.
  • Experience working with modern data lake or cloud data platforms.

 



Benefits
  • Comprehensive Medical Coverage:  
    Health insurance of INR 5.0 Lakhs for you and your family (up to 6 members), ensuring complete peace of mind.
  • Robust Protection Plans:  
    Group Personal Accident Insurance and Group Term Life Insurance to safeguard you and your loved ones.
  • Retirement Benefits: 
    PF and Gratuity provided as per standard government regulations.
  • Flexible Work Options: 
    Enjoy hybrid work arrangements & flexible working hours
  • Generous Leave Policy:  
    21 days of annual leave, in addition to 10 company-declared holidays.
  • Employee Well-being Spaces: 
    Access to a dedicated break-out area with round-the-clock refreshments for relaxation and rejuvenation


Skills Required

  • 4-8 years of experience in Data Engineering or related roles
  • Hands-on experience with PySpark and large-scale data processing
  • Experience designing and developing ETL pipelines
  • Advanced SQL skills, including query optimization and performance tuning
  • Understanding of data warehousing and data modeling concepts
  • Strong problem-solving skills and attention to detail
  • Excellent communication and collaboration skills
  • Experience with AWS
  • Exposure to Airflow or other workflow orchestration tools
  • Familiarity with Hadoop ecosystem technologies
  • Experience with modern data lake or cloud data platforms
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
414 Employees
Year Founded: 2018

What We Do

DATAECONOMY is a global, cloud-first data and AI consultancy delivering enterprise-grade solutions through an innovative intellectual-property suite. Its work spans data and BI platform modernization, self-service AI, data mesh and fabric, master data management, governance, cloud enablement, digital engineering, knowledge graphs, and machine lakes supporting cybersecurity and financial-crime use cases for enterprise clients.

Similar Jobs

Hybrid
Hyderabad, Telangana, IND
205000 Employees
Hybrid
Hyderabad, Telangana, IND
205000 Employees

Wells Fargo Logo Wells Fargo

Senior Software Engineer

Fintech • Financial Services
Hybrid
Hyderabad, Telangana, IND
205000 Employees

Wells Fargo Logo Wells Fargo

Principal Engineer

Fintech • Financial Services
Hybrid
Hyderabad, Telangana, IND
205000 Employees

Similar Companies Hiring

Northslope Thumbnail
Artificial Intelligence • Information Technology • Software • Analytics • Consulting • Generative AI
London, GB
100 Employees
Scotch Thumbnail
Artificial Intelligence • eCommerce • Fintech • Payments • Retail • Software • Analytics
US
35 Employees
Milestone Systems Thumbnail
Artificial Intelligence • Security • Software • Analytics • Big Data Analytics
Lake Oswego, OR
1500 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account