Experience: 5–7 Years
Location: Noida (Work from Office )
Company-Lumiq.AI - https://lumiq.ai/
Job SummaryWe are looking for an experienced AWS Data Engineering Tech Lead to design, build, and lead scalable data solutions on the AWS cloud. The ideal candidate will have strong hands-on expertise in AWS, PySpark, Spark, SQL, ETL, Python, and Hadoop, along with leadership experience in guiding data engineering teams and delivering high-quality data pipelines.
Key ResponsibilitiesLead the design and development of scalable data pipelines and ETL processes on AWS
Architect and implement big data solutions using PySpark, Spark, and Hadoop
Develop and optimize data processing workflows using Python and SQL
Work closely with stakeholders to understand data requirements and translate them into technical solutions
Ensure data quality, reliability, performance, and security across data platforms
Mentor and guide junior data engineers, conduct code reviews, and enforce best practices
Optimize existing ETL jobs for performance and cost efficiency
Collaborate with DevOps, analytics, and business teams for end-to-end data solutions
Strong experience with AWS services (e.g., S3, EMR, Glue, Redshift, Athena, Lambda – as applicable)
Hands-on expertise in PySpark and Apache Spark
Strong proficiency in SQL and performance tuning
Solid experience in ETL design and development
Advanced knowledge of Python for data engineering
Experience working with Hadoop ecosystem
Understanding of data warehousing and big data architecture
Experience with orchestration tools (Airflow, Step Functions, etc.)
Knowledge of CI/CD pipelines for data engineering
Exposure to real-time data processing (Kafka, Kinesis, etc.)
Experience working in Agile/Scrum environments
Bachelor’s or Master’s degree in Computer Science, Engineering, or related field
5–7 years of experience in data engineering, with at least 1–2 years in a technical lead role
📍 Noida
Skills Required
- 5-7 years of experience in data engineering
- At least 1-2 years in a technical lead role
- Bachelor's or Master's degree in Computer Science, Engineering, or related field
- Strong experience with AWS services (S3, EMR, Glue, Redshift, Athena, Lambda)
- Hands-on expertise in PySpark and Apache Spark
- Proficiency in SQL and performance tuning
- Advanced Python for data engineering
- ETL design and development experience
- Experience with Hadoop ecosystem
- Understanding of data warehousing and big data architecture
- Ability to mentor and guide junior data engineers and conduct code reviews
- Work from office in Noida (on-site)
What We Do
NextHire Consulting is an AI-driven recruiting platform that streamlines the hiring process for companies. By leveraging AI agents for sourcing, screening, and interviewing, the platform enables teams to focus on pre-qualified finalists. It provides data-driven insights into candidate soft skills and behavioral styles, aiming to disrupt traditional recruitment models with efficient, automated, and science-based talent acquisition solutions for businesses of all sizes.
