Location: Bangalore
Experience: 6 - 9 Years
We are looking for a Data Engineer with strong expertise in Python, PySpark, AWS Glue, and Lambda. The ideal candidate should have experience in data processing, transformation, and cloud-based data workflows. A strong foundation in PL/SQL and PostgreSQL is required, and experience with AWS services such as SNS and Step Functions, along with Java API development, would be a plus.
Key Responsibilities:- Develop and optimize ETL pipelines using AWS Glue, Lambda, and PySpark.
- Work with large-scale data processing and transformation using Python and Spark.
- Design and implement data workflows for structured and unstructured data.
- Optimize queries and data storage for performance and cost efficiency.
- Develop and maintain data models, schemas, and database structures using PL/SQL and PostgreSQL.
- Integrate AWS services such as SNS, Step Functions, and other cloud-based workflows.
- Collaborate with cross-functional teams to support business data needs.
- Troubleshoot and optimize data pipelines for scalability and reliability.
✅ Python & PySpark – Strong hands-on experience
✅ AWS Glue & Lambda – Experience in serverless data processing
✅ PL/SQL & PostgreSQL – Basic database development and querying skills
SNS & Step Functions – AWS workflow automation
Java API – Experience in API development and integration
Skills Required
- 6-9 years of experience in data engineering
- Python and PySpark - hands-on experience
- AWS Glue and AWS Lambda - ETL/serverless data processing
- PL/SQL and PostgreSQL - database development and querying
- Designing and optimizing large-scale data processing pipelines
- Experience with AWS SNS and Step Functions
- Java API development and integration
What We Do
Photon.com has emerged as one of the world’s largest and fastest-growing Digital Agencies. We work with 40% of the Fortune 100 on their Digital initiatives and are known for our ability to integrate Strategy Consulting, Creative Design, and Technology at scale. Please visit www.photon.com to learn more about us, how we work, and our customer case studies. Digital Transformation Starts Here.
