It's fun to work in a company where people truly BELIEVE in what they are doing!
We're committed to bringing passion and customer focus to the business.
Job Description
Data Engineer (AWS)
Role : DE Engineer (AWS)
Experience : 3-5 years (3+ years of experience with AWS cloud)
Education : BE/B. Tech/M. Tech
Location : Bangalore/India
We are currently seeking an experienced Data Support Engineer with a focus on AWS, Snowflake, Hadoop, Spark, and Python to join our Support team. The ideal candidate will have a solid technical background, strong problem-solving skills, and hands-on experience in troubleshooting and supporting data engineering systems.
Responsibilities Include
Hands-on experience with Hadoop, Spark with Python on AWS.
Provide technical support for data engineering systems, addressing user queries, and resolving issues related to data pipelines, AWS services, Snowflake, Hadoop, and Spark.
Investigate and troubleshoot issues in data pipelines, identifying root causes and implementing solutions to prevent recurrence.
Experience with a range of big data architectures like Hadoop,Spark,Kafka,Hive or other big data technologies.
Effectively manage and resolve incidents related to data processing, ensuring minimal downtime and optimal system performance.
Collaborate with cross-functional teams to prioritize and address critical issues promptly.
Experience in Tuning and Optimizing Spark jobs
Knowledge on Terraform templates for Infrastructure provisioning on AWS (or cloud formation templates)
Possess minimum 3+ years of in BI/DW development experience with Data Model Architecture/Design.
Should have a good understanding of functional programming concepts.
Good knowledge of Python with experience of production grade Python projects.
Continuous Integration, branching and merging, pair programming, code reviews, unit testing, agile methodologies (Scrum), Design Patterns.
Knowledge on CI/CD implementation like AWS Code Commit, Code Deploy for CI/CD pipelines (Git knowledge preferable)
Knowledge on Scheduling Tools and techniques on Hadoop/EMR.
Excellent written and verbal communication skills.
Strong analytical and project management skills.
Technical Essentials
Proven experience in providing technical support for data engineering systems.
Strong understanding of AWS services, including S3, Glue, Redshift, EMR, Lambda, Athena, and Step Functions.
Hands-on experience supporting Snowflake, Hadoop, Spark, and Python in a production environment.
Familiarity with data modeling, optimization, and performance tuning.
Excellent problem-solving skills and the ability to analyze and diagnose complex technical issues.
Experience with incident management, including prioritization and resolution procedures.
Strong communication and collaboration skills for working with cross-functional teams.
Knowledge of best practices in cloud-based data engineering and support.
Preferred:
AWS Certified Solutions Architect – Associate
Personal Specifications:
Self-motivated team player with strong analytical, relationship management with effective written and oral communication skills.
If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us!
Not the right fit? Let us know you're interested in a future opportunity by clicking Introduce Yourself in the top-right corner of the page or create an account to set up email alerts as new job postings become available that meet your interest!
Top Skills
What We Do
Fractal is one of the most prominent players in the Artificial Intelligence space. Fractal's mission is to power every human decision in the enterprise and brings AI, engineering, and design to help the world's most admired Fortune 500® companies.
Fractal's products include Qure.ai to assist radiologists in making better diagnostic decisions, Crux Intelligence to assists CEOs, and senior executives make better tactical and strategic decisions, Theremin.ai to improve investment decisions, and Eugenie.ai to find anomalies in high-velocity data & Samya.ai to drive next-generation Enterprise Revenue Growth Management.
Fractal has more than 3,000 employees across 16 global locations, including the United States, UK, Ukraine, India, Singapore, and Australia. Fractal has consistently been rated as India's best companies to work for, by The Great Place to Work® Institute, featured as a leader in Customer Analytics Service Providers Wave™ 2021, Computer Vision Consultancies Wave™ 2020 & Specialized Insights Service Providers Wave™ 2020 by Forrester Research, and recognized as an "Honorable Vendor" in 2021 Magic Quadrant™ for data & analytics by Gartner.
