AWS Engineer

Posted 2 Days Ago
Be an Early Applicant
Bengaluru, Bengaluru Urban, Karnataka, IND
In-Office
Mid level
Artificial Intelligence • Consulting
The Role
Build and maintain scalable ETL/ELT data pipelines on AWS Databricks using PySpark, SQL, and Delta Lake. Ingest structured and unstructured data, optimize batch and streaming workloads, ensure data quality, and support orchestration, CI/CD, governance, monitoring, and production issue resolution. Collaborate with analysts, data scientists, architects, and business stakeholders to enable reporting and analytics.
Summary Generated by Built In

It's fun to work in a company where people truly BELIEVE in what they are doing!

We're committed to bringing passion and customer focus to the business.


Job Description

Role Summary

We are looking for a highly motivated Data Engineer with 3–4 years of hands-on experience in AWS Databricks to join our data platform team. The role involves working closely with data scientists, analysts, architects, and business stakeholders to design, build, and maintain scalable, high-performance data pipelines and data solutions within the AWS cloud environment.

The ideal candidate should have strong expertise in Databricks, PySpark, SQL, Delta Lake, and AWS data services, along with a good understanding of modern data engineering practices, orchestration, and data governance.

Key Responsibilities
  • Design, develop, test, and deploy scalable ETL/ELT pipelines using AWS Databricks, PySpark, and SQL.
  • Build and maintain robust data pipelines for ingesting and processing structured and unstructured data from multiple sources such as Amazon S3, Amazon RDS, APIs, and external platforms.
  • Implement and manage Delta Lake solutions to support both batch and streaming data processing.
  • Optimize Spark workloads for performance, scalability, and cost efficiency.
  • Ensure data quality, consistency, reliability, and integrity through validations, monitoring, exception handling, and reconciliation checks.
  • Collaborate with cross-functional teams including data analysts, data modelers, architects, and business stakeholders to support reporting, analytics, and downstream consumption.
  • Support orchestration and scheduling of pipelines using tools such as AWS Glue Workflows, Apache Airflow, or AWS Step Functions.
  • Participate in CI/CD implementation and code deployment processes using Git, AWS CodePipeline, and CodeBuild.
  • Apply best practices related to data governance, metadata management, security, and access control.
  • Support production issue resolution, ad hoc data requests, and continuous improvement of the data platform.
Required Skills and Qualifications
  • Bachelor's degree in Computer Science, Information Systems, Engineering, or a related discipline.
  • 3–4 years of experience in Data Engineering or a similar role.
  • Strong hands-on experience with AWS Databricks.
  • Good proficiency in PySpark and SQL for large-scale data processing.
  • Experience working with Delta Lake and modern lakehouse concepts.
  • Familiarity with AWS services such as Amazon S3, Amazon RDS, AWS Glue, AWS Lambda, and Amazon Redshift.
  • Knowledge of batch and streaming data architectures.
  • Experience with workflow orchestration, monitoring, and debugging of pipelines.
  • Understanding of version control and CI/CD practices.
  • Awareness of data security, governance, and metadata management principles.
  • Strong analytical, problem-solving, and communication skills.
Preferred Qualifications
  • Experience in building data pipelines in enterprise-scale cloud data platforms.
  • Familiarity with real-time / streaming frameworks and event-driven architectures.
  • Exposure to data quality frameworks, reconciliation processes, and operational monitoring.
  • Working knowledge of infrastructure automation and cloud deployment best practices.
  • Experience collaborating in agile delivery environments.
Key Competencies
  • Strong problem-solving orientation
  • Attention to detail and focus on data quality
  • Ability to work in a fast-paced, collaborative environment
  • Good stakeholder communication and coordination skills
  • Ownership mindset with a focus on delivery excellence
Nice to Have
  • Experience with data modeling and analytics enablement
  • Exposure to DevOps and platform engineering practices
  • Certification in AWS or Databricks technologies
Why Join Us

This role offers the opportunity to work at the forefront of cloud-based data engineering, partnering with talented data scientists, analysts, and architects to build scalable, high-impact data solutions on AWS Databricks.

If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us!

Not the right fit?  Let us know you're interested in a future opportunity by clicking Introduce Yourself in the top-right corner of the page or create an account to set up email alerts as new job postings become available that meet your interest!

Skills Required

  • Bachelor's degree in Computer Science, Information Systems, Engineering, or a related discipline
  • 3-4 years of experience in Data Engineering or a similar role
  • Hands-on experience with AWS Databricks
  • Proficiency in PySpark and SQL for large-scale data processing
  • Experience with Delta Lake and modern lakehouse concepts
  • Familiarity with Amazon S3, Amazon RDS, AWS Glue, AWS Lambda, and Amazon Redshift
  • Knowledge of batch and streaming data architectures
  • Experience with workflow orchestration, monitoring, and pipeline debugging
  • Understanding of version control and CI/CD practices
  • Awareness of data security, governance, and metadata management principles
  • Strong analytical, problem-solving, and communication skills
  • Experience building data pipelines in enterprise-scale cloud data platforms
  • Familiarity with real-time or streaming frameworks and event-driven architectures
  • Exposure to data quality frameworks, reconciliation processes, and operational monitoring
  • Working knowledge of infrastructure automation and cloud deployment best practices
  • Experience collaborating in agile delivery environments
  • Experience with data modeling and analytics enablement
  • Exposure to DevOps and platform engineering practices
  • AWS or Databricks certification

Fractal Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Fractal and has not been reviewed or approved by Fractal.

  • Healthcare Strength — Health coverage includes medical, dental, and vision along with tax‑advantaged accounts and EAP in the U.S., indicating a broad core package. Feedback suggests core protections exist across regions, though specifics can vary by location.
  • Leave & Time Off Breadth — Time‑off programs include generous PTO, paid holidays and sick time, paid volunteer time, and sabbaticals in some areas. Some accounts also describe manager‑approved or flexible PTO approaches alongside hybrid/WFH latitude.
  • Flexible Benefits — Work arrangements commonly include remote/hybrid options and flexible schedules. Flexibility is frequently highlighted as part of the overall value proposition.

Fractal Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: New York, NY
5,262 Employees

What We Do

Fractal is one of the most prominent players in the Artificial Intelligence space. Fractal's mission is to power every human decision in the enterprise and brings AI, engineering, and design to help the world's most admired Fortune 500® companies. Fractal's products include Qure.ai to assist radiologists in making better diagnostic decisions, Crux Intelligence to assists CEOs, and senior executives make better tactical and strategic decisions, Theremin.ai to improve investment decisions, and Eugenie.ai to find anomalies in high-velocity data & Samya.ai to drive next-generation Enterprise Revenue Growth Management. Fractal has more than 3,000 employees across 16 global locations, including the United States, UK, Ukraine, India, Singapore, and Australia. Fractal has consistently been rated as India's best companies to work for, by The Great Place to Work® Institute, featured as a leader in Customer Analytics Service Providers Wave™ 2021, Computer Vision Consultancies Wave™ 2020 & Specialized Insights Service Providers Wave™ 2020 by Forrester Research, and recognized as an "Honorable Vendor" in 2021 Magic Quadrant™ for data & analytics by Gartner.

Similar Jobs

Hybrid
Bengaluru, Bengaluru Urban, Karnataka, IND
289097 Employees
Hybrid
Bengaluru, Bengaluru Urban, Karnataka, IND
289097 Employees
Hybrid
2 Locations
289097 Employees
Hybrid
Bengaluru, Bengaluru Urban, Karnataka, IND
289097 Employees

Similar Companies Hiring

Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
33 Employees
Vega Thumbnail
Artificial Intelligence • Automotive • Insurance • Transportation
US
65 Employees
RapidScale Thumbnail
Cloud • Information Technology • Consulting
Raleigh, NC
600 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account