Sr Data Engineer-AWS

Posted 6 Hours Ago
Be an Early Applicant
Bangalore, Bengaluru Urban, Karnataka, IND
In-Office
Senior level
Artificial Intelligence • Big Data • Cloud • Consulting
The Role
Design and build scalable AWS data lakes, lakehouses, and ETL/ELT pipelines using Glue, Python, and Spark. Integrate structured and semi-structured data from APIs, on-premises systems, and third-party sources. Manage IAM, security controls, governance, and compliance readiness. Automate infrastructure deployments with CI/CD and Docker, operate workloads on ECS or EKS, and monitor pipelines with CloudWatch. Collaborate with platform, AI, analytics, data science, and business teams to deliver reliable data assets.
Summary Generated by Built In

Job Title: Senior Data Engineer

Location: Remote

Experience: 5–8 Years

Employment Type: Full-Time

About the Role

Aptus Data Labs is looking for a talented and proactive Senior Data Engineer to help build the backbone of our enterprise data and AI initiatives. You’ll work on modern data lake architectures and high-performance pipelines in AWS, enabling real-time insights and scalable analytics.

This role reports to the Head – Data Platform and AI Lead, offering a unique opportunity to be part of a cross-functional team shaping the future of data-driven innovation.

 

Key Responsibilities

Data Engineering & Pipeline Development

  • Design and develop reliable, reusable ETL/ELT pipelines using AWS Glue, Python, and Spark.
  • Process structured and semi-structured data (e.g., JSON, Parquet, CSV) efficiently for analytics and AI workloads.
  • Build automation and orchestration workflows using Airflow or AWS Step Functions.

Data Lake Architecture & Integration

  • Implement AWS-native data lake/lakehouse architectures using S3, Redshift, Glue Catalog, and Lake Formation.
  • Consolidate data from APIs, on-prem systems, and third-party sources into a centralized platform.
  • Optimize data models and partitioning strategies for high-performance queries.

Security, IAM & Governance Support

  • Ensure secure data architecture practices across AWS components using encryption, access control, and policy enforcement.
  • Implement and manage AWS IAM roles and policies to control data access across services and users.
  • Collaborate with platform and security teams to maintain compliance and audit readiness (e.g., HIPAA, GxP).
  • Apply best practices in data security, privacy, and identity management in cloud environments.

DevOps & Observability

  • Automate deployment of data infrastructure using CI/CD pipelines (GitHub Actions, Jenkins, or AWS CodePipeline).
  • Create Docker-based containers and manage workloads using ECS or EKS.
  • Monitor pipeline health, failures, and performance using CloudWatch and custom logs.

Collaboration & Communication

  • Partner with the Data Platform Lead and AI Lead to align engineering efforts with AI product goals.
  • Engage with analysts, data scientists, and business teams to gather requirements and deliver data assets.
  • Contribute to documentation, code reviews, and architectural discussions with clarity and confidence.

 

Required Qualifications

  • Bachelor’s degree in Computer Science, Engineering, or equivalent.
  • 5–8 years of experience in data engineering, preferably in AWS cloud environments.
  • Proficient in Python, SQL, and AWS services: Glue, Redshift, S3, IAM, Lake Formation.
  • Experience managing IAM roles, security policies, and cloud-based data access controls.
  • Hands-on experience with orchestration tools like Airflow or AWS Step Functions.
  • Exposure to CI/CD practices and infrastructure automation.
  • Strong interpersonal and communication skills—able to convey technical ideas clearly.


Preferred Additional Skills
  • Proficiency in Databricks, Unity Catalog, and Spark-based distributed data processing.
  • Background in Pharma, Life Sciences, or other regulated environments (GxP, HIPAA).
  • Experience with EMR, Snowflake, or hybrid-cloud data platforms.
  • Experience with BI/reporting tools such as Power BI or QuickSight.
  • Knowledge of integration tools (Boomi, Kafka) or real-time streaming frameworks.


Ready to build data solutions that fuel AI innovation?

Join Aptus Data Labs and play a key role in transforming raw data into enterprise intelligence.

 



Skills Required

  • Bachelor’s degree in Computer Science, Engineering, or equivalent
  • 5-8 years of experience in data engineering, preferably in AWS cloud environments
  • Proficiency in Python and SQL
  • Proficiency with AWS Glue, Redshift, S3, IAM, and Lake Formation
  • Experience managing IAM roles, security policies, and cloud-based data access controls
  • Hands-on experience with Airflow or AWS Step Functions
  • Exposure to CI/CD practices and infrastructure automation
  • Strong interpersonal and communication skills
  • Proficiency in Databricks, Unity Catalog, and Spark-based distributed data processing
  • Background in Pharma, Life Sciences, or regulated environments such as GxP or HIPAA
  • Experience with EMR, Snowflake, or hybrid-cloud data platforms
  • Experience with Power BI or QuickSight
  • Knowledge of Boomi, Kafka, or real-time streaming frameworks
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
45 Employees
Year Founded: 2014

What We Do

Aptus Data Labs is a global data engineering and AI consulting company helping enterprises modernize their data landscapes, accelerate AI adoption, and build scalable digital and product capabilities. Its expertise spans artificial intelligence, generative AI, data engineering, cloud solutions, and industry platforms, supporting organizations in pharmaceuticals, financial services, manufacturing, supply chain, retail, consumer packaged goods, and technology.

Similar Jobs

TALPRO INDIA PRIVATE LIMITED Logo TALPRO INDIA PRIVATE LIMITED

Senior Data Engineer

HR Tech • Information Technology • Professional Services
In-Office
Bengaluru, Bengaluru Urban, Karnataka, IND
76 Employees
2M-2M Annually

Facctum IT Solutions India Private Limited Logo Facctum IT Solutions India Private Limited

Data Engineer

Artificial Intelligence • Fintech • Software • Financial Services
In-Office
Bengaluru North, Yelahanka, Bengaluru Urban, Karnataka, IND
147 Employees

Genesys Logo Genesys

Senior Engineer

Artificial Intelligence • Big Data • Cloud • Machine Learning • Software
In-Office
2 Locations
6774 Employees

Synechron Logo Synechron

Senior Data Engineer

Fintech • Financial Services
In-Office or Remote
2 Locations
12827 Employees

Similar Companies Hiring

Legora Thumbnail
Artificial Intelligence • Legal Tech • Software
New York, New York
700 Employees
Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account