Lead AI Data Engineer

Sorry, this job was removed at 12:16 p.m. (CST) on Thursday, Mar 12, 2026
Be an Early Applicant
Hiring Remotely in Office, Machaze, Manica, MOZ
Remote or Hybrid
Information Technology • Software
The Role
Lead AI Data Engineer

Location: Bengaluru, Karnataka, India

About the Role:
We’re looking for an experienced AI Data Engineer (4-8 years) to join our data team. In this role, you’ll build and maintain our data infrastructure on AWS, enabling analytics and AI teams to extract actionable insights. You’ll design and manage end-to-end data pipelines, ensuring high-quality, reliable, and real-time data, while also contributing to ML/GenAI workflows and model deployment pipelines.

What You'll Do:

  • Design and build scalable data pipelines/transformations using Spark / PySpark / Scala.

  • Manage and optimize Airflow DAGs for complex data workflows.

  • Clean, transform, and prepare data for analytics, AI, and ML use cases.

  • Use Python for automation, data processing, and internal tooling.

  • Work with AWS services (S3, Redshift, EMR, Glue, Athena) to maintain robust data infrastructure.

  • Collaborate with Analytics and AI teams to design pipelines for ML/GenAI projects.

  • Contribute to Node.js (TypeScript) backend development for data services.

  • Automate deployments using CI/CD pipelines (GitHub Actions).

  • Monitor, troubleshoot, and ensure data quality, consistency, and reliability across systems.

  • Build and maintain data warehouses/lakes and handle real-time streaming data using Kafka or similar technologies.

What You'll Need:

  • Bachelor’s or Master’s in Computer Science, Engineering, or related field.

  • 4-8 years of hands-on experience in data engineering.

  • Strong expertise in Spark / Scala for large-scale data processing.

  • Proficient in Airflow for managing and optimizing complex DAGs.

  • Advanced Python skills for data manipulation, automation, and tool development.

  • Proven experience with AWS related cloud services (S3, Redshift, EMR, Glue, Athena, IAM, EC2).

  • Solid understanding of ETL/ELT, data preparation, and analytics workflows.

  • Familiar with Node.js and TypeScript for backend data services.

  • Experience with automated CI/CD (GitHub Actions).

  • Familiarity with CDC Tools like Debezium.

  • Strong SQL, knowledge of data warehousing and streaming (Kafka, Flink, Kinesis), and excellent communication skills.

Bonus Points:

  • Experience with data lake technologies (Delta Lake, Apache Iceberg).

  • Knowledge of ML/GenAI model deployment pipelines.

  • Familiarity with data governance, quality frameworks, and statistics.

  • Experience with infrastructure as code (Terraform).

  • Familiarity with containers (Docker, Kubernetes).

  • Experience with monitoring and logging tools (Prometheus, Grafana).

Similar Jobs

Suite Studios Logo Suite Studios

Senior Software Engineer

Cloud • Digital Media • Professional Services • Database
Remote
Office, Machaze, Manica, MOZ
20 Employees
150K-175K Annually

Suite Studios Logo Suite Studios

Intern - General Application

Cloud • Digital Media • Professional Services • Database
Remote or Hybrid
Office, Machaze, Manica, MOZ
20 Employees

Mondelēz International Logo Mondelēz International

Consumer Data Platforms Product Lead

Big Data • Food • Hardware • Machine Learning • Retail • Automation • Manufacturing
Remote or Hybrid
3 Locations
90000 Employees

Mondelēz International Logo Mondelēz International

IAM (CyberArk) Engineer

Big Data • Food • Hardware • Machine Learning • Retail • Automation • Manufacturing
Remote or Hybrid
2 Locations
90000 Employees
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Tokyo, Tokyo
178 Employees

What We Do

Josys is the SaaS Management Platform that simplifies how IT works. Our holistic approach equips IT with 360° control over their software and hardware portfolio by making it easier to visualize assets, analyze utilization trends, and automate provisioning processes that will make IT operations run more efficiently. By leveraging APIs and integrating with hundreds of applications, Josys empowers IT with a single portal for assigning licenses and devices to employees, monitoring user access, and tracking adoption. IT teams can save time by eliminating dependencies on multiple spreadsheets and disparate tools, easily optimize IT costs, and securely govern access to company data with Josys.

Similar Companies Hiring

Fairly Even Thumbnail
Hardware • Other • Robotics • Sales • Software • Hospitality
New York, NY
30 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account