Data Engineer II

Sorry, this job was removed at 08:01 a.m. (CST) on Wednesday, Jun 04, 2025
Be an Early Applicant
Bengaluru, Bengaluru Urban, Karnataka
In-Office
Artificial Intelligence • eCommerce • Marketing Tech • Software • Analytics
We are building the operating system for brands to win in E-commerce.
The Role

Company Overview

CommerceIQ’s AI-powered digital commerce platform is revolutionizing the way brands sell online. Our unified ecommerce management solutions empower brands to make smarter, faster decisions through insights that optimize the digital shelf, increase retail media ROI and fuel incremental sales across the world’s largest marketplaces. With a global network of more than 900 retailers, our end-to-end platform helps 2,200+ of the world’s leading brands streamline marketing, supply chain, and sales operations to profitably grow market share in more than 50 countries. Learn more at commerceiq.ai.

@CommerceIQ, you will:
  • Design, implement, and maintain robust and scalable data pipelines that support machine learning applications and real-time decision-making systems.
  • Work closely with ML engineers, analysts, and product teams to understand data needs and translate them into efficient data engineering solutions.
  • Build and maintain workflows using tools like Apache Airflow, ensuring the reliability and timeliness of data availability across the platform.
  • Develop ETL/ELT pipelines using PySpark and Python, and optimize them for performance and cost at scale in a production environment.
  • Own and manage critical parts of the data infrastructure, ensuring high availability, consistency, and security of large-scale distributed data processing systems.
  • Proactively monitor, troubleshoot, and enhance data workflows to ensure quality, reliability, and performance SLAs are consistently met.
  • Collaborate in code reviews, technical design discussions, and mentoring junior data engineers within the team.
Experience:

4–6 years of hands-on experience designing, building, and deploying large-scale data processing pipelines in production environments.

Skillset:
  • Proficiency in Python is a must, with strong software engineering fundamentals and experience writing clean, maintainable code.
  • Extensive hands-on experience with PySpark and distributed data processing frameworks.
  • Production experience with Apache Airflow or similar workflow orchestration tools.
  • Solid understanding of data modeling, performance tuning, and optimization for large datasets.
  • Proven experience working with cloud-based data infrastructure (e.g., AWS, GCP, or Azure) is a strong plus.
  • Experience supporting ML pipelines or working in ML-driven environments is an advantage.
  • Strong sense of ownership, attention to detail, and a passion for building high-quality data solutions that deliver business value.

We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, disability status or any other category prohibited by applicable law. 

Similar Jobs

Hybrid
Bengaluru, Bengaluru Urban, Karnataka, IND
289097 Employees

JPMorganChase Logo JPMorganChase

Data Engineer

Financial Services
Hybrid
Bengaluru, Bengaluru Urban, Karnataka, IND
289097 Employees

Accenture Logo Accenture

Data Engineer

Information Technology
In-Office
2 Locations
456553 Employees

Intellectsoft Logo Intellectsoft

Senior Data Engineer

Consulting • PropTech
In-Office
2 Locations
199 Employees
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Bengaluru, Karnataka
360 Employees
Year Founded: 2017

What We Do

CommerceIQ is the leader in E-commerce Channel Optimization (ECO), the practice of using machine learning, analytics and automations to optimize the e-commerce channel across supply chain, marketing and sales operations to win at the moment of purchase and drive profitable market share growth.

Why Work With Us

CommerceIQ is building innovative products in a hot market, in a pre-IPO company with a bold vision, and with passionate colleagues who are collectively building a company for the long run. We have developed a culture to support our growth and deliver a unique employee experience with market competitive pay and exceptional benefits.

Gallery

Gallery

Similar Companies Hiring

Milestone Systems Thumbnail
Software • Security • Other • Big Data Analytics • Artificial Intelligence • Analytics
Lake Oswego, OR
1500 Employees
Idler Thumbnail
Artificial Intelligence
San Francisco, California
6 Employees
Fairly Even Thumbnail
Software • Sales • Robotics • Other • Hospitality • Hardware
New York, NY

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account