Data Engineer

Posted 2 Days Ago
Be an Early Applicant
Bangalore, Bengaluru Urban, Karnataka, IND
In-Office
Senior level
Information Technology • Consulting
The Role
Develop and operate enterprise-scale data engineering platforms, batch processing systems, backend services, and production data pipelines. Build AWS-native solutions using Spark, Python or Scala, SQL, Hive, and Airflow. Design workflow orchestration, APIs, microservices, and cloud infrastructure while supporting testing, CI/CD, monitoring, troubleshooting, performance tuning, and data governance. Collaborate with cross-functional Agile teams and improve automation, reliability, and operational readiness.
Summary Generated by Built In

Develop API-driven systems to govern, manage, and monitor large-scale batch Big Data applications. 

Build scalable backend services and data engineering solutions that support data processing and operational workflows. 

Develop and maintain data transformation processes using Spark, SQL, Hive, Python, Scala, and related technologies. 

Work with AWS cloud services such as S3, EC2, EMR, Lambda, DynamoDB, and API Gateway to build cloud-native data and backend solutions. 

Build and enhance workflow orchestration using Apache Airflow, including advanced DAG design, dependency management, scheduling, monitoring, and failure handling. 

Define technical scope, objectives, and implementation approaches by participating in requirements gathering, technical research, and process definition. 

Participate in architecture reviews, code reviews, performance tuning, and operational readiness activities. 

Contribute to test planning and validation for application integrations, functional areas, and project deliverables. 

Partner with product owners, data engineers, backend engineers, QA, DevOps, and other cross-functional teams to deliver high-quality solutions in an Agile/Scrum environment. 

Troubleshoot production issues, improve system reliability, and drive automation across data and backend workflows. 

Responsibilities

5+ years of hands-on experience developing enterprise-scale applications, data platforms, or distributed systems. 

5+ years of experience developing, and operating Big Data platforms and cloud-based infrastructure services, preferably using AWS EMR and the Hadoop ecosystem.

Hands-on experience with AWS, Spark, Python and/or Scala, Airflow, SQL, Hive, and related data processing technologies. 

Proficiency in either Python or Scala, with the ability to build production-grade data pipelines and backend services. 

Experience with AWS cloud services, including S3, EC2, EMR, Lambda, DynamoDB, and API Gateway.

Strong experience with Apache Airflow orchestration, including complex workflows, scheduling, dependency handling, monitoring, and operational support. 

Strong understanding of data engineering concepts, including data pipelines, data transformation, batch processing, real-time processing, data quality, and performance optimization. 

Excellent analytical and problem-solving skills. 

Strong communication and presentation skills, with the ability to explain technical concepts clearly to both technical and non-technical audiences. 

Experience with version control and CI/CD tools, including Git and Jenkins, for source code management, build automation, testing, and deployment workflows.

Ability to work effectively in cross-functional Agile/Scrum teams. 

Qualifications

Experience with LLMs, Generative AI, Agentic AI, or AI-assisted engineering workflows. 

Experience with API design, microservices, event-driven architecture, or serverless backend development. 

Experience with CI/CD pipelines, infrastructure as code, automated testing, and production deployment practices. 

Experience with data governance, metadata management, lineage, data observability, or operational controls for enterprise data platforms

About Us

ABOUT US:

Bristlecone is the leading provider of AI-powered application transformation services for the connected supply chain. We empower our customers with speed, visibility, automation, and resiliency – to thrive on change.

Our transformative solutions in Digital Logistics, Cognitive Manufacturing, Autonomous Planning, Smart Procurement and Digitalization are positioned around key industry pillars and delivered through a comprehensive portfolio of services spanning digital strategy, design and build, and implementation across a range of technology platforms.

Bristlecone is ranked among the top ten leaders in supply chain services by Gartner. We are headquartered in San Jose, California, with locations across North America, Europe and Asia, and over 2,500 consultants. Bristlecone is part of the $19.4 billion Mahindra Group.


EQUAL OPPORTUNITY EMPLOYER:

Bristlecone is an equal opportunity employer. All applicants will be considered for employment without attention to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status.


INFORMATION SECURITY RESPONSIBILITIES:

  • Understand and adhere to Information Security policies, guidelines and procedure, practice them for protection of organizational data and Information System.
  • Take part in information security training and act while handling information.
  • Report all suspected security and policy breach to InfoSec team or appropriate authority (CISO).
  • Understand and adhere to the additional information security responsibilities as part of the assigned job role.

Skills Required

  • 5+ years of hands-on experience developing enterprise-scale applications, data platforms, or distributed systems
  • 5+ years of experience developing and operating Big Data platforms and cloud-based infrastructure services
  • Hands-on experience with AWS, Spark, Python and/or Scala, Airflow, SQL, Hive, and related data processing technologies
  • Proficiency in Python or Scala for production-grade data pipelines and backend services
  • Experience with AWS S3, EC2, EMR, Lambda, DynamoDB, and API Gateway
  • Strong experience with Apache Airflow orchestration, complex workflows, scheduling, dependency handling, monitoring, and operational support
  • Strong understanding of data pipelines, data transformation, batch processing, real-time processing, data quality, and performance optimization
  • Excellent analytical and problem-solving skills
  • Strong communication and presentation skills
  • Experience with Git and Jenkins for source control, build automation, testing, and deployment
  • Ability to work effectively in cross-functional Agile/Scrum teams
  • Experience with LLMs, Generative AI, Agentic AI, or AI-assisted engineering workflows
  • Experience with API design, microservices, event-driven architecture, or serverless backend development
  • Experience with CI/CD pipelines, infrastructure as code, automated testing, and production deployment
  • Experience with data governance, metadata management, lineage, data observability, or operational controls

Bristlecone Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Bristlecone and has not been reviewed or approved by Bristlecone.

  • Healthcare Strength — Health coverage is described as having improved recently, with core medical, dental, and vision coverage in place for U.S. employees. Health insurance is also characterized positively in several places.
  • Leave & Time Off Breadth — PTO, paid holidays, and WFH flexibility are outlined for U.S. employees, with PTO specifically called out positively. Employer-verified details indicate unlimited PTO for some exempt roles.
  • Wellbeing & Lifestyle Benefits — An employee assistance program (unMute) provides confidential counseling alongside wellness apps and webinars. Additional wellbeing initiatives and company celebrations reinforce lifestyle support.

Bristlecone Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
London
3,058 Employees
Year Founded: 1998

What We Do

Bristlecone is the industry’s largest pure-play supply chain service provider. As the trusted partner for AI-first supply chain transformations, we specialize in empowering customers with tech-enabled solutions for planning, sourcing, and fulfillment. Through our consulting, platforms, and supply chain build and enablement expertise, we help Global 2000 organizations in the life sciences, retail, consumer goods, manufacturing, and high-tech industries drive visibility, resiliency, and efficiency across their supply chain. Guided by a consulting-led approach, we serve as strategic partners to customers throughout their supply chain transformation journey. With comprehensive advisory and implementation capabilities, we offer high-value consulting spanning domains, processes, and change management, ensuring tailored solutions that drive meaningful outcomes for each customer. Bristlecone is headquartered in San Jose, California, with locations across North America, Europe, and Asia. It is part of the Mahindra Group. Learn more at www.bristlecone.com

Similar Jobs

Optum Logo Optum

Data Engineer

Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
In-Office
Bengaluru, Bengaluru Urban, Karnataka, IND
160000 Employees
Hybrid
Bengaluru, Bengaluru Urban, Karnataka, IND
289097 Employees

Hewlett Packard Enterprise Logo Hewlett Packard Enterprise

AI Data Foundation Research Engineer

Artificial Intelligence • Cloud • Information Technology • Consulting
In-Office
Bengaluru, Bengaluru Urban, Karnataka, IND
85422 Employees

Zscaler Logo Zscaler

Integration Engineer

Cloud • Information Technology • Security • Software • Cybersecurity
Easy Apply
Hybrid
Bangalore, Bengaluru, Karnataka, IND
8697 Employees

Similar Companies Hiring

NODA AI Thumbnail
Artificial Intelligence • Information Technology • Software • Cybersecurity • Defense • Defense Technology
Austin, TX
54 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
567 Employees
RapidScale Thumbnail
Cloud • Information Technology • Consulting
Raleigh, NC
600 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account