Lead Data Engineer (India)

Posted 7 Days Ago
Be an Early Applicant
Bengaluru, Bengaluru Urban, Karnataka, IND
In-Office
Senior level
Agency • Software • Consulting
Living at the intersection of creativity and technology.
The Role
Leads a pod of data engineers while designing and delivering scalable data platforms, pipelines, APIs, and reusable data products. Owns architecture, technical planning, code quality, testing, monitoring, data governance, and observability. Partners with machine learning, strategy, creative, and client teams to support predictive models and generative AI. Mentors engineers, supports hiring, evaluates cloud data services, and promotes AI-assisted development practices.
Summary Generated by Built In

The Lead Data Engineer will own the design, build, and delivery of core components of our data platform and lead a pod of engineers working on them. You will help shape how Code and Theory collects, models, and activates data, powering analytics, predictive models, and generative AI across the agency and its clients. You will work closely with the Technical Director, Data Engineering, the Machine Learning team, Strategy, and client-facing teams to turn business needs into reliable, well-modeled data products.

You will be a hands-on technical leader with authority over design decisions, code quality, and delivery within your area, and input into estimates and roadmap planning. You will anchor the architecture of the pipelines and services your pod owns, set day-to-day engineering standards, and mentor the engineers around you. You will collaborate with some of the best talent globally and contribute to the culture and craft of a world-class data organization.

Our engineers are AI native and advance the state of the art in the practice of software development with AI.

WHAT YOU’LL DO

  • Own the design, build, and delivery of core data platform components and the pod of engineers behind them
  • Translate roadmap priorities from the Technical Director into technical plans, estimates, and timelines
  • Design and build scalable data pipelines, covering how data is collected, modeled, and activated
  • Turn latent company and client data lakes into data-driven product backends, APIs, and reusable data products
  • Evaluate tools and cloud data services, and recommend fit-for-purpose approaches with clear trade-offs
  • Write and review production-grade Python and SQL, staying hands-on in design reviews and critical builds
  • Partner with the Machine Learning team to deliver reliable feature pipelines and data foundations for predictive models and generative AI
  • Use AI tools like Claude Code and Cursor in daily engineering, and build agents and AI-enabled workflows that improve quality, testing, and delivery speed
  • Coach the team on AI-assisted development and agentic engineering, and help establish best practices for AI-enhanced processes
  • Mentor engineers, support hiring and interviews, and help raise the engineering bar through standards, code review, and team culture
  • Implement testing, monitoring, data quality, and observability practices to keep pipelines trustworthy
  • Apply data governance, privacy, and security standards that fit client and regulatory constraints
  • Communicate effectively with technical and creative colleagues in an organization that is 50/50 Tech/Creative, and with client stakeholders when needed
  • Contribute to internal and external knowledge sharing in the form of blog posts, best practices, and methodologies

WHAT YOU’LL NEED

  • 8+ years in data engineering or adjacent disciplines
  • 3+ years leading engineers, a pod, or a workstream
  • Strong hands-on experience designing and delivering data pipelines and platforms in production
  • Ability to translate technical work into clear plans, estimates, and business outcomes
  • Experience making data lake or warehouse data available to applications and products
  • Working experience with at least one major cloud data platform (BigQuery, Snowflake, Databricks, Redshift, or similar) and sound judgment on when to use it
  • Strong technical fluency in Python and SQL
  • Experience with orchestration and batch or streaming tools (Airflow, Spark, Kafka, dbt, or similar)
  • Hands-on experience with AI-powered coding, agentic engineering, and AI-enabled workflows, ideally having helped teammates adopt them
  • Track record of mentoring engineers and enforcing standards and best practices through code review, documentation, and testing
  • Solid communication skills across the full range of technical levels, including creative partners

NICE TO HAVE

  • Experience with data governance, privacy compliance, and security practices
  • Working knowledge of marketing data ecosystems (GA4, advertising platforms, CRMs, CDPs)
  • Experience integrating AI/ML capabilities into data pipelines and shipping GenAI applications to production
  • Experience in an agency or consultancy environment, balancing client-facing delivery with internal platform investment
  • Experience with infrastructure as code, CI/CD, and FinOps basics

ABOUT US

Born in 2001, Code and Theory is a digital-first creative agency that sits at the center of creativity and technology. We pride ourselves on not only solving consumer and business problems, but also helping to establish new capabilities for our clients. With a global client roster of Fortune 100s and start-ups alike, we crave the hardest problems to solve. We have teams distributed across North America, South America, Europe, and Asia. The Code and Theory global network of agencies is growing and includes Kettle, Instrument, Left Field Labs, Create Group, Current, and TrueLogic.

Striving never to be pigeonholed, we work across every major category: from tech to CPG, financial services to travel & hospitality, government and education to media and publishing. We value the collaboration with our client partners, including but not limited to Adidas, Amazon, Con Edison, Diageo, EY, J.P. Morgan Chase, Lenovo, Marriott, Mars, Microsoft, Thomson Reuters, and TikTok.

The Code and Theory network is comprised of nearly 2,000 people with 50% engineers and 50% creative talent. We’re always on the lookout for smart, driven, and forward-thinking people to join our team.

Skills Required

  • 8+ years of experience in data engineering or adjacent disciplines
  • 3+ years leading engineers, a pod, or a workstream
  • Strong hands-on experience designing and delivering production data pipelines and platforms
  • Ability to translate technical work into plans, estimates, timelines, and business outcomes
  • Experience making data lake or warehouse data available to applications and products
  • Experience with at least one major cloud data platform such as BigQuery, Snowflake, Databricks, or Redshift
  • Strong technical fluency in Python and SQL
  • Experience with orchestration and batch or streaming tools such as Airflow, Spark, Kafka, or dbt
  • Hands-on experience with AI-powered coding, agentic engineering, and AI-enabled workflows
  • Track record of mentoring engineers and enforcing standards through code review, documentation, and testing
  • Solid communication skills across technical levels, including creative partners
  • Experience with data governance, privacy compliance, and security practices
  • Working knowledge of marketing data ecosystems, including GA4, advertising platforms, CRMs, or CDPs
  • Experience integrating AI or machine learning capabilities into data pipelines and shipping generative AI applications to production
  • Experience in an agency or consultancy environment
  • Experience with infrastructure as code, CI/CD, and FinOps basics

Code and Theory Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Code and Theory and has not been reviewed or approved by Code and Theory.

  • Leave & Time Off Breadth — Time-off policies include an “unlimited”/flexible PTO approach with paid holidays/sick time and seasonal early-close Fridays, offering notable flexibility. These options provide additional downtime beyond standard accrual models.
  • Healthcare Strength — Core medical, dental, and vision coverage is part of the standard package, with employer-verified health plan information cited as current. Life and disability insurance further reinforce foundational coverage.
  • Retirement Support — A 401(k) with employer match is included in the package, supporting long-term savings. Candidates are encouraged to confirm the match formula during the offer stage.

Code and Theory Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: New York, NY
445 Employees
Year Founded: 2001

What We Do

Code and Theory is a strategically driven, digital-first creative agency that lives at the intersection of creativity and technology. We solve consumer and business problems across the entire customer journey that flex to meet the ever-changing needs of consumer expectations. We put the user, their behaviors and needs, at the center of everything we do — from our proprietary research methodologies, to product development processes, to how we create brand, channel and messaging strategies. Our goal is simple: to solve our clients business problems. We bring big ideas to life by looking holistically at brand ecosystems where digital plays a prominent role in driving the consumer from first-touch through to conversion to relationship deepening over time. We identify gaps in the consumer journey and opportunities in culture that require products, services or communications to fill. We work across categories, ranging as far and wide as health care (Pfizer, Sanofi, Reach MD, Bioreference Laboratories) to financial services (JP Morgan Chase, Prudential, Morgan Stanley, First Data) to cpg (Mars, Unilever, Johnson & Johnson) to technology companies (Facebook, Xerox, Samsung, Comcast) to culture brands (adidas, H&M). And because our DNA is in publishing — we’ve embedded in over 135 newsrooms in the past decade — we bring unique expertise in understanding how content is created, distributed and optimized, including our work with CNN, NBC News, NBC Sports, and Bustle Digital Group. At Code and Theory, we strive to only be limited by our own ambition and creativity. We believe in pushing our creativity beyond the easy and obvious answers in order to deliver the solutions that are right for our clients, their businesses, and their consumers.

Gallery

Gallery

Similar Jobs

Atlassian Logo Atlassian

Senior Site Reliability Engineer

Cloud • Information Technology • Productivity • Security • Software • App development • Automation
In-Office or Remote
560071, Domlur, Karnataka, IND
11000 Employees

Atlassian Logo Atlassian

Principal Engineer

Cloud • Information Technology • Productivity • Security • Software • App development • Automation
In-Office or Remote
560071, Domlur, Karnataka, IND
11000 Employees

ServiceNow Logo ServiceNow

Principal Software Engineer

Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Hybrid
Bangalore, Bengaluru, Karnataka, IND
29000 Employees

The Aerospace Corporation Logo The Aerospace Corporation

Advanced Project Engr

Aerospace • Artificial Intelligence • Cloud • Machine Learning • Software • Cybersecurity • Defense
Hybrid
Bengaluru, Bengaluru Urban, Karnataka, IND
4600 Employees

Similar Companies Hiring

Revel Thumbnail
Aerospace • Hardware • Robotics • Software
Marina Del Rey, California
70 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
33 Employees
RapidScale Thumbnail
Cloud • Information Technology • Consulting
Raleigh, NC
600 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account