Senior Engineering Manager - Data Engineering

Posted 11 Hours Ago
Be an Early Applicant
Bengaluru, Karnataka, IND
In-Office
Senior level
Digital Media • Information Technology • Analytics
The Role
Lead and mentor data engineering teams to design, build, and scale high-volume data pipelines and measurement solutions. Own roadmap, prioritize resources, ensure data validation and platform integrity, optimize ETL monitoring and performance, and resolve critical technical blockers across international markets.
Summary Generated by Built In
Company Description

At Nielsen, we are passionate about our work to power a better media future for all people by providing powerful insights that drive client decisions and deliver extraordinary results. Our talented, global workforce is dedicated to capturing audience engagement with content - wherever and whenever it’s consumed. Together, we are proudly rooted in our deep legacy as we stand at the forefront of the media revolution. When you join Nielsen, you will join a dynamic team committed to excellence, perseverance, and the ambition to make an impact together. We champion you, because when you succeed, we do too. We enable your best to power our future.

Job Description

Nielsen is seeking a technical and strategic Senior Engineering Manager to lead our Data Engineering teams within the Digital & AI organization. This role is critical for driving the development of high-scale data pipelines and measurement solutions, including our Streaming+ Infrastructure and the Panelist Intelligence Engine (PIE).

The ideal candidate will oversee the end-to-end data lifecycle—from ingestion and processing to validation and reporting—ensuring the highest standards of data accuracy and platform integrity for our global digital measurement products.

Key Responsibilities

Leadership & Strategy

  • Lead and mentor high-performing engineering teams, fostering a culture of technical excellence, automation, and continuous improvement.

  • Own the Tech Roadmap and long-term planning for data engineering workstreams, ensuring alignment with product goals and business efficiency initiatives.

  • Partner closely with Product Management (Head of Streaming+ Infrastructure) and Data Science to define system requirements for automated panel data processing and eligibility.

  • Manage resource bandwidth and prioritize quarterly planning integrity over ad-hoc requests to ensure project delivery.

Technical Execution

  • Oversee the architecture and scaling of data pipelines using technologies like Spring Boot, ClickHouse, OpenSearch, and Logstash.

  • Drive the transition toward automated, longitudinal data processing to replace deterministic manual processes.

  • Ensure robust data validation across complex event streams, batch jobs, and downstream reporting dashboards.

  • Implement rigorous performance standards and "tech excellence" line items, such as Cloud Cost Optimization and SEV-1 Reduction targets.

  • Resolve critical technical blockers related to data schemas, device-process date misalignment, and international market integrations.

  • Implement and oversee ETL job monitoring and performance optimization for critical data pipelines.

Qualifications

Technical Proficiency

  • Backend & Frameworks: Deep expertise in Java and Spring Boot.

  • 12+years of relevant experience.

  • Data Systems: Hands-on experience with Big Data technologies (ClickHouse, ElasticSearch/OpenSearch, Spark, MDL) and ETL tools (Logstash).

  • Cloud Ecosystems: Advanced knowledge of AWS services, including Lambda, S3, and EC2, along with Grafana for monitoring and observability.

  • Data Validation: Strong SQL skills and experience validating large-volume, high-variability datasets and event pipelines.

  • Data Pipeline Management: Strong experience with ETL job monitoring, optimization, and building/scaling high-volume data pipelines.

Leadership Capabilities

  • Proven experience managing engineering teams in an Agile environment with a focus on roadmap visibility and stakeholder communication.

  • Ability to conduct rigorous performance calibration and talent assessment to maintain a high-quality engineering bar.

  • Strong experience in cross-functional collaboration across Product, Data Science, and Operations teams.

Additional Information

Nice-to-Have Skills

  • Experience in digital measurement, panel management, or attribution ecosystems.

  • Knowledge of Connected TV (CTV) platforms and streaming data collection.

  • Familiarity with privacy-compliant, software-first measurement solutions.

  • Handson of Databricks.

Please be aware that job-seekers may be at risk of targeting by scammers seeking personal data or money. Nielsen recruiters will only contact you through official job boards, LinkedIn, or email with a nielsen.com domain. Be cautious of any outreach claiming to be from Nielsen via other messaging platforms or personal email addresses. Always verify that email communications come from an @nielsen.com address. If you're unsure about the authenticity of a job offer or communication, please contact Nielsen directly through our official website or verified social media channels.

Skills Required

  • Deep expertise in Java and Spring Boot
  • 12+ years of relevant experience
  • Hands-on experience with ClickHouse, ElasticSearch/OpenSearch, Spark, and MDL
  • Experience with ETL tools and pipelines, including Logstash and ETL job monitoring/optimization
  • Advanced knowledge of AWS services (Lambda, S3, EC2) and cloud observability with Grafana
  • Strong SQL skills and experience validating large-volume, high-variability datasets and event pipelines
  • Proven experience managing engineering teams in an Agile environment, including roadmap planning and stakeholder communication
  • Experience conducting performance calibration, talent assessment, and maintaining high engineering quality
  • Cross-functional collaboration experience with Product, Data Science, and Operations teams
  • Experience in digital measurement, panel management, attribution ecosystems
  • Knowledge of Connected TV (CTV) platforms and streaming data collection
  • Familiarity with privacy-compliant, software-first measurement approaches
  • Hands-on experience with Databricks

Nielsen Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Nielsen and has not been reviewed or approved by Nielsen.

  • Leave & Time Off Breadth Time off is described as generous, including flexible or unlimited PTO in some roles, paid holidays, sick days, volunteer time, and flex days. Personal days accrue monthly and can be used at employees’ discretion.
  • Parental & Family Support Support includes paid parental leave, family medical leave, adoption assistance, and adoption subsidies. These programs are positioned as part of a comprehensive package for families.
  • Strong & Reliable Incentives Select roles benefit from commissions, car pay, longevity bonuses, and performance-based bonuses. In some cases, overall compensation is characterized as outstanding or very satisfying.

Nielsen Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: New York, NY
30,034 Employees

What We Do

Nielsen shapes the world’s media and content as a global leader in audience insights, data and analytics. Through our understanding of people and their behaviors across all channels and platforms, we empower our clients with independent and actionable intelligence so they can connect and engage with their audiences—now and into the future. An S&P 500 company, Nielsen (NYSE: NLSN) operates around the world in more than 55 countries.

Similar Jobs

Atlassian Logo Atlassian

Data Engineering Manager

Cloud • Information Technology • Productivity • Security • Software • App development • Automation
In-Office or Remote
Bengaluru, Bengaluru Urban, Karnataka, IND
11000 Employees

Atlassian Logo Atlassian

Data Engineering Manager

Cloud • Information Technology • Productivity • Security • Software • App development • Automation
In-Office or Remote
Bengaluru, Bengaluru Urban, Karnataka, IND
11000 Employees

Guidewire Software Logo Guidewire Software

Senior Engineering Manager

Cloud • Information Technology • Insurance • Software • Analytics
In-Office
Bangalore, Bengaluru Urban, Karnataka, IND
3400 Employees

Fortive Logo Fortive

Senior Manager, AI & Data Engineering

Hardware • Other • Software • Appliances • Industrial • Manufacturing
Hybrid
2 Locations
13486 Employees

Similar Companies Hiring

Scotch Thumbnail
Artificial Intelligence • eCommerce • Fintech • Payments • Retail • Software • Analytics
US
35 Employees
Milestone Systems Thumbnail
Artificial Intelligence • Security • Software • Analytics • Big Data Analytics
Lake Oswego, OR
1500 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account