Lead - Data Engineer

Sorry, this job was removed at 12:16 p.m. (CST) on Wednesday, Jun 04, 2025
Be an Early Applicant
Bangalore, Bengaluru Urban, Karnataka
Hybrid
Digital Media • Information Technology • Analytics
The Role
Gracenote, a Nielsen company, is dedicated to connecting audiences to the entertainment they love, powering a better media future for all people. Gracenote is the content data business unit of Nielsen that powers innovative entertainment experiences for the world’s leading media companies. Our entertainment metadata and connected IDs deliver advanced content navigation and discovery to connect consumers to the content they love and discover new ones.
Gracenote’s industry-leading datasets cover TV programs, movies, sports, music and podcasts in 80 countries and 35 languages. Common identifiers Universally adopted by the world’s leading media companies to deliver powerful cross-media entertainment experiences. Machine driven, human validated best-in-class data and images fuel new search and discovery experiences across every screen.
Gracenote's Data Organization is a dynamic and innovative group that is essential in delivering business outcomes through data, insights, predictive & prescriptive analytics. An extremely motivated team that values creativity, experimentation through continuous learning in an agile and collaborative manner. From designing, developing and maintaining data architecture that satisfies our business goals to managing data governance and region-specific regulations, the data team oversees the whole data lifecycle.

Role Overview

  • We are seeking an experienced Senior Data Engineer with 10-12 years of experience to join our Video engineering team with Gracenote - a NielsenIQ Company. In this role, you will design, build, and maintain our data processing systems and pipelines. You will work closely with Product managers, Architects, analysts, and other stakeholders to ensure data is accessible, reliable, and optimized for Business, analytical and operational needs.

Key Responsibilities

  • Design, develop, and maintain scalable data pipelines and ETL processes
  • Architect and implement data warehousing solutions and data lakes
  • Optimize data flow and collection for cross-functional teams
  • Build infrastructure required for optimal extraction, transformation, and loading of data
  • Ensure data quality, reliability, and integrity across all data systems
  • Collaborate with data scientists and analysts to help implement models and algorithms
  • Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, etc.
  • Create and maintain comprehensive technical documentation
  • Mentor junior engineers and provide technical leadership
  • Evaluate and integrate new data management technologies and tools
  • Implement Optimization strategies to enable and maintain sub second latency.
  • Oversee Data infrastructure to ensure robust deployment and monitoring of the pipelines and processes.
  • Stay ahead of emerging trends in Data, cloud, integrating new research into practical applications.
  • Mentor and grow a team of junior data engineers.

Required Qualifications and Skills

  • Expert-level proficiency in Python, SQL, and big data tools (Spark, Kafka, Airflow).Bachelor's degree in Computer Science, Engineering, or related field; Master's degree preferred
  • Expert knowledge of SQL and experience with relational databases (e.g., PostgreSQL, Redshift, TIDB, MySQL, Oracle, Teradata)
  • Extensive experience with big data technologies (e.g., Hadoop, Spark, Hive, Flink)Proficiency in at least one programming language such as Python, Java, or Scala
  • Experience with data modeling, data warehousing, and building ETL pipelines
  • Strong knowledge of data pipeline and workflow management tools (e.g., Airflow, Luigi, NiFi)Experience with cloud platforms (AWS, Azure, or GCP) and their data services.
  • AWS Preferred Hands on Experience with building streaming pipelines with flink, Kafka, Kinesis. Flink Preferred.  Understanding of data governance and data security principles
  • Experience with version control systems (e.g., Git) and CI/CD practices
  • Proven leadership skills in grooming data engineering teams.

Preferred Skills

  • Experience with containerization and orchestration tools (Docker, Kubernetes)Basic knowledge of machine learning workflows and MLOps
  • Experience with NoSQL databases (MongoDB, Cassandra, etc.)
  • Familiarity with data visualization tools (Tableau, Power BI, etc.)Experience with real-time data processing
  • Knowledge of data governance frameworks and compliance requirements (GDPR, CCPA, etc.)
  • Experience with infrastructure-as-code tools (Terraform, CloudFormation)

Similar Jobs

CrowdStrike Logo CrowdStrike

Senior Software Engineer

Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Remote or Hybrid
KA, IND
10000 Employees

Allica Bank Logo Allica Bank

Technical Incident Lead

Fintech • Software • Financial Services
In-Office or Remote
2 Locations
502 Employees

Elsevier Logo Elsevier

Account Manager

Artificial Intelligence • Healthtech • Information Technology • Other • Analytics
In-Office or Remote
3 Locations

Allica Bank Logo Allica Bank

Full-stack Engineer

Fintech • Software • Financial Services
In-Office or Remote
2 Locations
502 Employees
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: New York, NY
30,034 Employees

What We Do

Nielsen shapes the world’s media and content as a global leader in audience insights, data and analytics. Through our understanding of people and their behaviors across all channels and platforms, we empower our clients with independent and actionable intelligence so they can connect and engage with their audiences—now and into the future.

An S&P 500 company, Nielsen (NYSE: NLSN) operates around the world in more than 55 countries.

Similar Companies Hiring

Standard Template Labs Thumbnail
Software • Information Technology • Artificial Intelligence
New York, NY
15 Employees
Scotch Thumbnail
Software • Retail • Payments • Fintech • eCommerce • Artificial Intelligence • Analytics
US
25 Employees
Milestone Systems Thumbnail
Software • Security • Other • Big Data Analytics • Artificial Intelligence • Analytics
Lake Oswego, OR
1500 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account