Lead Software Engineer – Big Data

Posted 6 Days Ago
Easy Apply
Be an Early Applicant
Bangalore, Bengaluru, Karnataka
Hybrid
7+ Years Experience
AdTech • Artificial Intelligence • Marketing Tech • Software • Analytics
We deliver better experiences for consumers and better results for your brand.
The Role
Lead Software Engineer responsible for designing and growing data infrastructure for Zeta Identity Graph platform. Responsibilities include building and maintaining data infrastructure, optimizing data models, ETL processes, and working with various teams. Desired skills include expertise in distributed data processing, Python/Scala/Java, relational databases, Spark, HDFS, Hive, agile development, and AWS.
Summary Generated by Built In

Lead Software Engineer – Big Data


We are looking for lead or principal software engineers to join our Data Cloud team. Our Data Cloud team is 
responsible for the Zeta Identity Graph platform, which captures billions of behavioural, demographic, 
environmental, and transactional signals, for people-based marketing. As part of this team, the data engineer will be 
designing and growing our existing data infrastructure to democratize data access, enable complex data analyses,
and automate optimization workflows for business and marketing operations. 

Job Description:
Essential Responsibilities: 
As a Lead or Principal Data Engineer, your responsibilities will include: 
• Building, refining, tuning, and maintaining our real-time and batch data infrastructure 
• Daily use technologies such as HDFS, Spark, Snowflake, Hive, HBase, Scylla, Django, FastAPI, etc.
• Maintaining data quality and accuracy across production data systems 
• Working with Data Engineers to optimize data models and workflows 
• Working with Data Analysts to develop ETL processes for analysis and reporting 
• Working with Product Managers to design and build data products 
• Working with our DevOps team to scale and optimize our data infrastructure 
• Participate in architecture discussions, influence the road map, take ownership and responsibility over new 
projects 
• Participating in 24/7 on-call rotation (be available by phone or email in case something goes wrong) 
Desired Characteristics:
• Minimum 7 years of software engineering experience.
• Proven long term experience and enthusiasm for distributed data processing at scale, eagerness to learn 
new things. 
• Expertise in designing and architecting distributed low latency and scalable solutions in either cloud and onpremises environment.
• Exposure to the whole software development lifecycle from inception to production and monitoring 
• Fluency in Python or solid experience in Scala, Java 
• Proficient with relational databases and Advanced SQL 
• Expert in usage of services like Spark, HDFS, Hive, HBase 
• Experience in adequate usage of any scheduler such as Apache Airflow, Apache Luigi, Chronos etc.
• Experience in adequate usage of cloud services (AWS) at scale 
• Experience in agile software development processes 
• Excellent interpersonal and communication skills 

Nice to have: 
• Experience with large scale / multi-tenant distributed systems 
• Experience with columnar / NoSQL databases – Vertica, Snowflake, HBase, Scylla, Couchbase 
• Experience in real team streaming frameworks – Flink, Storm 
• Experience with web frameworks such as Flask, Django 

Company Summary

Zeta Global is a data-powered marketing technology company with a heritage of innovation and industry leadership. 
Founded in 2007 by entrepreneur David A. Steinberg and John Sculley, former CEO of Apple Inc and Pepsi-Cola, the 
Company combines the industry's 3rd largest proprietary data set (2.4B+ identities) with Artificial Intelligence to 
unlock consumer intent, personalize experiences and help our clients drive business growth.
Our technology runs on the Zeta Marketing Platform, which powers 'end to end' marketing programs for some of the 
world's leading brands. With expertise encompassing all digital marketing channels – Email, Display, Social, Search 
and Mobile – Zeta orchestrates acquisition and engagement programs that deliver results that are scalable, 
repeatable and sustainable.

Zeta Global is an Equal Opportunity/Affirmative Action employer and does not discriminate on the basis of race, 
gender, ancestry, color, religion, sex, age, marital status, sexual orientation, gender identity, national origin, medical 
condition, disability, veterans status, or any other basis protected by law.
Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with 
arrest and conviction records.

Zeta Global Recognized in Enterprise Marketing Software and Cross-Channel Campaign Management Reports by 
Independent Research Firm

https://www.prnewswire.com/news-releases/zeta-global-opens-ai--data-labs-in-san-francisco-and-nyc300945353.html

https://www.prnewswire.com/news-releases/zeta-global-recognized-in-enterprise-marketing-software-and-crosschannel-campaign-management-reports-by-independent-research-firm-300938241.htm


Top Skills

Java
Python
Scala
The Company
HQ: New York, NY
1,805 Employees
Hybrid Workplace
Year Founded: 2007

What We Do

 Zeta Global (NYSE: ZETA) is the Data-Powered Marketing Cloud that leverages advanced artificial intelligence (AI) and trillions of consumer signals to make it easier for marketers to acquire, grow, and retain customers more efficiently.

Through the Zeta Marketing Platform (ZMP), our vision is to make sophisticated marketing simple by unifying identity, intelligence, and omnichannel activation into a single platform – powered by one of the industry’s largest proprietary databases and AI.

Our enterprise customers across multiple verticals are empowered to personalize experiences with consumers at an individual level across every channel, delivering better results for marketing programs. Zeta was founded in 2007 by David A. Steinberg and John Sculley and is headquartered in New York City with offices around the world. To learn more, go to www.zetaglobal.com.

Why Work With Us

Zeta is deeply committed to enriching our people’s wellbeing and growth throughout their career journeys. Our autonomous environment gives our teammates the freedom and space to grow, be creative, and come up with innovative solutions to reinvent consumer experiences and impact brand growth.

Gallery

Gallery
Gallery
Gallery
Gallery
Gallery
Gallery
Gallery
Gallery

Zeta Global Offices

Hybrid Workspace

Employees engage in a combination of remote and on-site work.

Typical time on-site: Flexible
HQNew York, NY
Bengaluru, Karnataka
Brussels, BE
Hyderabad, Telangana
London, GB
Marina del Rey, CA
Nashville, TN
Paris, FR
Prague, CZ
San Francisco, CA
San Mateo, CA
Washington, DC
Learn more

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account