Data Engineering Team Lead

Posted 16 Days Ago
Be an Early Applicant
Tel Aviv
Mid level
Security • Software • Cybersecurity • Data Privacy
The Role
As a Data Engineering Team Lead at BigID, you will lead a team to design and implement big data architecture, develop data processing pipelines using Kafka, optimize Elastic technologies, and collaborate across teams to meet business objectives.
Summary Generated by Built In

Who we are:

BigID is an innovative tech startup that focuses on solutions for data security, compliance, privacy, and AI data management. We're leading the market in all things data: helping our customers reduce risk, drive business innovation, achieve compliance, build customer trust, make better decisions, and get more value from their data.

We are building a global team passionate about innovation and next-gen technology. BigID has been recognized for: 

  • BigID Named Hot Company in Artificial Intelligence and Machine Learning at the 2024 Global InfoSec Awards
  • Citizens JMP Cyber 66 List of Hottest Privately Held Cybersecurity Companies
  • CRN 100 list named BIgID as one of the 20 Coolest Identity Access Management And Data Protection Companies Of 2024 (2 years running)
  • DUNS 100 Best Tech Companies to Work For in 2024
  • Top 3 Big Data and AI Vendors to Watch' in the 2023 BigDATAwire Readers and Editors Choice Awards
  • 2024 Inc. 5000 list for the 4th consecutive year!
  • Shortlisted for the 2024 AI Awards in the category of Best Use of AI in Cybersecurity

At BigID, our team is the foundation of our success. Join a people-centric culture that is fast-paced and rewarding: you’ll have the opportunity to work with some of the most talented people in the industry who value innovation, diversity, integrity, and collaboration.

Who we seek:

We’re looking for a Data Engineering Team Lead to join our data platform team and report to the Director of Engineering. As a Software Team Lead, you’ll lead a team of back-end and full-stack engineers, working closely with the Product Manager to plan, kickoff, and execute new product and feature development projects. Our ideal candidate is someone who values excellence, is hungry for success, and thrives when working with the best.

As the Data Platform Manager, you'll be responsible for overseeing the design, development, and implementation of our big data architecture. You'll lead a team of data engineers and collaborate with cross-functional teams to drive data initiatives that support business objectives. Your expertise in Elastic, Kafka, and Java will be critical in ensuring the scalability and performance of our data systems.

What you’ll do:

  • Lead and mentor a team of data engineers in the design and development of big data solutions.
  • Architect and implement data processing pipelines using Kafka for real-time data streaming.
  • Optimize and manage search capabilities using Elastic technologies.
  • Collaborate with product managers, data analysts, and other stakeholders to gather requirements and translate them into technical specifications.
  • Oversee code reviews, ensure best practices in coding and data handling, and maintain high-quality standards in software development.
  • Stay up-to-date with emerging trends and technologies in big data and recommend improvements to our architecture and processes.
  • Troubleshoot and resolve issues in a timely manner to minimize downtime and ensure system reliability.
  • Contribute to strategic planning and decision-making regarding data architecture and tools.
  • Collect and analyze your team’s KPIs.
  • Participate in customer calls, understand their use cases, and solve their problems.
  • Collaborate with software teams from Israel, Portugal, Ukraine, Poland, and India.

What you’ll bring:

  • Bachelor’s degree in Computer Science, Engineering, or a related field; Master’s degree preferred
  • 3+ years of experience leading software teams
  • 8+ years of experience in the software engineering field
  • 5+ years of experience in big data technologies, with a focus on Elastic and Kafka
  • Proficiency in Java programming and experience with related frameworks
  • Strong understanding of data modeling, ETL processes, and data warehousing
  • Proven leadership skills with the ability to motivate and guide a team
  • Excellent problem-solving abilities and strong analytical skills
  • Strong communication skills, with the ability to convey technical concepts to non-technical stakeholders
  • A solid understanding of CI/CD principles
  • Experience working with both external and in-house APIs and SDKs 

Advantages:

  • Experience working directly with customers
  • Experience with Docker, Kubernetes
  • Experience with cloud platforms (e.g., AWS or Azure) 

What’s in it for you?!

Our people are the foundation of our success, and we prioritize offering a wide range of benefits that make our team happier and healthier.

  • Equity participation - everyone shares in our success
  • Flexible work arrangements - for parents, for remote workdays, etc.
  • Office perks: dog-friendly environment, fully stocked fridge, gym, and exercise classes, weekly Happy Hours, free parking, evening meals
  • Knowledge training & Career development tracks

Our Values:

We look for people who embody our values - Care, Do, Try & Shine.

  • Care - We care about our customers and each other
  • Do - We do what it takes to make a positive impact
  • Try- We try our best and we don’t give up
  • Shine- We shine and make it our mission to always stand out

#LI-Hybrid

#LI-AT1

BigDiversity: We’re committed to creating a culture of inclusion, diversity, and equality – across race, gender, sexuality, disability, and neurodiversity – where innovation and growth thrive, every voice is heard, and everybody belongs. Learn more about us here.

CPRA Employee Privacy Notice: CA 

BigID is an E-Verify Participant.

Top Skills

Java
The Company
New York, NY
500 Employees
Hybrid Workplace
Year Founded: 2016

What We Do

BigID is an innovative tech startup that focuses on solutions for data security, compliance, privacy, and governance. We're leading the market in all things data: helping our customers reduce risk, drive business innovation, achieve compliance, build customer trust, make better decisions, and get more value from their data.

We are building a global team with a passion for innovation and next-gen technology. BigID has been recognized for being one of CNBC’s Top 25 Startups powering the economy, we're on Built In's 2023 Best Places to Work, #21 on the 2022 Deloitte 500 (most innovative, fastest-growing companies in North America) and we’re on the 2022 Inc 5000.

Why Work With Us

At BigID, our team is the foundation of our success. Join a people-centric culture that is fast-paced and rewarding: you’ll have the opportunity to work with some of the most talented people in the industry who value innovation, diversity, integrity, and collaboration.

Gallery

Gallery

Similar Jobs

Remitly Logo Remitly

Data Engineering Team Lead

eCommerce • Fintech • Payments • Software • Financial Services
Tel Aviv, ISR
2700 Employees

Bringg Logo Bringg

Senior Backend Developer

Cloud • Enterprise Web • Logistics • Software
Tel Aviv, ISR
210 Employees

Bringg Logo Bringg

VP of Engineering

Cloud • Enterprise Web • Logistics • Software
Tel Aviv, ISR
210 Employees

Taboola Logo Taboola

Technical Operations Engineer

AdTech • Big Data • Digital Media • Marketing Tech
Tel Aviv, ISR
1900 Employees

Similar Companies Hiring

Jobba Trade Technologies, Inc. Thumbnail
Software • Professional Services • Productivity • Information Technology • Cloud
Chicago, IL
45 Employees
RunPod Thumbnail
Software • Infrastructure as a Service (IaaS) • Cloud • Artificial Intelligence
Charlotte, North Carolina
53 Employees
Hedra Thumbnail
Software • News + Entertainment • Marketing Tech • Generative AI • Enterprise Web • Digital Media • Consumer Web
San Francisco, CA
14 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account