Senior Data Platform Engineer

Posted 3 Days Ago
Be an Early Applicant
Chennai, Tamil Nadu
In-Office
Senior level
Security • Software • Cybersecurity • Data Privacy
The Role
Responsible for the design, development, and maintenance of big data architecture, implementing data processing pipelines, optimizing search capabilities, and managing code quality and best practices.
Summary Generated by Built In

Who we are:

BigID is an innovative tech startup that focuses on solutions for data security, compliance, privacy, and AI data management. We're leading the market in all things data: helping our customers reduce risk, drive business innovation, achieve compliance, build customer trust, make better decisions, and get more value from their data.

We are building a global team passionate about innovation and next-gen technology. BigID has been recognized for: 

  • BigID Named Hot Company in Artificial Intelligence and Machine Learning at the Global InfoSec Awards
  • Citizens JMP Cyber 66 List of Hottest Privately Held Cybersecurity Companies
  • CRN 100 list named BigID as one of the 20 Coolest Identity Access Management and Data Protection Companies (3 years running)
  • DUNS 100 Best Tech Companies to Work for
  • Top 3 Big Data and AI Vendors to Watch' in the 2023 BigDATAwire Readers and Editors Choice Awards
  • 2024 Inc. 5000 list for the 4th consecutive year!
  • Shortlisted for the 2024 AI Awards in the category of Best Use of AI in Cybersecurity

At BigID, our team is the foundation of our success. Join a people-centric culture that is fast-paced and rewarding: you’ll have the opportunity to work with some of the most talented people in the industry who value innovation, diversity, integrity, and collaboration.

Who we seek:

We’re looking for a Senior Data Platform Engineer to join our Data Platform team. The ideal candidate will have extensive experience with data engineering, specifically with Kafka and Elasticsearch, to design and maintain our data platforms. You will work closely with cross-functional teams to ensure the scalability and reliability of our data solutions.

Job Summary:
As a Senior Data Platform Engineer, you'll be responsible for design, development, maintenance, troubleshooting, and implementation of our big data architecture. Your expertise in Elastic, Kafka, and node.js will be critical in ensuring the scalability and performance of our data systems.

What you’ll do:

  • Implement data processing pipelines using Kafka for real-time data streaming.
  • Optimize and manage search capabilities using Elastic technologies.
  • Collaborate with product managers, data analysts, and other stakeholders to gather requirements and translate them into technical specifications.
  • Oversee code reviews, ensure best practices in coding and data handling, and maintain high-quality standards in software development.
  • Stay up-to-date with emerging trends and technologies in big data and recommend improvements to our architecture and processes.
  • Troubleshoot and resolve issues in a timely manner to minimize downtime and ensure system reliability.

What you’ll bring:

  • Bachelor’s degree in Computer Science, Engineering, or a related field; Master’s degree preferred.
  • 8+ years of experience in the software engineering field. 
  • 5+ years of experience in big data technologies, with a focus on MongoDB, Elastic Stack and Kafka.
  • Proficiency in Node.js  with NestJS framework and TypeScript.
  • Strong understanding of data modelling, ETL processes, and data warehousing.
  • Excellent problem-solving abilities and strong analytical skills.
  • A solid understanding of CI/CD principles.
  • Experience working with both external and in-house APIs and SDKs 

Advantages:

  • Experience with Java
  • Experience with Docker, Kubernetes
  • Experience with cloud platforms (e.g., AWS or Azure) 

What’s in it for you?!

Our people are the foundation of our success, and we prioritize offering a wide range of benefits that make our team happier and healthier.

  •    Equity participation - everyone shares in our success
  •    Hybrid work 
  •    Team fun & company outings
  •    Statutory benefits and leave benefits
  •    Health Insurance coverage 

Our Values:

We look for people who embody our values - Care, Do, Try & Shine.

  • Care - We care about our customers and each other
  • Do - We do what it takes to make a positive impact
  • Try- We try our best and we don’t give up
  • Shine- We shine and make it our mission to always stand out

#LI-HYBRID

#LI-EV2

We’re committed to creating a culture of inclusion and equality – across race, gender, sexuality, and disability – where innovation and growth thrive, every voice is heard, and everybody belongs. Learn more about us here.

Job Candidate Privacy Notice

Must be able to exercise independent judgment with little or no oversight.

BigID is an E-Verify Participant.

Top Skills

AWS
Azure
Ci/Cd
Docker
Elastic Stack
Elasticsearch
Kafka
Kubernetes
MongoDB
Nestjs
Node.js
Typescript
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
New York, NY
500 Employees
Year Founded: 2016

What We Do

BigID is an innovative tech startup that focuses on solutions for data security, compliance, privacy, and governance. We're leading the market in all things data: helping our customers reduce risk, drive business innovation, achieve compliance, build customer trust, make better decisions, and get more value from their data.

We are building a global team with a passion for innovation and next-gen technology. BigID has been recognized for being one of CNBC’s Top 25 Startups powering the economy, we're on Built In's 2023 Best Places to Work, #21 on the 2022 Deloitte 500 (most innovative, fastest-growing companies in North America) and we’re on the 2022 Inc 5000.

Why Work With Us

At BigID, our team is the foundation of our success. Join a people-centric culture that is fast-paced and rewarding: you’ll have the opportunity to work with some of the most talented people in the industry who value innovation, diversity, integrity, and collaboration.

Gallery

Gallery

Similar Jobs

Gen Logo Gen

Platform Engineer

Security • Cybersecurity
In-Office
Chennai, Tamil Nadu, IND
2006 Employees

Liven (liven.love) Logo Liven (liven.love)

Platform Engineer

Fintech • Software • Financial Services
In-Office or Remote
2 Locations
190 Employees

Optum Logo Optum

Assistant Manager - IP DRG

Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
In-Office
Chennai, Tamil Nadu, IND
160000 Employees

Optum Logo Optum

Software Engineering Lead - Contact Center, Genesys, IVR

Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
In-Office
Chennai, Tamil Nadu, IND
160000 Employees

Similar Companies Hiring

Scotch Thumbnail
Software • Retail • Payments • Fintech • eCommerce • Artificial Intelligence • Analytics
US
25 Employees
Milestone Systems Thumbnail
Software • Security • Other • Big Data Analytics • Artificial Intelligence • Analytics
Lake Oswego, OR
1500 Employees
Fairly Even Thumbnail
Software • Sales • Robotics • Other • Hospitality • Hardware
New York, NY

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account