Senior Data Engineer

Posted 4 Days Ago
Be an Early Applicant
Sofia, Sofia-grad, BGR
Hybrid
Senior level
Artificial Intelligence • Machine Learning • Security • Software • Analytics • Big Data Analytics
Actionable Intelligence for a Safer World
The Role
Design, build, and optimize a scalable data lakehouse and pipelines (batch & streaming) using Spark, Iceberg, ClickHouse, Trino and AWS/hybrid infrastructure. Own data modeling, medallion architecture, data quality, lineage, performance tuning, and platform operations while collaborating with BI users and stakeholders.
Summary Generated by Built In
Description

At Cognyte, you’ll collaborate with expert colleagues around the globe to solve problems most people will never even know exist!

You’ll be part of building unique solutions shaped by real investigative methodologies, enabling our customers to identify, investigate, visualize and prevent criminal, terror and security threats worldwide.

These solutions are used by law enforcement, national security, and national and military intelligence agencies in almost 100 countries to turn massive, diverse data into clear, actionable intelligence for a safer world.

We are looking for a passionate Senior Data Engineer to join our Data Platform team. In this role, you will be an individual contributor working on the design and implementation of our data lakehouse infrastructure. You will help build scalable, high-performance data foundations that support analytics, BI, and future data-driven capabilities across the platform.

The mission is to deliver a successfully working data lakehouse based on modern data engineering technologies, medallion architecture, scalable processing, and reliable data quality.

As a Cognyter you will:

  • Design, build, and optimize scalable data lakehouse platforms using technologies such as Spark, Iceberg, Trino, ClickHouse, and AWS/hybrid infrastructure.
  • Develop and maintain batch and streaming data pipelines, workflow orchestration, and data-serving layers, ensuring reliability, scalability, and performance.
  • Own data modelling, medallion architecture (bronze, silver, gold), ClickHouse optimization, cost estimation, and platform governance, including data quality, lineage, and observability.
  • Collaborate with BI users, engineers, and stakeholders to deliver curated datasets, support analytics and reporting, and contribute to architectural decisions.
  • Provide hands-on support for platform operations, infrastructure-related tasks, and continuous improvement of the data ecosystem.
Requirements

For that mission you'll need:

  • 5+ years in software/data engineering, including 3+ years in hands-on data engineering and experience in a senior engineering role.
  • Strong expertise in SQL, Python, Apache Spark, and ClickHouse (schema design, materialized views, performance tuning, scalable query optimization).
  • Experience with Kubernetes and building, operating, and optimizing production-grade data pipelines.
  • Solid understanding of data warehousing, data lakes/lakehouses, data modeling, data quality, scalability, and performance optimization.
  • Experience working with large-scale distributed systems, high-volume data, and AWS and/or hybrid cloud environments.
  • Hands-on experience with several of the following: Apache Iceberg, Nessie, AWS Glue, Argo Workflows, PostgreSQL, Elasticsearch, Neo4j, Helm, Jenkins, and Kubernetes.
  • Good English communication skills.

Nice to have:

  • Experience with Apache Iceberg, Apache Ranger, data governance, access control, and data security.
  • Experience with BI platforms, particularly Apache Superset.
  • Experience building data platforms from scratch and optimizing cloud or hybrid data infrastructure.

Skills Required

  • 5+ years in software/data engineering, including 3+ years hands-on data engineering and senior engineering experience
  • Strong expertise in SQL
  • Strong expertise in Python
  • Strong expertise in Apache Spark
  • Strong expertise in ClickHouse (schema design, materialized views, performance tuning, query optimization)
  • Experience with Kubernetes and operating production-grade data pipelines
  • Understanding of data warehousing, data lakes/lakehouses, data modeling, data quality, scalability, and performance optimization
  • Experience with large-scale distributed systems, high-volume data, and AWS and/or hybrid cloud environments
  • Hands-on experience with several of: Apache Iceberg, Nessie, AWS Glue, Argo Workflows, PostgreSQL, Elasticsearch, Neo4j, Helm, Jenkins
  • Good English communication skills
  • Experience with Apache Ranger, data governance, access control, and data security
  • Experience with BI platforms, particularly Apache Superset
  • Experience building data platforms from scratch and optimizing cloud or hybrid data infrastructure

Cognyte Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Cognyte and has not been reviewed or approved by Cognyte.

  • Healthcare Strength Health coverage spans medical, dental, vision, disability, life insurance, mental‑health support, and FSA options. Coverage is generally portrayed as solid within a well‑rounded package.
  • Leave & Time Off Breadth Time off includes generous PTO, paid holidays, floating holidays, wellness days, and paid volunteer time. These elements indicate a comprehensive time‑off offering.
  • Wellbeing & Lifestyle Benefits Work setup includes flexible schedules and hybrid/remote options highlighted across public materials. Flexibility is emphasized alongside the core benefits offering.

Cognyte Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Herzliya
1,600 Employees
Year Founded: 2021

What We Do

Cognyte is a leading software-driven technology company focused on solutions for data processing and investigative analytics that allow customers to generate Actionable Intelligence for a Safer World™. We empower law enforcement, national security, national and military intelligence agencies, and other organizations to navigate an increasingly complex threat landscape with greater speed, accuracy, and precision.

Why Work With Us

Driven by curiosity and a purpose with real-world impact, we place innovation at the core as we tackle complex, fascinating challenges where bold questions forge real breakthroughs.

Gallery

Gallery

Similar Jobs

Experian Logo Experian

Senior Data Engineer

Big Data • Marketing Tech • Analytics
Remote or Hybrid
Sofia, Sofia-grad, BGR
16292 Employees

Keyrock Logo Keyrock

Senior Data Engineer

Fintech • Software • Financial Services • Cryptocurrency
In-Office or Remote
37 Locations
163 Employees

Experian Logo Experian

Analytics Engineer

Big Data • Marketing Tech • Analytics
Remote or Hybrid
Sofia, Sofia-grad, BGR
16292 Employees

Langfuse Logo Langfuse

Senior Back-end Engineer

Artificial Intelligence • Software
Remote or Hybrid
32 Locations
15 Employees

Similar Companies Hiring

Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account