Top Data Engineer Jobs in Cologne

Design and scale mission-critical market data services for stocks, options, crypto, and foreign exchange. Responsibilities include architecting backend systems and APIs, maintaining software quality and test coverage, participating in code reviews, and troubleshooting incidents and bugs. The role uses Go and Python with REST, gRPC, WebSockets, SSE, Docker, Kubernetes, Google Cloud, BigTable, Prometheus, Grafana, and ELK.

The Software Engineer will manage data collection for model training at Speechify, handling infrastructure on GCP, and collaborating with AI scientists.

Own and grow the Data Layer: build and operate ingestion, transformation, reconciliation, and serving pipelines (raw→refined→curated). Use agentic AI tools to accelerate delivery, ensure data correctness, and partner with backend, AI, and product teams to define reliable data contracts.

Design, build, and operate cloud-native, serverless ClickHouse infrastructure. Develop and maintain Kubernetes operators, improve metrics pipelines, support data ingestion/transformation systems (Spark/Kafka), and collaborate with core database and data plane teams to ensure scalable, highly available distributed systems.

Own and scale the ingestion pipeline and backend abstractions for high-throughput AI tracing data. Optimize ClickHouse schemas and queries, operate Langfuse Cloud and self-hosted deployments, and build infrastructure-heavy features that enable product engineers to ship data-heavy capabilities.

Own and build the internal data warehouse and analytics platform: consolidate product and operational data, define data models and contracts, create transformation pipelines, enable AI/ML datasets, implement data quality, lineage, and observability, and collaborate with stakeholders to support BI and analytics.

Lead and operate production-grade data pipelines and streaming systems to ingest, enrich, process, and serve web event and intent data at scale. Own cloud infrastructure as code, observability, data quality, and CI/CD. Collaborate with product and ML teams to deliver reliable, low-latency data powering customer-facing features and AI/ML workflows.

Lead design and implementation of scalable, real-time data infrastructure. Build and optimize production-grade streaming pipelines, employ spec-driven development and agentic AI workflows, implement testing/monitoring, take ownership of systems, and mentor junior engineers.

Design, build, and operate high-frequency, event-driven data pipelines into Snowflake; implement reverse ETL; model data with dbt; deploy cloud infra as code; monitor and improve production reliability, latency, quality, and cost; mentor teammates and establish data engineering standards.

The Technical Privacy Expert will implement privacy-by-design principles, ensure compliance with regulations, mentor teams, and develop technical frameworks for privacy in technologies.

Design, build, and scale high-performance data pipelines and infrastructure (ingestion, transformation, storage, modeling, serving) using ClickHouse, Postgres, Python and dbt. Manage data quality, reliability, and observability at terabyte and 500M+ address scale, collaborate with researchers and product, mentor engineers, and leverage AI tools to accelerate work.

Lead development of Data and AI features from data architecture to optimization and simulation. Design scalable data architectures, reliable pipelines, and DataOps/DevOps workflows. Partner with analysts, product managers and supply chain specialists to turn complex logistics data into actionable solutions.

Own and evolve the core data platform: warehouse design, dbt transformations, and production AWS pipelines. Refactor and harden API-driven data flows, ensure observability and testing, partner with backend and product teams, and contribute to data-aware backend features to deliver reliable, product-focused data.

As a Senior Software Engineer, you'll design and build scalable market data systems, improve API architecture, and enhance overall system performance, contributing to Alpaca's infrastructure for trading financial assets.

Build and operate large-scale data pipelines and orchestration for generative AI research, focusing on video/audio datasets, feature extraction, labeling, and dataset quality to improve model performance.

Design, build, and operate a multi-tenant data platform: ingestion from heterogeneous sources, storage, fast query paths, pipelines to object storage, production Postgres performance, platform infrastructure and deployments, and performance work with the optimization engine.

Build and maintain high-performance, fault-tolerant distributed backend services and data pipelines for large genomic and health datasets. Design storage, indexing, and async event workflows; optimize latency, throughput, and reliability. Partner with bioinformatics and product teams to validate scientific accuracy and guard AI-driven responses.

Build end-to-end features for a data orchestration platform across Java/Micronaut backend and Vue 3/TypeScript frontend. Implement data-aware orchestration (assets, lineage, freshness, quality), create integrations/plugins (dbt, Fivetran, Airbyte, warehouses), improve UI (flow editor, topology, dashboards), collaborate on 8-week releases, review PRs, and engage with the open-source community.

Design and build highly scalable, low-latency market data systems and APIs. Implement backend services, influence architecture, maintain test coverage, participate in code reviews, troubleshoot incidents, and occasionally be on-call. Work spans streaming and historical market data endpoints and developer-focused API improvements.

Own and operate Databricks-based data platform production support, build and migrate ETL/ELT pipelines to Databricks across Azure/AWS, optimize compute and performance, enforce Delta Lake architecture and data security, implement observability and CI/CD, support multi-tenant onboarding and on-call incident response, and maintain runbooks and SLA metrics.

Own and evolve a GCP-native data platform from ingestion to reporting. Lead architecture, reliability, observability, data quality, cost optimization, and AI-assisted engineering practices while mentoring engineers and collaborating with product and customer teams.

Design and develop data models, ETL processes, and cloud-based data solutions using Azure and various big data technologies. Support report generation and data analysis.

Design and maintain data infrastructure, build pipelines for data collection, ensure data quality, and collaborate with stakeholders on data requirements.