Senior Data Engineer

Who You’ll Work With:

You will design, build, and maintain scalable, cloud‑ready data pipelines and infrastructure enabling investment business teams—research analysts, quantitative modelers, traders, risk managers, and portfolio managers—to access accurate, timely, and high‑quality data. The role blends engineering rigor with fluency in investment data, helping power analytics, models, and mission-critical investment applications

What You’ll Do:

Data Pipeline & Engineering Development

·        Build and optimize end‑to‑end data pipelines to support ingestion, scrubbing, transformation, and distribution of investment data.

·        Implement robust ETL/ELT processes for structured and unstructured datasets across fixed income, Equities, and Multi asset domains.

·        Automate workflows and enhance data reliability for downstream risk, attribution, analytics, and reporting platforms.

Data Modeling, Architecture & Quality Control

·        Develop, maintain, and document data models, schemas, and database structures supporting investment analytics and operational workflows.

·        Implement data validation and quality frameworks aligned with investment teams’ data integrity standards.

Investment Data Domain Expertise

·        Build fluency across various investment data domains and design data access patterns that deliver clean, consistent, and efficient access to consumers.

·        Understand how key model inputs (terms and conditions, pricing, index attributes, reference data) influence analytical outputs and decision‑making.

Systems Integration & API Development

·        Integrate data with internal platforms and external vendors; streamline and standardize access through APIs, warehouses, or curated data layers.

·        Support enhancements to data streams and contribute to cloud‑native data engineering initiatives aligned with machine learning and analytics engineering trends.

·        Enable seamless data access through analytics and visualization tools (e.g., Power BI, Excel, and BQL), ensuring that curated datasets, semantic models, and governed views are optimized for consumption by investment teams and downstream reporting workflows.

Collaboration & Cross‑Functional Partnership

·        Partner with investment teams to understand requirements and deliver high‑quality data that supports research, risk, and portfolio‑management workflows.

·        Contribute to documentation, data governance, and best practices across the technology and investment organization.

Make Data AI‑Ready

·        Design and structure datasets and documents so AI assistants (e.g., Copilot, ChatGPT) can seamlessly interpret and generate on‑the‑fly access requests for citizen developers.

·        Standardize metadata, tagging, and ontologies to reduce ambiguity in natural‑language queries and improve AI‑driven retrieval accuracy.

·        Implement data normalization, consistent schemas, and well‑defined relationships to support LLM‑driven reasoning across investment and operational domains.

·        Build and maintain semantic layers or knowledge catalogs that allow AI models to map user intent to underlying data assets.

·        Partner with architecture, security, and business teams to ensure AI‑facing datasets meet governance, privacy, and compliance requirements.

·        Develop automated pipelines that prepare and refresh AI‑ready data—including embeddings, vector indexes, and domain‑specific feature stores.

·        Evaluate and optimize data structures for compatibility with enterprise GenAI tools (e.g., Microsoft Copilot, RAG systems, internal LLMs).

What We’re Looking For:

• Python, SQL; Scala/Java for Apache Spark (batch & streaming)
• Databricks, Spark; orchestration with Azure Data Factory / Airflow
• Formats & storage: Delta Lake, Parquet; serving on Synapse / Fabric / Snowflake
• Event ingestion and near‑real‑time processing with Kafka / Azure Event Hubs
• Dimensional & domain modeling, data contracts, and data validation frameworks
• Catalog/lineage & governance with Microsoft Purview (or equivalent)
• Power BI (DAX, Power Query, XMLA, RLS/OLS, Deployment Pipelines, REST API)
• Excel (Power Pivot/Power Query); Bloomberg BQL add‑ins/templates
• Ontologies/semantic layer, knowledge catalogs; embeddings & vector search
• RAG patterns and alignment with Microsoft Copilot / enterprise LLMs
• Azure services, Terraform/Bicep, Docker/Kubernetes, monitoring/observability
• Secure access patterns (SSO/AAD, gateways), RBAC/ABAC, secrets management
• Nice to understand various investment data domains
• Intellectual curiosity, strong work ethic, and professional presence.
• Excellent problem‑solving skills and the ability to work across diverse technical and business teams.
• Ability to communicate complex data concepts to investment stakeholders.

About AB 

We are a leading global investment management firm offering high-quality research and diversified investment services to institutional clients, retail investors, and private-wealth clients in major markets around the globe. With over 4,000 employees across 57 locations operating in 26 countries and jurisdictions, our ambition is simple: to be the most trusted investment firm in the world. We realize that it's our people who give us a competitive advantage and drive success in the market, and our goal is to create an inclusive culture that rewards hard work. 

Our culture of intellectual curiosity and collaboration creates an environment where you can thrive and do your best work. Whether you're producing thought-provoking research, identifying compelling investment opportunities, infusing new technologies into our business or providing thoughtful advice to our clients, we are fully invested in you. If you're ready to challenge your limits and empower your career, join us!