Sr AI Data Engineer

Posted 2 Days Ago
Be an Early Applicant
Gurugram, Haryana, IND
In-Office
Senior level
Information Technology • Consulting
The Role
Build production-grade data ingestion and transformation pipelines using Databricks, PySpark, Delta Lake, and Microsoft Fabric. Develop LLM and AI agents, MCP servers, and governed AI data access solutions. Apply dimensional modeling, data quality, reconciliation, lineage, and governance practices while integrating enterprise systems. Partner with technical and business stakeholders to deliver data solutions, with preferred expertise in financial data engineering, FP&A, TBM classification, financial controls, and agentic workflows.
Summary Generated by Built In
Required Skills & Experience
    • 7+ years of experience in Data Engineering.
    • Minimum 3 years of hands-on experience with Databricks.
    • Strong hands-on experience with:
    • PySpark
    • Delta Lake
    • Databricks Workflows
    • Unity Catalog
    • Strong SQL development and optimization skills.
    • Strong experience in dimensional data modelling and star schemas.
    • Hands-on experience with Slowly Changing Dimensions (SCD).
    • Experience building production-grade data ingestion and transformation pipelines.
    • Experience integrating multiple enterprise source systems, preferably ERP, planning and HR systems.
    • Hands-on experience integrating Databricks with Microsoft Fabric.
    • Good understanding of:
    • Microsoft OneLake
    • Fabric Lakehouses
    • OneLake shortcuts
    • Proven hands-on experience building LLM/AI agents using Python.
    • Proven hands-on experience building MCP servers using Python in a real-world project.
    • Understanding of secure and governed access for AI agents and tools.
    • Strong understanding of data quality, reconciliation, lineage and data governance.
    • Ability to work with business and technical stakeholders to translate requirements into data solutions.

Strongly Preferred Skills
    • Experience in Finance, FP&A or financial data engineering.
    • Strong understanding of:
    • GL structures
    • Budgets
    • Forecasts
    • Estimates
    • Allocations
    • Cost centres
    • Financial planning scenarios
    • Experience with TBM (Technology Business Management) classification or similar financial classification frameworks.
    • Experience building AI-powered data engineering or ingestion solutions.
    • Experience with agentic workflows for data mapping, classification and anomaly detection.
    • Experience with additional LLM frameworks such as LangChain, LangGraph or similar.
    • Experience with enterprise AI governance and secure AI/data access.
    • Experience with Databricks data governance and lineage.
    • Experience implementing automated data reconciliation and financial controls.
    • Experience working with Microsoft Fabric-based enterprise analytics environments.

Skills Required

  • 7+ years of experience in data engineering
  • 3+ years of hands-on Databricks experience
  • Hands-on experience with PySpark, Delta Lake, Databricks Workflows, and Unity Catalog
  • Strong SQL development and optimization skills
  • Experience with dimensional data modeling, star schemas, and Slowly Changing Dimensions
  • Experience building production-grade data ingestion and transformation pipelines
  • Experience integrating multiple enterprise source systems, preferably ERP, planning, and HR systems
  • Hands-on experience integrating Databricks with Microsoft Fabric
  • Understanding of Microsoft OneLake, Fabric Lakehouses, and OneLake shortcuts
  • Proven hands-on experience building LLM or AI agents using Python
  • Proven hands-on experience building MCP servers using Python in a real-world project
  • Understanding of secure and governed access for AI agents and tools
  • Strong understanding of data quality, reconciliation, lineage, and data governance
  • Ability to translate business and technical requirements into data solutions
  • Experience in Finance, FP&A, or financial data engineering
  • Understanding of GL structures, budgets, forecasts, estimates, allocations, cost centres, and financial planning scenarios
  • Experience with TBM classification or similar financial classification frameworks
  • Experience building AI-powered data engineering or ingestion solutions
  • Experience with agentic workflows for data mapping, classification, and anomaly detection
  • Experience with LangChain, LangGraph, or similar LLM frameworks
  • Experience with enterprise AI governance and secure AI or data access
  • Experience with Databricks data governance and lineage
  • Experience implementing automated data reconciliation and financial controls
  • Experience with Microsoft Fabric-based enterprise analytics environments
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Vaughan, Ontario
345 Employees
Year Founded: 2007

What We Do

@TechBlocks we power the software defined industries (SDI) of today and tomorrow. We are a software engineering and consulting firm. We build modern digital value chains and businesses reimagined to create frictionless experiences for innovative monetization methods and drive unforeseen efficiencies. We are known to build world class custom platforms and products that are cloud native for some of the worlds largest brands. We are the go to technology partners for born in digital businesses that grew with us from "Concept to Commercialization" and have revenues between $100M - $10B. We help modern businesses transition just from a technology outsourcing mentality to help create globally distributed digital COEs and mature them. Our converged COEs that we create in partnership with our clients help power software factories that are extremely dynamic. We have created modern digital COEs and factories that are created with a single minded goal to future proof our clients businesses. Everything we do is centred around two philosophies and practices - Design Thinking and Lean Engineering. Whether it is building digital commerce platforms, marketplace for worlds largest retailers or smart utilities applications and products or digital health products/platforms that power wearables, patches or devices across healthcare landscape; we do it all with speed and sophistication that is unmatched in the industry

Similar Jobs

In-Office
Gurgaon, Gurugram, Haryana, IND
17843 Employees

EXL Logo EXL

Data Engineer

Information Technology • Database • Consulting
Hybrid
Gurugram, Haryana, IND
30246 Employees
Hybrid
Gurugram, Haryana, IND
244 Employees

Similar Companies Hiring

Axle Health Thumbnail
Artificial Intelligence • Healthtech • Information Technology • Logistics
Santa Monica, CA
25 Employees
NODA AI Thumbnail
Artificial Intelligence • Information Technology • Software • Cybersecurity
Sydney, AU
54 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account