The Role
Build and manage data pipelines, enterprise connectors, raw-to-mart data layers, metadata and semantic indexes, vector databases, data quality controls, lineage, governance, and audit data stores. Support RAG and LLM applications with grounded, traceable data. Required skills include Python, SQL, modern data platforms, orchestration, API integration, testing, Git, and CI/CD. Bonus experience includes unstructured content processing, knowledge graphs, regulated life sciences data, and cloud or platform certifications.
Summary Generated by Built In
Why this role matters
Every AI agent, scorecard, and dashboard we deliver is only as good as the data underneath it. As a Data Engineer, you’ll build that foundation: the pipelines, connectors, indexes, vector stores, and data marts that make our AI products accurate, grounded, and auditable.
What you’ll do
- Design and build ingestion pipelines for structured data, unstructured content such as documents and PDFs, and metadata
- Build reusable connectors to enterprise systems, catalogs, content repositories, and licensed third-party sources via APIs
- Model and build raw-to-mart data layers serving both analytics and AI use cases
- Implement metadata extraction, enrichment, and search indexing, including semantic and vector indexes for RAG
- Set up and manage the vector databases and knowledge repositories that power LLM agents
- Build data quality rules, profiling, scoring outputs, and exception handling
- Register lineage and maintain source registries, version tracking, and refresh controls
- Design data stores for signals, findings, audit trails, and user feedback loops
- Apply security and governance controls, including RBAC, PII and sensitivity flagging, and approved data handling
- Support SIT and UAT data validation, defect fixes, and production releases
What you bring
- Strong Python and SQL, with solid dimensional and normalized data modeling
- Hands-on experience with a modern data platform such as Databricks, Snowflake, or Azure/AWS data services
- Pipeline orchestration and transformation with Spark, Airflow, ADF, dbt, or similar
- REST API integration, JSON handling, and incremental or CDC ingestion patterns
- Data quality frameworks and pipeline testing practices
- Git and CI/CD for data workloads
Bonus points for
- RAG data preparation: chunking, embeddings, and vector databases (Azure AI Search, pgvector, Pinecone, or similar)
- Unstructured content processing, including text extraction, OCR, and document parsing
- Metadata management, data catalogs, ontologies, or knowledge graphs such as Neptune
- Experience supporting LLM or agentic applications with grounded, traceable data
- Life sciences data exposure and experience handling regulated data
- Azure Data Engineer, Databricks, AWS, or Snowflake certification
Skills Required
- Strong Python skills
- Strong SQL skills
- Experience with dimensional and normalized data modeling
- Hands-on experience with a modern data platform such as Databricks, Snowflake, or Azure/AWS data services
- Experience with pipeline orchestration and transformation using Spark, Airflow, ADF, dbt, or similar
- Experience integrating REST APIs and handling JSON
- Experience with incremental or CDC ingestion patterns
- Experience with data quality frameworks and pipeline testing
- Experience using Git and CI/CD for data workloads
- Experience preparing RAG data, including chunking, embeddings, and vector databases
- Experience processing unstructured content, including text extraction, OCR, and document parsing
- Experience with metadata management, data catalogs, ontologies, or knowledge graphs such as Neptune
- Experience supporting LLM or agentic applications with grounded, traceable data
- Life sciences data exposure and experience handling regulated data
- Azure Data Engineer, Databricks, AWS, or Snowflake certification
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
Techdome is a technology consultancy and IT solutions provider founded in 2020. It helps businesses modernize operations and navigate digital transformation through scalable, end-to-end services spanning planning, building, designing, developing, and launching technology solutions, alongside AI, cloud computing, automation, data engineering, machine learning, custom large language models, and cybersecurity. Its mission is to make complex technology accessible and support business growth across diverse industries and markets.








