Lead design, develop, and maintain scalable Databricks-based data pipelines using PySpark/Python and Delta Lake. Build and optimize ETL/ELT workflows, ensure data quality, troubleshoot pipelines, and collaborate with analytics and engineering teams.

Design, train, fine-tune, distill, and evaluate language models; build and maintain RAG pipelines with vector databases; implement LLM observability, monitoring, and evaluation; optimize deployments for latency, cost, and reliability; collaborate to integrate AI into products.

Design, build, and maintain scalable Databricks data pipelines using PySpark/Python and Apache Spark. Implement ETL/ELT workflows with Delta Lake, optimize Spark jobs, ensure data quality, and collaborate with engineering and analytics teams to troubleshoot and improve pipeline performance.