AI Lead Engineer

What you’ll do:

• Lead cross-functional teams in identifying and prioritizing key areas of a partner’s business where AI solutions can drive significant business benefit. 

• Design and develop solutions leveraging patterns in the data and metadata stored in Petabytes of Objects and Files in distributed fashion across enterprise storage platform. 

• Design, develop, and deploy hybrid RAG architectures integrating LLMs with retrieval-based systems for improved relevance and contextual responses. 

• Work on functional design, process design (including scenario design, flow mapping), prototyping, testing, training, and defining support procedures, in collaboration with an advanced engineering team and executive leadership 

• Translating technical AI findings into clear, business-oriented language for non-technical stakeholders to support AI-driven business strategies. 

• Implement and manage pipelines that effectively combine retrieval mechanisms with generative capabilities, ensuring high accuracy and efficiency. 

• Develop custom plugins, adapters, or APIs to integrate retrieval systems (e.g., Elasticsearch) with generative models, facilitating seamless information retrieval. 

• Fine-tune and optimize large language models, enhancing their performance and adaptability to domain-specific requirements. 

• Monitor and troubleshoot issues within pipelines, fine-tuning retrieval parameters and model hyperparameters to optimize performance. 

• Evaluate and benchmark the performance of vector databases and collaborate with data scientists and software engineers to integrate vector search capabilities into production systems. 

• Evaluate and benchmark the performance of solutions, using metrics such as response accuracy, latency, and user satisfaction. 

• Articulate and document the solutions architecture and lessons learned for each exploration and accelerated incubation. 

• Serve as liaison between stakeholders and project teams, delivering feedback and enabling team members to make necessary changes in product performance or presentation. 

• Demonstrate innovative AI use-cases, conducting workshops and training sessions, technical paper and patent presentations to foster AI adoption 

• Guiding and mentoring junior AI engineers, helping them develop their skills and knowledge in the field. 

• Adhere to the policies and procedures related to AI governance to ensure compliance with legal and ethical standards. 

• Keeping abreast of the latest industry trends, tools, and technologies in AI to continually improve the AI capabilities of the organization. 

What you need to bring:

• Experience designing and developing software systems design tools and languages in storage/server/networking area. 

• Two or more years of experience in applying AI to practical and comprehensive technology solutions 

• Experience with ML, deep learning, TensorFlow, Python, NLP 

• Experience in program leadership, governance, and change enablement 

• Knowledge of basic algorithms, object-oriented and functional design principles, and best-practice patterns 

• Experience in REST API development, NoSQL database design, and RDBMS design and optimizations 

• Experience with innovation accelerators