LLM Engineer

Why Join HYCU?  

HYCU is the fastest-growing leader in the multi-cloud and SaaS data protection as a service industry. By bringing true SaaS-based data backup and recovery to on-premises, cloud-native, and SaaS IT environments, the company provides unrivaled data protection, migration, disaster recovery, and ransomware protection to thousands of companies worldwide. The company's award-winning R-Cloud platform eliminates complexity, risk, and the high cost of legacy-based solutions, providing data protection simplicity to make it the #1 SaaS Data Protection platform. With an industry leading NPS score of 91, HYCU has raised $140M in VC funding to date and is based in Boston, Mass. Learn more at www.hycu.com.
 

Overview  

We are seeking a LLM Engineer (Large Language Model Engineer) that will be responsible for developing, optimizing, and operationalizing Large Language Model capabilities that power data understanding, reasoning, and insight generation across AI products. 

We are building next-generation Generative AI products that deliver actionable data insights at enterprise scale. Our platform leverages Large Language Models (LLMs), advanced data pipelines, and AI agents to help organizations reason over data, generate insights, and make informed decisions. We focus on building secure, scalable, explainable, and production-grade AI systems. 

Location:   

• Bangalore, India (Hybrid; 3 days onsite/2 days remote)  
   

What You’ll Do:  

• Design, develop, and maintain LLM-based workflows for data analysis and insight generation 

• Build prompt strategies, templates, and system instructions for reliable and accurate model behavior 

• Implement retrieval-augmented generation (RAG), tool calling, and multi-step reasoning workflows 

• Evaluate and improve model quality, latency, and cost efficiency 

• Collaborate with data, knowledge, and applied AI engineers to improve grounding and relevance 

• Develop and optimize prompts and workflows for complex data reasoning use cases 

• Continuously test and evaluate model outputs for accuracy, consistency, and bias 

• Optimize token usage, response time, and cost without compromising quality 

• Contribute to best practices for LLM usage and responsible AI development 

• Support production deployments and troubleshoot LLM-related issues 

What We’re Looking For:  

• Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field 

• 6–9 years of experience in software engineering, AI, or NLP-related roles 

• Experience working with Generative AI or NLP systems in production environments 

• Exposure to enterprise data or analytics platforms is a plus 

• Strong experience working with Large Language Models and LLM APIs 

• Hands-on experience with prompt engineering and prompt optimization 

• Good understanding of embeddings, semantic search, and RAG architectures 

• Proficiency in Python and AI/ML development frameworks 

• Familiarity with model evaluation, experimentation, and monitoring techniques 

Technical Skills Required: 

Core Skills 

• Python 

• LLM API integration (OpenAI, Anthropic) 

• RAG architecture design 

• Prompt strategy & evaluation 

• LLM output validation techniques 

• Response scoring & testing 

• LLM Tooling (Hands-on Required) 

• LangChain or LlamaIndex 

• Embedding models 

• Vector DB integration 

• Streaming inference handling 

Preferred 

• Open-source LLM experimentation 

• Function-calling / tool-use patterns 

• Evaluation frameworks 

• Cost optimization strategies 

Who We Are:  

Our Core Values: Authenticity, Grit and Empathy are at the heart of everything we do at HYCU. All of us at HYCU take ownership in shaping and contributing to our culture. We pride ourselves in developing an inclusive and diverse company that supports our employees and customers to do extraordinary things.

"We are at our best when we stay true to our Core Values."~ Simon Taylor, CEO  

What We Offer: 

Come work for one of CRN’s “Cloud 100 Companies for 2026”. At HYCU you’ll have the opportunity to build your career with a “Visionary” B2B SaaS company from Gartner’s Magic Quadrant for Enterprise BackUp. HYCU provides an excellent benefits package including Medical Insurance, generous time off, and more. We offer career development programs and an inclusive global culture. All our employees participate in our equity program.