NLP / LLM Engineer

Posted 11 Hours Ago
Be an Early Applicant
Pune, Maharashtra, IND
In-Office
Mid level
Artificial Intelligence • Software • Analytics • Business Intelligence
The Role
Build and maintain NLP and LLM capabilities for Rubiscape’s enterprise AI copilot. Responsibilities include developing document understanding and information extraction pipelines, fine-tuning open-source LLMs, constructing RAG systems, creating prompt engineering frameworks, evaluating model quality, supporting multilingual Indian-language NLP, and deploying scalable NLP microservices. The role also involves improving accuracy, safety, latency, structured outputs, and integration with enterprise data systems.
Summary Generated by Built In
About the Role

As an NLP / LLM Engineer at Rubiscape, you will build the language intelligence that makes RubiAI — our agentic AI copilot — genuinely useful to enterprise analysts, data engineers, and business decision-makers interacting with complex data in natural language. You will own the full NLP stack: from classical text processing and information extraction through LLM fine-tuning, retrieval-augmented generation, and prompt engineering for enterprise-grade accuracy and safety. This role directly advances Rubiscape’s vision of a platform where every employee can query, analyse, and act on enterprise data without writing a single line of code.

 

Key Responsibilities

·         Design and implement NLP pipelines for document understanding, entity extraction, classification, and summarisation integrated into RubiAI and Business Workbench.

·         Fine-tune and evaluate open-source LLMs (Llama 3, Mistral, Phi-3) on Rubiscape’s domain-specific corpora using PEFT techniques (LoRA, QLoRA) and managed fine-tuning APIs.

·         Build and iterate on RAG architectures: chunking strategies, embedding model selection and evaluation, hybrid retrieval (dense + sparse), and re-ranking for high-precision enterprise knowledge retrieval.

·         Develop and maintain the prompt engineering framework for RubiAI: structured prompting patterns, chain-of-thought templates, system prompt governance, and automated regression testing for prompt quality.

·         Evaluate LLM outputs systematically using RAGAS, DeepEval, or custom evaluation harnesses; track quality metrics across model versions and prompt iterations.

·         Implement multilingual NLP capabilities for Indian-language enterprise content (Hindi, Marathi) where required by government and public-sector customers.

·         Collaborate with the AI Platform Engineer to deploy NLP microservices at scale, ensuring latency SLOs are met for interactive RubiAI copilot responses.

Nice to Have

·         Experience with structured output generation (JSON mode, grammar-constrained decoding) for reliable LLM integration with enterprise data systems.

·         Knowledge of speech-to-text or multimodal models relevant to voice-driven analytics interfaces.

·         Exposure to LLM safety, alignment, and responsible AI practices for regulated-sector deployments.

·         Contribution to open-source NLP or LLM tooling (HuggingFace, LangChain, LlamaIndex, or equivalent).

 

 

 

About Rubiscape

Rubiscape is India’s leading Decision Intelligence Platform, unifying data engineering, BI, machine learning, and agentic AI in a single governed platform. Built in Pune and trusted by Fortune 500 enterprises across BFSI, manufacturing, healthcare, and government. 8 international innovation patents. 10 Industry-Academia Labs & COEs. From BI to AI — One Platform. Every Decision.



RequirementsRequirements

·         3+ years of NLP engineering experience with demonstrable production deployments; at least 1 year working with large language models in a product context.

·         Deep proficiency with HuggingFace Transformers, Datasets, and PEFT libraries for model fine-tuning and evaluation.

·         Hands-on experience with RAG pipeline construction using LangChain or LlamaIndex and at least one vector store (Weaviate, Qdrant, Chroma, or pgvector).

·         Strong Python skills and familiarity with model serving for NLP workloads (ONNX, TorchServe, vLLM, or Text Generation Inference).

·         Solid understanding of LLM evaluation methodology: benchmark construction, human preference alignment, and hallucination mitigation strategies.

·         Bachelor’s or Master’s degree in Computer Science, Computational Linguistics, or a related field.



Skills Required

  • 3+ years of NLP engineering experience with demonstrable production deployments
  • At least 1 year of experience working with large language models in a product context
  • Deep proficiency with HuggingFace Transformers, Datasets, and PEFT libraries
  • Hands-on experience constructing RAG pipelines using LangChain or LlamaIndex
  • Experience with at least one vector store: Weaviate, Qdrant, Chroma, or pgvector
  • Strong Python skills
  • Familiarity with NLP model serving using ONNX, TorchServe, vLLM, or Text Generation Inference
  • Understanding of LLM evaluation methodology, benchmark construction, human preference alignment, and hallucination mitigation
  • Bachelor’s or Master’s degree in Computer Science, Computational Linguistics, or a related field
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
30 Employees
Year Founded: 2018

What We Do

Rubiscape is a decision intelligence platform that unifies business intelligence, analytics, data science, and artificial intelligence in one place, helping organizations move from BI to AI. Its technology and product-development work spans AI-focused development, software engineering, product management, agile delivery, security operations, and DevOps, reflecting a software platform mission centered on enabling data-driven decisions across modern organizations.

Similar Jobs

Hybrid
Mumbai, Maharashtra, IND
289097 Employees

MetLife Logo MetLife

Senior Data Goverance Analyst II

Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Hybrid
Pune, Maharashtra, IND
43000 Employees

BlackRock Logo BlackRock

Software Engineer

Fintech • Information Technology • Financial Services
In-Office
Mumbai, Maharashtra, IND
25000 Employees
In-Office
Mumbai, Maharashtra, IND
25000 Employees

Similar Companies Hiring

Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account