NLP / LLM Engineer

Posted One Month Ago
Be an Early Applicant
Pune, Maharashtra, IND
In-Office
Mid level
Artificial Intelligence • Software • Analytics • Business Intelligence
The Role
Build and maintain NLP and LLM capabilities for Rubiscape’s enterprise AI copilot. Responsibilities include developing document understanding and information extraction pipelines, fine-tuning open-source LLMs, constructing RAG systems, creating prompt engineering frameworks, evaluating model quality, supporting multilingual Indian-language NLP, and deploying scalable NLP microservices. The role also involves improving accuracy, safety, latency, structured outputs, and integration with enterprise data systems.
Summary Generated by Built In
About the Role

As an NLP / LLM Engineer at Rubiscape, you will build the language intelligence that makes RubiAI — our agentic AI copilot — genuinely useful to enterprise analysts, data engineers, and business decision-makers interacting with complex data in natural language. You will own the full NLP stack: from classical text processing and information extraction through LLM fine-tuning, retrieval-augmented generation, and prompt engineering for enterprise-grade accuracy and safety. This role directly advances Rubiscape’s vision of a platform where every employee can query, analyse, and act on enterprise data without writing a single line of code.

 

Key Responsibilities

·         Design and implement NLP pipelines for document understanding, entity extraction, classification, and summarisation integrated into RubiAI and Business Workbench.

·         Fine-tune and evaluate open-source LLMs (Llama 3, Mistral, Phi-3) on Rubiscape’s domain-specific corpora using PEFT techniques (LoRA, QLoRA) and managed fine-tuning APIs.

·         Build and iterate on RAG architectures: chunking strategies, embedding model selection and evaluation, hybrid retrieval (dense + sparse), and re-ranking for high-precision enterprise knowledge retrieval.

·         Develop and maintain the prompt engineering framework for RubiAI: structured prompting patterns, chain-of-thought templates, system prompt governance, and automated regression testing for prompt quality.

·         Evaluate LLM outputs systematically using RAGAS, DeepEval, or custom evaluation harnesses; track quality metrics across model versions and prompt iterations.

·         Implement multilingual NLP capabilities for Indian-language enterprise content (Hindi, Marathi) where required by government and public-sector customers.

·         Collaborate with the AI Platform Engineer to deploy NLP microservices at scale, ensuring latency SLOs are met for interactive RubiAI copilot responses.

Nice to Have

·         Experience with structured output generation (JSON mode, grammar-constrained decoding) for reliable LLM integration with enterprise data systems.

·         Knowledge of speech-to-text or multimodal models relevant to voice-driven analytics interfaces.

·         Exposure to LLM safety, alignment, and responsible AI practices for regulated-sector deployments.

·         Contribution to open-source NLP or LLM tooling (HuggingFace, LangChain, LlamaIndex, or equivalent).

 

 

 

About Rubiscape

Rubiscape is India’s leading Decision Intelligence Platform, unifying data engineering, BI, machine learning, and agentic AI in a single governed platform. Built in Pune and trusted by Fortune 500 enterprises across BFSI, manufacturing, healthcare, and government. 8 international innovation patents. 10 Industry-Academia Labs & COEs. From BI to AI — One Platform. Every Decision.



RequirementsRequirements

·         3+ years of NLP engineering experience with demonstrable production deployments; at least 1 year working with large language models in a product context.

·         Deep proficiency with HuggingFace Transformers, Datasets, and PEFT libraries for model fine-tuning and evaluation.

·         Hands-on experience with RAG pipeline construction using LangChain or LlamaIndex and at least one vector store (Weaviate, Qdrant, Chroma, or pgvector).

·         Strong Python skills and familiarity with model serving for NLP workloads (ONNX, TorchServe, vLLM, or Text Generation Inference).

·         Solid understanding of LLM evaluation methodology: benchmark construction, human preference alignment, and hallucination mitigation strategies.

·         Bachelor’s or Master’s degree in Computer Science, Computational Linguistics, or a related field.



Skills Required

  • 3+ years of NLP engineering experience with demonstrable production deployments
  • At least 1 year of experience working with large language models in a product context
  • Deep proficiency with HuggingFace Transformers, Datasets, and PEFT libraries
  • Hands-on experience constructing RAG pipelines using LangChain or LlamaIndex
  • Experience with at least one vector store: Weaviate, Qdrant, Chroma, or pgvector
  • Strong Python skills
  • Familiarity with NLP model serving using ONNX, TorchServe, vLLM, or Text Generation Inference
  • Understanding of LLM evaluation methodology, benchmark construction, human preference alignment, and hallucination mitigation
  • Bachelor’s or Master’s degree in Computer Science, Computational Linguistics, or a related field
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Pune
30 Employees
Year Founded: 2018

What We Do

Rubiscape is a decision intelligence platform that unifies business intelligence, analytics, data science, and artificial intelligence in one place, helping organizations move from BI to AI. Its technology and product-development work spans AI-focused development, software engineering, product management, agile delivery, security operations, and DevOps, reflecting a software platform mission centered on enabling data-driven decisions across modern organizations.

Similar Jobs

LogicMonitor Logo LogicMonitor

Senior Performance Specialist

Artificial Intelligence • Cloud • Information Technology • Machine Learning • Software
Easy Apply
Hybrid
2 Locations
1100 Employees

Morningstar Logo Morningstar

Associate Finance Analyst II

Artificial Intelligence • Big Data • Enterprise Web • Fintech • Software • Financial Services
Hybrid
Mumbai, Maharashtra, IND
11500 Employees

JPMorganChase Logo JPMorganChase

Controller

Financial Services
Hybrid
Mumbai, Maharashtra, IND
289097 Employees
Hybrid
Mumbai, Maharashtra, IND
289097 Employees

Similar Companies Hiring

Revel Thumbnail
Aerospace • Hardware • Robotics • Software
Marina Del Rey, California
60 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
30 Employees
Vega Thumbnail
Artificial Intelligence • Automotive • Insurance • Transportation
US
43 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account