Software Development Engineer - AI / LLM Systems (Python Backend)

Posted 8 Hours Ago
Be an Early Applicant
Hiring Remotely in India
Remote
23-30 Annually
Mid level
Artificial Intelligence • Information Technology • Software • Database • Automation
The Role
Build and maintain Python backend services integrating LLMs into production workflows. Design scalable APIs, async workflows, prompt management, model routing, response validation, monitoring, and automation. Debug distributed systems, collaborate cross-functionally, and contribute to architecture and engineering best practices for AI systems.
Summary Generated by Built In

Company: Volga Partners
Location: Fully Remote (Occasional office visits 1–2 times per year)
Compensation: ₹23–₹30 LPA (based on experience)
Job Type: Full-time, Project-Based
Project Duration: Until the end of September 2026
Start Date: Urgently hiring — must be available to start within 1–2 weeks
Work Hours: 8:00 AM – 5:00 PM IST or 9:00 AM – 6:00 PM IST
(Collaboration with USA Pacific Time teams)


About the Role 

Volga Partners is looking for a skilled Software Development Engineer with strong expertise in Python backend systems and AI/LLM applications. 

In this role, you will build and maintain production-grade AI-powered systems, integrating large language models into real-world workflows. You will work across backend services, orchestration layers, and data pipelines—ensuring that AI features are reliable, scalable, and performant. 

This is a hands-on engineering role requiring strong problem-solving, system design, and the ability to operate in fast-evolving AI environments. 


Key Responsibilities 

  • Build and maintain backend services and internal tools in Python for AI-powered applications.  
  • Integrate LLM APIs into production workflows, including prompt handling, response processing, validation, and retries.  
  • Design and implement scalable REST APIs, async workflows, and background job systems.  
  • Maintain and enhance components of a multi-language codebase (C#/C++, Python, web technologies) where applicable.  
  • Work with structured and unstructured data to prepare inputs, transform outputs, and support downstream systems.  
  • Develop systems for prompt management, model routing, response validation, and failure handling.  
  • Debug complex issues across backend logic, API integrations, and distributed services.  
  • Monitor system performance using telemetry tools and proactively identify and resolve bottlenecks.  
  • Automate recurring workflows related to data processing, evaluation, and reporting.  
  • Collaborate with cross-functional teams to turn ambiguous product ideas into production-ready features.  
  • Contribute to architecture decisions around scalability, performance, and safe use of AI systems.  
  • Write clean, testable, and maintainable code while helping establish engineering best practices for AI systems.  

What You Bring 

Education 

  • Bachelor’s degree in Computer Science or a related field.  

Experience 

  • 3+ years of professional experience in backend or systems engineering.  
  • Strong experience in Python development for production systems.  
  • Experience integrating LLM APIs or AI-driven services into real applications.  
  • Proven ability to work within large codebases and collaborative environments.  

Technical Skillset 

Core Skills 

  • Python (strong), backend system design, API development  
  • Async workflows, job queues, and service orchestration  
  • Debugging across APIs, services, and data pipelines  

Languages 

  • Python, C#, C/C++, JavaScript/TypeScript, SQL  

Frameworks & Libraries 

  • .NET Web API, ASP.NET (MVC & WebForms), Entity Framework  
  • React, Bootstrap, Ajax  
  • Testing frameworks (xUnit or similar)  

AI / LLM Systems 

  • Prompt design, response parsing, and guardrails  
  • Model integration patterns and failure handling  
  • Understanding of LLM limitations and production constraints  

Tools & Platforms 

  • Azure DevOps, Git, Docker, Terraform  
  • SQL Server or similar databases  
  • Elastic Stack, Postman, Swagger  
  • AWS or Azure cloud environments  

Architecture 

  • Microservices, distributed systems, modular architectures  

Operating Systems 

  • Windows, Linux  

Build Tools 

  • Make, Ninja (preferred)  

Nice to Have 

  • Experience with RAG, embeddings, vector databases, or retrieval systems  
  • Familiarity with agent workflows or multi-step orchestration  
  • Experience with model monitoring, prompt versioning, or evaluation systems  
  • Understanding of AI safety, privacy, and secure data handling  
  • Exposure to cloud-native deployments and scalable infrastructure  

Why Join Us 

  •  Remote-first culture with minimal in-person requirements  
  •  Work with global teams on cutting-edge AI systems  
  •  Opportunity to build real-world LLM applications at scale  
  •  High ownership, fast-moving environment with strong growth potential 

Skills Required

  • Bachelor's degree in Computer Science or related field
  • 3+ years professional experience in backend or systems engineering
  • Strong Python development experience for production systems
  • Experience integrating LLM APIs or AI-driven services into production applications
  • Experience designing and implementing REST APIs, async workflows, and background job systems
  • Ability to work within large/multi-language codebases (C#/C++, Python, web technologies)
  • Experience with Git, Docker and cloud environments (AWS or Azure)
  • Experience with SQL Server or similar relational databases
  • Experience with prompt design, response parsing, and production guardrails for LLMs
  • Experience with RAG, embeddings, vector databases, agent workflows, model monitoring, or prompt versioning
  • Familiarity with .NET Web API, ASP.NET, Entity Framework, React and front-end/web technologies
  • Familiarity with Terraform, Azure DevOps, Elastic Stack, Postman, Swagger, Make/Ninja build tools
  • Understanding of AI safety, privacy, and secure data handling
  • Available to start urgently (within 1-2 weeks) and work IST hours
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Kirkland, Washington
396 Employees
Year Founded: 2020

What We Do

Working with forward looking technology visionaries to help achieve their company goals in a reliable manner using ever changing technology needs. On-shore and off-shore product solutions, ML/AI testing, audit and content moderation using a global workforce in all major languages. Volga Partners provides AI optimization services and AI solutions which focuses on engineering services and data to both big tech and other industries. Customer support with fully integrated call center and chat support using tone recognition and generative AI LLMs. We partners to deliver success to all stakeholders

Similar Jobs

Mondelēz International Logo Mondelēz International

EOP O9 Global Test Lead

Big Data • Food • Hardware • Machine Learning • Retail • Automation • Manufacturing
Remote or Hybrid
Mumbai, Maharashtra, IND
90000 Employees

Mondelēz International Logo Mondelēz International

Organization Capability Specialist

Big Data • Food • Hardware • Machine Learning • Retail • Automation • Manufacturing
Remote or Hybrid
India
90000 Employees

Tufin Logo Tufin

Senior Data Scientist

Security • Cybersecurity
Remote or Hybrid
India
500 Employees

Motive Logo Motive

Product Manager

Artificial Intelligence • Fintech • Hardware • Information Technology • Sales • Software • Transportation
Easy Apply
Remote
India
4000 Employees

Similar Companies Hiring

Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account