Gen AI Engineer

Sorry, this job was removed at 08:20 p.m. (UTC) on Friday, Sep 11, 2026
Be an Early Applicant
5 Locations
In-Office
Entry level
Artificial Intelligence • Consulting
The Role
Designs and delivers production-grade generative AI solutions using LLMs, RAG, agentic workflows, and Azure services. Responsibilities include architecture, development, testing, deployment, evaluation, observability, guardrails, cost optimization, and maintenance. The role translates business problems into measurable AI outcomes, develops reusable frameworks, collaborates with stakeholders, contributes to proposals and proofs of concept, and supports responsible AI practices, knowledge sharing, code reviews, and mentorship.
Summary Generated by Built In

It's fun to work in a company where people truly BELIEVE in what they are doing!

We're committed to bringing passion and customer focus to the business.

Job Description: Gen AI Engineer

Responsibilities:

  • Design, develop, and implement advanced solutions leveraging Large Language Models (LLMs).
  • Take full ownership of initiatives, delivering end-to-end solutions with minimal supervision.
  • Stay current with the latest advancements in Generative AI, LLMs, RAG systems, and applied research.
  • Build and maintain reusable code libraries, tools, and frameworks to accelerate AI development.
  • Participate in code reviews to ensure high-quality, maintainable, and scalable solutions.
  • Contribute across the entire software development lifecycle—design, implementation, testing, deployment, and maintenance.
  • Collaborate with cross-functional teams to align AI solutions with business goals, integrate contributions into core systems, and influence roadmaps.
  • Apply strong analytical and problem-solving skills to design efficient solutions for complex business challenges.
  • Communicate effectively across technical and non-technical teams, ensuring transparency and alignment.
  • Own business impact of AI solutions, including adoption, accuracy, latency, and cost efficiency
  • Translate ambiguous business problems into structured AI solution approaches and measurable outcomes
  • Drive solution success metrics (e.g., productivity gains, automation %, decision accuracy)
  • Engage directly with business and technical stakeholders to understand requirements, present solutions, and influence decision-making
  • Communicate solution architecture and trade-offs clearly to both technical and non-technical audiences
  • Contribute to client discussions, PoCs, and proposal development.
  • Design scalable, modular, and production-grade AI systems (APIs, pipelines, orchestration layers)
  • Define architecture patterns for LLM applications (RAG pipelines, agentic workflows, hybrid systems)
  • Make trade-offs across latency, cost, accuracy, and maintainability
  • Build reusable accelerators, frameworks, and components that can be leveraged across multiple use cases and clients
  • Contribute to internal IP creation (assets, templates, reference architectures)
  • Ensure reliability and robustness of LLM systems through evaluation frameworks, guardrails, and fallback strategies
  • Design safe and responsible AI systems (hallucination mitigation, bias handling, governance)
  • Optimize cost-performance trade-offs in large-scale deployments
  • Identify when NOT to use LLMs and propose alternative approaches
  • Contribute to code reviews, design reviews, and mentorship of junior team members
  • Drive quality standards and best practices across projects
  • Stay ahead of advancements in GenAI and proactively evaluate their applicability to business problems
  • Contribute to internal knowledge sharing, training, and capability building.

Must-Have Skills:

Generative AI & NLP:

  • SaaS-based LLMs: LangChain, LlamaIndex, vector databases, prompt engineering (CoT, ReAct, agents), Azure OpenAI function calling, multimodal models.
  • Open-Source and SaaS LLMs: Azure OpenAI, Claude Opus 4.6, GPT-3.5 Turbo, GPT-4, etc.
  • At least one agentic Generative AI framework: CrewAI, AutoGen, LangGraph, n8n, LangFlow, SmolAgents, Semantic Kernel.
  • Advanced Retrieval-Augmented Generation (RAG) systems: hybrid retrieval, knowledge graph–based retrieval, multi-hop RAG, hierarchical/contextual retrieval strategies, evaluation/monitoring of RAG pipelines.
  • Classical NLP: text classification, topic modeling, Q&A systems, conversational AI/chatbots, search, Document AI, summarization, content generation, and Named Entity Recognition (NER).
  • Databricks ecosystem: Databricks Genie, Databricks AI/BI, AgentBricks
  • MS Copilot Studio and knowledge on no-code/low-code app development.
  • MCP server, tools, skills and creation and maintenance of reusable components.

Tech Stack:
Programming & Frameworks: Python, FastAPI
Cloud & DevOps: Azure DevOps, Agile (Azure Boards)
AI/ML Tools: Azure Databricks, MLFlow Model Lifecycle Management, Unity Catalog (Azure Databricks)
Cloud Services: Azure Function Apps, Azure Blob Storage, Azure Cognitive Services, Azure AI Search
Productivity Tools: Microsoft Copilot Studio (basic)

Good-to-Have Skills:

Ops & Engineering:
AgentOps / LLMOps:
Agent monitoring, evaluation, and debugging frameworks.
LLM observability and tracing (LangSmith, LangFuse,  Weights & Biases ).
Prompt/version management and experimentation.
Governance, compliance, and cost optimization for LLMs.
CI/CD pipelines in Azure DevOps.
Flask, Docker.
Other AI/ML Skills:
Document digitization and OCR methods.
Azure Document Intelligence or equivalent.
Azure Delta Lake.
Behavioral Competencies
Flexible to contribute to ad-hoc initiatives such as PoCs, solution prototyping, and proposal workflows.
Open to working on non-GenAI AI/ML projects (e.g., computer vision, document digitization, data structuring, brainstorming for business use cases).
Proactive in providing timely updates and driving tasks to completion.
Demonstrates responsibility, accountability, curiosity, and an innovative mindset.
Willingness to learn and understand the business context (e.g., Philips domain and data landscape) beyond core technical skills.

If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us!

Not the right fit?  Let us know you're interested in a future opportunity by clicking Introduce Yourself in the top-right corner of the page or create an account to set up email alerts as new job postings become available that meet your interest!

Skills Required

  • Experience designing, developing, and implementing solutions leveraging large language models and generative AI
  • Experience with LangChain, LlamaIndex, vector databases, and prompt engineering
  • Experience with Azure OpenAI, including function calling and multimodal models
  • Experience with at least one agentic generative AI framework, such as CrewAI, AutoGen, LangGraph, n8n, LangFlow, SmolAgents, or Semantic Kernel
  • Advanced retrieval-augmented generation experience, including hybrid retrieval, knowledge graph retrieval, multi-hop RAG, hierarchical or contextual retrieval, and RAG evaluation
  • Classical NLP experience, including text classification, topic modeling, question answering, conversational AI, search, Document AI, summarization, content generation, and named entity recognition
  • Experience with Databricks Genie, Databricks AI/BI, and AgentBricks
  • Knowledge of Microsoft Copilot Studio and no-code or low-code application development
  • Experience creating and maintaining MCP servers, tools, skills, and reusable components
  • Proficiency in Python and FastAPI
  • Experience with Azure DevOps and Agile development using Azure Boards
  • Experience with Azure Databricks, MLflow model lifecycle management, and Unity Catalog
  • Experience with Azure Functions, Azure Blob Storage, Azure Cognitive Services, and Azure AI Search
  • Ability to design scalable, modular, production-grade AI systems, including APIs, pipelines, and orchestration layers
  • Ability to implement LLM reliability, evaluation, monitoring, guardrails, fallback strategies, governance, and responsible AI practices
  • Strong analytical, problem-solving, communication, collaboration, and stakeholder management skills
  • Experience with AgentOps or LLMOps, agent monitoring, evaluation, debugging, observability, and tracing
  • Experience with LangSmith, LangFuse, or Weights & Biases
  • Experience with prompt and version management, experimentation, governance, compliance, and LLM cost optimization
  • Experience building CI/CD pipelines in Azure DevOps
  • Experience with Flask and Docker
  • Experience with document digitization, OCR, Azure Document Intelligence, or equivalent tools
  • Experience with Azure Delta Lake
  • Willingness to contribute to non-generative AI/ML projects, proofs of concept, solution prototyping, and proposal workflows
  • Willingness to learn business context and data landscapes

Fractal Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Fractal and has not been reviewed or approved by Fractal.

  • Healthcare Strength Health coverage includes medical, dental, and vision along with tax‑advantaged accounts and EAP in the U.S., indicating a broad core package. Feedback suggests core protections exist across regions, though specifics can vary by location.
  • Leave & Time Off Breadth Time‑off programs include generous PTO, paid holidays and sick time, paid volunteer time, and sabbaticals in some areas. Some accounts also describe manager‑approved or flexible PTO approaches alongside hybrid/WFH latitude.
  • Flexible Benefits Work arrangements commonly include remote/hybrid options and flexible schedules. Flexibility is frequently highlighted as part of the overall value proposition.

Fractal Insights

Similar Jobs

Citi Logo Citi

Artificial Intelligence Engineer

Fintech • Financial Services
In-Office
Pune, Mahārāshtra, IND
223850 Employees

Citi Logo Citi

Artificial Intelligence Engineer

Fintech • Financial Services
In-Office
Pune, Mahārāshtra, IND
223850 Employees

Coditation Logo Coditation

Application Engineer

Artificial Intelligence • Machine Learning • Software
In-Office
Pune, Mahārāshtra, IND
104 Employees
Remote or Hybrid
2 Locations
3661 Employees
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: New York, NY
5,262 Employees

What We Do

Fractal is one of the most prominent players in the Artificial Intelligence space. Fractal's mission is to power every human decision in the enterprise and brings AI, engineering, and design to help the world's most admired Fortune 500® companies. Fractal's products include Qure.ai to assist radiologists in making better diagnostic decisions, Crux Intelligence to assists CEOs, and senior executives make better tactical and strategic decisions, Theremin.ai to improve investment decisions, and Eugenie.ai to find anomalies in high-velocity data & Samya.ai to drive next-generation Enterprise Revenue Growth Management. Fractal has more than 3,000 employees across 16 global locations, including the United States, UK, Ukraine, India, Singapore, and Australia. Fractal has consistently been rated as India's best companies to work for, by The Great Place to Work® Institute, featured as a leader in Customer Analytics Service Providers Wave™ 2021, Computer Vision Consultancies Wave™ 2020 & Specialized Insights Service Providers Wave™ 2020 by Forrester Research, and recognized as an "Honorable Vendor" in 2021 Magic Quadrant™ for data & analytics by Gartner.

Similar Companies Hiring

Kepler  Thumbnail
Artificial Intelligence • Fintech • Software
New York, New York
9 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software • Productivity
US
15 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account