We are looking for an experienced Senior LLM Engineer to build an AI-powered data intelligence platform that enables users to interact with multiple enterprise data sources through natural language.
This role focuses on designing and implementing Retrieval-Augmented Generation (RAG) solutions, semantic search, and conversational AI experiences powered by AWS Bedrock. You will build scalable AI pipelines capable of retrieving, processing, and synthesizing information from multiple structured and unstructured data sources into an intuitive chatbot experience.
The ideal candidate has strong experience building Generative AI applications, designing RAG architectures, and working with vector search, embeddings, and cloud-native AI services.
Key Responsibilities:
- Design and implement Retrieval-Augmented Generation (RAG) architectures.
- Build AI-powered chatbot experiences using AWS Bedrock.
- Develop multi-source data ingestion and retrieval pipelines.
- Design and optimize embeddings and semantic search strategies.
- Build scalable vector search solutions for enterprise knowledge retrieval.
- Integrate structured and unstructured data sources into AI workflows.
- Develop prompt engineering strategies to improve response quality and accuracy.
- Build cloud-native AI services using AWS.
- Collaborate with engineering teams to improve AI performance, scalability, and reliability.
- Continuously evaluate new AI technologies and best practices for enterprise LLM applications.
Requirements:
- 5+ years of professional software engineering experience.
- Strong Python development experience.
- Hands-on experience building Generative AI applications.
- Experience working with AWS cloud services.
- Strong understanding of Retrieval-Augmented Generation (RAG).
- Experience building scalable backend applications.
- Strong analytical and problem-solving skills.
- Experience working in Agile environments.
- Strong written and verbal English communication skills.
Must Have:
- Strong Python development experience.
- Hands-on experience with AWS Bedrock.
- Experience building Retrieval-Augmented Generation (RAG) solutions.
- Experience working with:
- Embeddings
- Vector Search
- Semantic Search
- Experience building AI-powered chatbot applications.
- Experience designing multi-source data ingestion pipelines.
- Experience working with S3 Data Lakes.
- Strong Prompt Engineering experience.
- Experience integrating multiple enterprise data sources.
- Strong understanding of Large Language Models (LLMs).
- Experience designing scalable AI architectures.
Nice to Have:
- Experience with:
- LangChain
- LlamaIndex
- Pinecone
- Weaviate
- OpenSearch Vector
- ChromaDB
- FAISS
- Experience building conversational AI applications.
- Experience with enterprise knowledge management systems.
- Experience with API Gateway.
- Experience with EventBridge or SQS.
- Experience with Infrastructure as Code.
- Experience optimizing LLM performance and retrieval quality.
- Experience with connected TV (CTV), AdTech, or advertising analytics platforms.
Skills Required
- 5+ years of professional software engineering experience
- Strong Python development experience
- Hands-on experience with AWS Bedrock
- Hands-on experience building Generative AI applications
- Experience working with AWS cloud services
- Strong understanding of Retrieval-Augmented Generation (RAG)
- Experience building scalable backend applications
- Experience designing and optimizing embeddings and semantic search strategies
- Experience building scalable vector search solutions
- Experience integrating structured and unstructured enterprise data sources
- Experience designing multi-source data ingestion and retrieval pipelines
- Experience working with S3 Data Lakes
- Strong prompt engineering experience
- Strong understanding of Large Language Models (LLMs)
- Experience working in Agile environments
- Strong written and verbal English communication skills
- Experience with LangChain, LlamaIndex, Pinecone, Weaviate, OpenSearch Vector, ChromaDB, or FAISS
- Experience with API Gateway, EventBridge, or SQS
- Experience with Infrastructure as Code
- Experience optimizing LLM performance and retrieval quality
What We Do
We are on a mission to give every company, no matter the size, the opportunity to innovate and help build a better future. Our Services: Dedicated Tech (full/partial) Squads: we create multi-disciplinary, remote (near-shore) Tech Squads that become part of your team. They adapt to your workflows and are trained on Agile methodologies to deliver continuous value. We believe that well-trained remote teams bring clients the opportunity to increase innovation output by accessing a greater / more diverse pool of talent, while reducing the cost of development. On-Demand Software Development: at our core, we are software developers excited about building digital products and solutions using the latest technologies and agile methodologies. We provide end-to-end capabilities to deliver on your technical requests. Product Management, Tech Architecture, Front / Back End Development, Devops & QA Venture Building: we partner with companies to co-launch new digital businesses that leverage core assets of the company (distribution channels, customer base, industry knowledge, proprietary technology, etc). We take the co-created ideas into MLP’s (Most Lovable Product) aiming to find product market fit and scale in the leanest possible way. As startup founders ourselves, we love getting things from 0 to 1. We are End-To-End Innovation Enablers, helping your company unlock it's full innovation potential.
