AI Software Engineer

Posted 2 Days Ago
Hiring Remotely in Virginia, USA
Remote
Entry level
Information Technology
The Role
Build and scale production enterprise AI applications using RAG, LLM integrations, agents, vector search, and prompt evaluation. Develop Python/FastAPI backends, React/Next.js frontends, real-time services, and database architectures. Deploy AI workloads with Docker, Kubernetes, CI/CD, cloud infrastructure, and Terraform. Implement monitoring, testing, security, observability, and cost optimization for reliable, scalable AI systems.
Summary Generated by Built In
Company Description

Oteemo is an industry-leading technology consulting firm at the forefront of cloud native, enterprise DevSecOps, and AI-driven transformation. We build intelligent, automated, secure systems for organizations tackling their toughest technical challenges and we're pushing the boundaries of what AI, generative AI, and agentic systems can do in production, not just in theory. Join us and you'll work alongside recognized experts on cutting-edge projects that blend cloud native architecture, extreme automation, and AI/ML at the core. We foster a dynamic, inclusive, and collaborative culture built on continuous learning, where your ideas shape real outcomes for our clients. If you're passionate about building what's next in AI and cloud technology and want to do it with a team that sets the standard rather than follows it, Oteemo is where you belong.

Job Description

We're seeking an exceptional AI Software Engineer to build and scale enterprise AI applications end to end from database to UI. In this role, you'll work with cutting-edge LLM technology, RAG systems, and production ML infrastructure, combining full-stack development expertise with hands-on AI/ML engineering to ship intelligent systems that deliver real business value at scale. You'll be a key technical contributor, shipping production-ready AI features that users love while ensuring reliability, performance, and cost-effectiveness.

Key Responsibilities:

  • Design and implement end-to-end RAG (Retrieval-Augmented Generation) pipelines for intelligent document search and question-answering across enterprise knowledge bases.
  • Build production-ready integrations with leading LLMs (GPT-4, Claude, Gemini) for accurate, contextual responses to user queries.
  • Develop prompt engineering strategies and evaluation frameworks to ensure consistent, high-quality AI outputs.
  • Create agent systems with tool integration capabilities that can autonomously complete complex tasks.
  • Implement vector search solutions using Pinecone, Weaviate, or similar technologies for semantic similarity and knowledge retrieval.
  • Build scalable backend services using Python/FastAPI with type-safe APIs, authentication, and robust error handling.
  • Develop responsive, performant frontend applications using React/Next.js with real-time streaming for LLM responses.
  • Design and optimize database schemas across PostgreSQL, MongoDB, and Redis to support high-throughput AI workloads.
  • Implement WebSocket servers and event-driven architectures for real-time user experiences.
  • Create comprehensive testing strategies covering unit, integration, and end-to-end tests.
  • Deploy and manage ML/AI services using Docker containers and Kubernetes orchestration.
  • Build and maintain CI/CD pipelines for rapid, safe deployment of AI features.
  • Implement infrastructure as code using Terraform to manage cloud resources (AWS, Azure, or GCP).
  • Set up monitoring and observability using Datadog, Prometheus/Grafana, and LLM-specific tools (LangSmith, Weights & Biases).
  • Optimize costs through intelligent caching, batching strategies, and model selection algorithms.
  • Ensure enterprise-grade security through authentication, authorization, secrets management, and compliance measures.

Qualifications

  • Expert-level proficiency in Python with modern frameworks (FastAPI, Flask).
  • Strong TypeScript/JavaScript skills with deep React and Next.js experience; proven track record designing and building RESTful and GraphQL APIs.
  • Solid understanding of relational (PostgreSQL, MySQL) and NoSQL (MongoDB) databases.
  • Experience with authentication systems (OAuth2, JWT, SSO) and security best practices.
  • Proven track record of shipping high-quality, scalable software to production.
  • Hands-on experience building and deploying AI/ML applications in production environments.
  • Deep understanding of LLM integration, prompt engineering, and context managemen.
  • Proven expertise with RAG systems, including document processing, chunking, embedding, retrieval, and generation.
  • Experience working with vector databases (Pinecone, Weaviate, Chroma, FAISS, or Qdrant).
  • Strong grasp of semantic search, similarity algorithms, and hybrid search techniques.
  • Knowledge of evaluation frameworks for assessing AI system quality and performance.
  • Production experience with Docker containerization and Kubernetes orchestration.
  • Strong knowledge of at least one major cloud platform (AWS, Azure, or GCP) and its AI services.
  • Experience building CI/CD pipelines for ML/AI application.
  • Proficiency with infrastructure as code tools (Terraform, CloudFormation, Pulumi).
  • Understanding of monitoring, logging, and alerting best practices; cost optimization experience for cloud and AI workloads.
  • Strong computer science fundamentals and algorithmic thinking.
  • Proficiency with Git workflows, code review practices, and collaborative development.
  • Excellent debugging and problem-solving skills.
  • Clear technical communication and documentation abilities.

Additional Information

All your information will be kept confidential according to EEO guidelines.

Skills Required

  • Expert-level proficiency in Python with FastAPI or Flask
  • Strong TypeScript and JavaScript skills with deep React and Next.js experience
  • Experience designing and building RESTful and GraphQL APIs
  • Solid understanding of PostgreSQL, MySQL, and MongoDB databases
  • Experience with OAuth2, JWT, SSO, and security best practices
  • Proven track record of shipping high-quality, scalable software to production
  • Hands-on experience building and deploying AI/ML applications in production
  • Deep understanding of LLM integration, prompt engineering, and context management
  • Proven expertise with RAG systems, including document processing, chunking, embedding, retrieval, and generation
  • Experience with Pinecone, Weaviate, Chroma, FAISS, Qdrant, or similar vector databases
  • Strong understanding of semantic search, similarity algorithms, and hybrid search techniques
  • Knowledge of evaluation frameworks for AI system quality and performance
  • Production experience with Docker and Kubernetes
  • Strong knowledge of AWS, Azure, or GCP and its AI services
  • Experience building CI/CD pipelines for ML/AI applications
  • Proficiency with Terraform, CloudFormation, Pulumi, or similar infrastructure-as-code tools
  • Understanding of monitoring, logging, alerting, and cost optimization for cloud and AI workloads
  • Strong computer science fundamentals and algorithmic thinking
  • Proficiency with Git workflows, code review, and collaborative development
  • Excellent debugging and problem-solving skills
  • Clear technical communication and documentation abilities
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Reston, VA
58 Employees
Year Founded: 2014

What We Do

We help enterprises unlock the power of modern technology to transform business through acceleration, enablement, and adoption. Let us help your enterprise connect its People, Process, Technology, Culture to enable reliable, secure innovation, agility, and resiliency. - Decrease DevSecOps cycle times from months to weeks - Accelerate software release rates - Ensure digital adoption across the enterprise - Increase ROI and reduce TCO Creds: CNCF (Cloud Native Compute Foundation) Member Certified Kubernetes Service Provider (KCSP) Certified Kubernetes for CNCF (KTP) Training Partner AWS Advanced Consulting Partner Let’s get started. Contact us to learn how we can help transform your digital supply chain at www.oteemo.com.

Similar Jobs

Toast Logo Toast

Staff Software Engineer

Cloud • Fintech • Food • Information Technology • Software • Hospitality
Remote
US
5000 Employees
193K-309K Annually

Liftoff Logo Liftoff

Software Engineer

AdTech • Artificial Intelligence • Big Data • Machine Learning • Marketing Tech • Mobile • Software
Easy Apply
Remote
United States
645 Employees
211K-270K Annually

Circle (circle.so) Logo Circle (circle.so)

Software Engineer

Artificial Intelligence • Consumer Web • Digital Media • Information Technology • Social Impact • Software
Easy Apply
Remote
31 Locations
250 Employees
130K-140K Annually

Deepgram Logo Deepgram

Senior Software Engineer

Artificial Intelligence • Machine Learning • Natural Language Processing • Software • Conversational AI
Remote
USA
150 Employees
180K-240K Annually

Similar Companies Hiring

Standard Template Labs Thumbnail
Artificial Intelligence • Information Technology • Software
New York, NY
25 Employees
NODA AI Thumbnail
Artificial Intelligence • Information Technology • Software • Cybersecurity
Sydney, AU
54 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account