Senior Backend Engineer(Gen AI)- Octopus by RTG

Octopus by RTG is enabling a key partner organization to build their digital hubs in Egypt and grow their tech teams around the world. We are currently looking for the right pioneers to work on exciting AI Projects with a key partner in Riyadh, KSA.

Octopus is proud to be part of the Robusta Technology Group (RTG), a leading tech group. With a decade of experience and a successful track record of delivering over 300 projects across Europe, the Middle East, and North America, RTG has established itself as a preferred employer in the Egyptian market. Octopus and Robusta are building a bridge between Europe and Africa, creating tailored hub solutions to connect companies with top talent across the globe.

Octopus is specialized in rapidly assembling remote & onsite global tech teams that are fully aligned with the culture and practices of a particular brand. By providing tailored hubs to suit its clients needs, Octopus gives companies all the advantages of remote work and offshoring without all the negatives.

Key Responsibilities:

• Design and implement scalable and distributed backend systems.
• Develop microservices and APIs using Spring Boot and Python frameworks.
• Integrate Large Language Models (LLMs) into backend workflows.
• Work across DevOps, cloud platforms, and CI/CD pipelines for deployment and monitoring.
• Collaborate with cross-functional teams to deliver robust and secure solutions.
• Optimize AI pipelines for latency, cost, and performance.
• Ensure backend systems meet industry standards for reliability, observability, and security.

Requirements:

• 5+ years of experience in backend development with scalable and distributed system design.
• Advanced expertise in Spring Boot (Java) – including Spring MVC, Security, Data JPA, and Spring Cloud.
• Strong command of Core Java concepts: OOP, exception handling, multithreading, collections, memory management, and Java 8+ features (streams, lambdas).
• Proficient in Python, with hands-on experience using FastAPI, Flask, or Django.
• Solid knowledge of Data Structures & Algorithms with real-world application in backend development.
• Proven experience building and maintaining microservices architectures: service discovery, API gateways, distributed tracing, fault tolerance, and rate limiting.
• Hands-on with Docker, Podman, and Kubernetes (Helm, auto-scaling, RBAC, Ingress, ConfigMaps, Secrets).
• Expertise in designing and securing RESTful APIs with OAuth2, JWT, and SSO.
• Strong database experience with PostgreSQL, MySQL, MongoDB, Redis, or DynamoDB.
• Experience with event-driven systems and message brokers like Kafka, RabbitMQ, or Pulsar.
• Familiar with CI/CD pipelines and DevOps practices using GitHub Actions, Jenkins, GitLab, etc.
• Experience in cloud platforms (AWS, GCP, Azure),
• Knowledge of observability tools: Prometheus, Grafana, ELK/EFK Stack, OpenTelemetry.

Hands-on experience with Generative AI:

•  Integrated LLMs (OpenAI, Claude, Cohere, LLaMA) into backend services.

•  Built prompt engineering logic and optimized for performance and hallucination reduction.
• Developed inference pipelines for large-scale and real-time AI applications.
• Worked with LangChain, LlamaIndex, Haystack for LLM orchestration.
• Used vector databases (Pinecone, FAISS, Weaviate, ChromaDB) in RAG pipelines.
• Experience with fine-tuning models using Hugging Face, LoRA, QLoRA.
• Knowledge of tokenization, cost/latency optimization, API limits.
• Built streaming outputs (SSE/WebSockets) for chatbots and summarizers.
• Implemented guardrails, moderation, and AI safety best practices.
• Exposure to LLMOps and multi-modal models (e.g., GPT-4 Vision, CLIP) is a plus.