Top Tech Jobs & Startup Jobs

Design, build, and maintain a scalable internal LLM agent framework and backend services in Python. Ensure observability and reliability via metrics, tracing, and monitoring. Collaborate with ML/NLP teams to adapt the framework for customers, build automated LLM evaluation pipelines, and support integrations and parallel processing for production systems.

Build and maintain a scalable internal LLM agent framework and backend services in Python, ensuring observability, reliability, and parallel processing. Collaborate with ML/NLP teams, adapt the framework to customer use cases, and build automated LLM evaluation pipelines.

Build and maintain a scalable internal LLM agent framework, ensure observability and reliability with metrics/tracing/monitoring, adapt solutions for customer use cases with ML/NLP teams, build automated LLM evaluation pipelines, and design Python backend services using cloud-native architecture.

Design and iterate prompts and end-to-end conversational flows for AI agents. Analyze client processes, study transcripts, create training and test datasets, run prompt testing/QA and observability, develop evaluation methodologies, and refine agent performance with human-in-the-loop workflows.

Lead QA for an AI voice assistant across prompt/agent behavior, mobile/TV devices, and backend services. Perform manual end-to-end testing, analyze observability/tracing data, validate integrations (REST/gRPC), maintain test cases and bugs, collaborate with TPM/Prompt Engineers/Dev/ML, and serve as first-line QA for demos.

Lead QA for an AI voice assistant across prompts, agent behavior, mobile/TV devices, and backend services. Design and execute manual tests, analyze observability/traces, validate integrations (APIs, logs), and collaborate with engineering, ML, and prompt teams to maintain quality and prevent regressions. First-line QA ahead of demos and maintain test cases and bug reports.

Lead reliability and observability for a complex AI-agent platform: define SLIs/SLOs, build monitoring and dashboards, run load tests, handle incidents and on-call rotations, maintain Kubernetes-based infrastructure across cloud and on‑prem, mentor engineers, and support customer deployments.

Design and iterate prompts and conversational flows for LLM-based agents, analyze client business processes and conversation transcripts, create training/test datasets, and measure and improve AI agent performance.

Senior SRE responsible for reliability, observability, incident management, SLIs/SLOs, load testing, capacity planning, and Kubernetes-based infrastructure across cloud and on-prem. Build and maintain dashboards, automate operations with Python and IaC, run on-call rotations and postmortems, support customer deployments, and mentor teammates.

Lead DevSecOps engineer owning security and compliance implementation across infrastructure, CI/CD, Kubernetes, and cloud. Implement SOC 2/ISO controls in Drata, automate onboarding/offboarding and access reviews, drive SDLC security (SAST/SCA/secrets), run vulnerability management and incident response, and spend ~60% on infrastructure operations, monitoring, and on-call.