The Role
Build and operate an AWS-based AI platform: develop internal services and SDKs, run and harden a model gateway, manage cloud compute/databases/containers/CI-CD, ensure security and observability, optimize costs, and provide documentation and support so teams can safely adopt AI.
Summary Generated by Built In
The Cloud Software Engineer builds and operates AWS-based platforms that help the company adopt AI safely and cost effectively. This is largely a greenfield role, with a basic gateway already in place but most of the platform still to be built. It is a hands-on builder and operator role for someone who enjoys writing software and running infrastructure, and who wants to help create the backbone for AI across the organization.
Core competencies
Responsibilities
Requirements
Nice to have
Core competencies
- Troubleshooting and diagnostics across distributed cloud systems
- Strong analytical and problem-solving ability
- Clear written and verbal communication
- Works well both independently and in cross-functional teams
- Comfortable juggling multiple systems and technologies at once
- Curiosity and enthusiasm for staying current with industry trends, especially in cloud and AI
- A track record of self-directed learning and adapting to new technical environments
- Ownership, reliability, and sound judgment
Responsibilities
- Build and ship internal applications, services, and shared libraries end to end from API to the data layer.
- Design, query, and tune our managed data platforms while keeping schemas, migrations, and query performance healthy.
- Maintain the internal SDK that routes apps through the model gateway, injects keys, and adds tracing and cost headers, so teams write less code and we keep control of prompts and guardrails.
- Run and harden the model gateway used by every team, including high availability across zones and clean dev, staging, and production environments.
- Build and operate the cloud services behind the platform, including container compute, managed databases, caching, storage, and secrets.
- Build and run the CI/CD pipelines, container registry, and monorepo tooling that every app depends on.
- Own platform security maintenance by patching CVEs and security findings quickly during business hours.
- Work with the Security team to implement core safety controls, including image and code scanning, secret scanning, access control, identity and sign-on, and audit logging.
- Keep the platform reliable and observable through logging, tracing, issue resolution, and steady improvement.
- Support cost visibility by tagging usage, building spend and chargeback views, and helping keep spend sensible.
- Write clear documentation and provide practical support so teams can adopt the platform without friction.
Requirements
- 4+ years of experience in software engineering, platform engineering, infrastructure engineering, or DevOps, with hands-on coding at the center of the role.
- Strong coding skills in at least two of TypeScript, JavaScript, Go, and Python, plus solid software fundamentals such as testing, code review, and clean API design.
- Solid database experience, including schema design, SQL, and query tuning, ideally with Postgres.
- Proven hands-on AWS experience, having built and run real services across compute, databases, networking, IAM, and common managed services.
- Experience with CI/CD pipelines, containers, and source control workflows.
- Hands-on comfort with LLM and AI tooling at the application level, including model APIs, prompts, retrieval, and guardrails. This is an AI-first platform, so working with these tools is core to the role.
- Comfortable owning security maintenance, including quickly patching CVEs and handling incidents during business hours.
- A good grasp of access control, identity, logging, and keeping systems secure.
Nice to have
- Deeper AI or agent experience, such as building agents, RAG systems, model gateways, or eval tooling.
- Experience with data tooling, including streaming, data lakes, Iceberg, Athena, or dbt.
- Frontend or full-stack experience, such as React or similar, for internal apps and dashboards.
- Experience running an API gateway or proxy layer, with attention to rate limits, routing, and budgets.
- Familiarity with security tooling, including scanning, findings aggregation, and guardrails.
Skills Required
- 4+ years of experience in software, platform, infrastructure engineering, or DevOps with hands-on coding
- Strong coding skills in at least two of TypeScript, JavaScript, Go, and Python
- Solid database experience including schema design, SQL, and query tuning (ideally Postgres)
- Proven hands-on AWS experience across compute, databases, networking, IAM, and managed services
- Experience with CI/CD pipelines, containers, and source control workflows
- Hands-on comfort with LLM and AI tooling at the application level (model APIs, prompts, retrieval, guardrails)
- Ownership of security maintenance including patching CVEs and incident handling during business hours
- Good grasp of access control, identity, logging, and overall system security
- Familiarity with testing, code review, and clean API design practices
- Deeper AI or agent experience (building agents, RAG systems, model gateways, or eval tooling)
- Experience with data tooling (streaming, data lakes, Iceberg, Athena, or dbt)
- Frontend or full-stack experience (React or similar) for internal apps and dashboards
- Experience running an API gateway or proxy layer with rate limits and routing considerations
- Familiarity with security tooling including scanning and findings aggregation
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
Sembi empowers organizations with world-class solutions for product quality and security management. Our comprehensive suite of tools enhances testing, strengthens security, and ensures superior product performance. Focused on automation, enterprise-scale capabilities, and AI readiness, Sembi is shaping the future of software quality for over 20,000 customers worldwide. Learn more at https://www.sembi.com/.
