Jobs at Together AI

Design and operate multi-petabyte, high-performance storage for large-scale AI/HPC clusters. Architect parallel filesystems and object stores, build Kubernetes-native storage operators, optimize RDMA/InfiniBand and NVMe-based data paths for 10–50 GB/s per node, implement multi-tier caching and prefetching, ensure observability and 99.9%+ uptime, and collaborate with ML/SRE teams while driving cost and performance improvements.

As an AI Researcher, you will develop novel architectures and optimizations in machine learning, collaborating with teams to enhance open models and ensuring cutting-edge research practices.

As a Forward Deployed Engineer, you will optimize inference engines and guide customers in deploying AI models effectively, ensuring high-value outcomes and driving product improvements.

The Senior Backend Engineer will develop scalable backend services for an AI cloud platform, enhance existing systems, and partner with product teams, ensuring robust and efficient cloud services.

Design and build production systems for AI inference, optimize runtime services, and collaborate on AI solutions with researchers and engineers.

The Senior Data Engineer will build and operate data infrastructure for high-volume event processing, enhance scalability, and collaborate with product teams on analytics systems.

Develop systems and APIs for LLM inference and fine-tuning. Design production systems, collaborate with teams, and improve system efficiency.

The role involves designing and optimizing distributed inference engines for multimodal LLMs, ensuring high performance and cost efficiency.

The role involves developing and optimizing GPU-accelerated kernels for ML/AI applications, collaborating with teams to enhance AI systems' performance.

The Manager will analyze and benchmark compute infrastructure sourcing and operations, driving strategic decisions and optimizing resource allocation across sites and vendors.

Lead and manage a team of infrastructure engineers, design and build cloud services, and ensure system scalability and robustness.

The role entails optimizing model performance and developer experience through serverless inference platforms, distributed systems, and API development. Responsibilities include enhancing system robustness and scalability, partnering with product teams, and maintaining clean software and IaC.

The Staff Engineer will lead the architecture and development of Together's Customer Insights platform, focusing on analytics, event systems, and user workflows to enhance customer visibility and governance of AI workloads.

Translate RL and inference research into production systems to improve latency, throughput, cost, and model quality. Design and implement inference engines and scheduling, build RL/post‑training pipelines, profile and optimize GPU/network/memory performance, run scale experiments, and drive production roadmap and benchmarks. Provide technical leadership and mentor others.

The Senior Backend Engineer will optimize and build systems for the Inference Platform, focusing on low-latency, scalability, and performance for generative AI models. Responsibilities include enhancing request routing, developing auto-scaling systems, and collaborating with ML researchers to implement new model architectures in production.

Develop and maintain a global AI cloud infrastructure, focusing on high-performance backend services, IaaS software, and robust observability solutions.

As a Senior Backend Engineer, you will develop foundational backend services, enhance existing systems, and ensure scalability and robustness in a generative AI cloud platform.

The Product Marketing Director will lead the PMM function, develop go-to-market strategies, manage product launch calendars, and ensure effective cross-functional collaboration to drive product adoption and user growth.

The Director of Tax will develop global tax strategies, manage compliance, optimize tax rates, and lead international expansion efforts for a high-growth AI company.

Lead the architectural evolution of the Product UI Platform, enhancing performance, reliability, and scalability while collaborating across teams.