Infrastructure Engineer, Data Platform

Together AI is hiring a Infrastructure engineer to own and operate the data platform that powers our rapidly scaling data platforms. In this role, you will be the primary engineer responsible for defining, building, and maintaining the AWS infrastructure that underpins data engineering systems across the company — from internal analytics pipelines to customer-facing metering and billing systems.

You will work closely with multiple data engineering teams, enabling them to move faster by building reliable, secure-by-default infrastructure they can depend on. You’ll partner with our dedicated security engineering team to ensure best practices around IAM, network design, and data lake access — while focusing on platform reliability, scalability, and developer experience.

This is a high-ownership, hands-on engineering role. You’ll manage everything from Terraform modules and CI/CD pipelines to Lake Formation permissions and observability tools — with a mandate to build infrastructure that just works, and keeps working.

• Own the design, implementation, and operation of all AWS-based infrastructure supporting data systems
• Build and maintain reproducible, well-documented Terraform infrastructure modules
• Collaborate with multiple data engineering teams to understand and support their infrastructure needs
• Implement and maintain IAM policies and Lake Formation permissions in partnership with the security engineering team
• Build internal tooling and automation to support self-service infra provisioning
• Monitor infrastructure health and cost, and drive continuous improvements in reliability and efficiency
• Serve as the point person for infrastructure questions, issues, and requests across the company’s data platforms

• 5+ years of experience in infrastructure, SRE, or DevOps roles
• Deep experience with Terraform and AWS infrastructure design, including VPCs, IAM, S3, EC2, etc.
• Experience with access control and permissions in AWS, including Lake Formation or similar
• Experience supporting data infrastructure or working alongside data engineering teams (Kafka/Kinesis/ClickHouse a plus)
• Familiarity with CI/CD for infrastructure (GitHub Actions, TeamCity, ArgoCD, etc.)
• Proficiency in scripting or programming (Python, Go, or Bash preferred)
• Comfortable working autonomously and supporting multiple stakeholders
• Bonus: experience with Kubernetes, hybrid cloud/on-prem infrastructure, or cost optimization at scale

Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society, and together we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancement such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers and engineers in our journey in building the next generation AI infrastructure.

We offer competitive compensation, startup equity, health insurance and other competitive benefits. The US base salary range for this full-time position is: $160,000 - $260,000 + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Please see our privacy policy at https://www.together.ai/privacy