Machine Learning Engineer, Fine-Tuning API

As an ML Engineer within the Fine-Tuning API team at Together AI, you will develop a platform that allows our users to customize open-source models with their data. You will collaborate with our product and research teams, developing features that will enable new use cases for the Fine-Tuning API. You will also work with the engineering team to ensure that our API is reliable and well-integrated into the company’s technical infrastructure. You will have an opportunity to build the foundational layer of the open-source AI ecosystem, letting developers all over the world efficiently create high-quality models tailored to their application scenarios.

• Build and improve Together’s systems and infrastructure for customizing open-source models
• Create tooling and documentation to set our users up for success with the Fine-Tuning API
• Make sure the service is stable and robust, participating in an on-call rotation and ensuring 24/7 availability of our platform
• Analyze and increase the efficiency of fine-tuning methods, both from research and engineering perspectives
• Develop new features and capabilities for the API based on latest research in AI

• Have 2+ years of experience building and deploying machine learning-based services in a production environment
• Have working knowledge of latest methods for fine-tuning LLMs or other AI models
• Have a strong software engineering background in Python or Go
• Are passionate about making reliable and convenient tools for software developers
• Follow latest advances and trends in the Machine Learning community

Experience in any of the following will make you stand out:

• Developing large-scale and high-load production systems
• Implementation and design of advanced methods for efficient fine-tuning
• Maintaining or contributing to open-source ML projects
• Managing machine learning workloads on Kubernetes clusters

Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society, and together we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancement such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers in our journey in building the next generation AI infrastructure.

We offer competitive compensation, startup equity, health insurance and other competitive benefits. The US base salary range for this full-time position is: $160,000 - $230,000 + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Please see our privacy policy at https://www.together.ai/privacy