Staff Software Engineer - AI Compute, Together Cloud

Together AI is developing an advanced AI cloud platform that integrates high-speed GPU inference engines with state-of-the-art cloud infrastructure. The engineering team focuses on creating scalable, reliable, and high-performance systems that support generative AI workflows, including inference, reinforcement learning, and model fine-tuning. The platform powers both internal SaaS products and external cloud services, serving a broad range of AI applications across multiple data centers.

The role of a Staff Software Engineer in this team involves leading the design and implementation of core virtualization and infrastructure components. This includes managing GPU and network virtualization stacks, building data center provisioning services, and designing global management systems for capacity and fault tolerance. The engineer will set technical standards, guide cross-team collaboration, and contribute to the architecture of a greenfield data center with thousands of GPUs.

Candidates should have extensive experience in distributed systems, cloud infrastructure, and high-performance computing. Proficiency in backend programming, especially Golang, and deep knowledge of virtualization, networking, and storage technologies are essential. The role requires strong leadership skills to mentor engineers, lead design reviews, and communicate complex technical concepts effectively. Work is primarily remote, with the opportunity to influence the future of AI cloud infrastructure.