Software Engineer, Storage Systems (Agent Infra)

Baseten's Agent Infra team develops Agent Drive, a specialized filesystem that supports numerous isolated agent sandboxes simultaneously. This infrastructure is designed to handle unique access patterns involving many small files, ensuring fast startup times and secure data sharing. The team operates from offices in San Francisco and New York with a hybrid work setup, focusing on rapid development cycles and significant ownership of their projects.

The role involves creating and refining key components of Agent Drive, such as metadata synchronization, data placement strategies, and cleanup processes. The engineer will tackle challenges related to maintaining consistency across multiple mounts, managing cache invalidation, and ensuring data integrity after crashes. Performance tuning for input/output operations and enforcing strict tenant boundaries are also critical responsibilities, alongside collaborating with other teams to enhance storage reliability and monitoring.

Ideal candidates have a strong background in low-level programming languages like Go, Rust, or C/C++, and possess deep knowledge of Linux filesystem mechanisms including virtual filesystems and FUSE interfaces. Experience with scalable caching solutions and handling concurrency issues is important. Additional familiarity with consensus algorithms, snapshotting techniques, and Linux diagnostic tools is advantageous. Baseten provides competitive pay, comprehensive benefits, and fosters an inclusive workplace culture.