Research Engineer

Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F, led by Altimeter Capital, Conviction Partners, and Spark Capital.

• Build in-house tooling to support post-training of customer models.
• Train a wide spectrum of different model architectures with a variety of techniques efficiently and at scale.
• Work across the stack as a whole - systems-level concepts like Kubernetes, cgroups, storage systems, and networking topologies, as well as PyTorch distributed tensor computation, and GPU kernels.

• A deep understanding of modern ML techniques and tools for training transformers.
• Advanced experience in a tensor/array computation library like PyTorch, TensorFlow, Jax, or similar.
• A detailed understanding of transformer training parallelism strategies like data parallelism, sharded data parallelism, tensor parallelism, pipeline parallelism, context parallelism.
• The experience and knowledge to profile and improve the performance of a distributed GPU program in PyTorch or a similar library.
• The ability to perform roofline analysis on a transformer training setup.
• A willingness to dive into messy problems, work with researchers, derive specifications by asking important questions, and execute.
• Familiarity with HPC and distributed computing platforms like Slurm, Ray, Kubernetes, and Dask.
• Familiarity with cluster networking technology like Infiniband, RoCE, GPUDirect.
• Solid fundamentals in operating systems concepts like processes, files, kernel drivers, containerisation, and networking protocols.
• A sense of creativity and willingness to ask difficult questions about our approach, assumptions, and tooling choices.

• Competitive compensation, including meaningful equity.
• 100% coverage of medical, dental, and vision insurance for employee and dependents.
• Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!).
• Paid parental leave.
• Fertility and family-building stipend through Carrot.
• Company-facilitated 401(k).
• Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.