About the company
Anyscale is commercializing Ray, a popular open-source project creating an ecosystem of libraries for scalable machine learning. Backed by Andreessen Horowitz, NEA, and Addition with $250+ million raised to date.
Responsibilities
- Define and drive the multi-year technical roadmap for services that orchestrate Ray clusters across diverse cloud and on-premises environments
- Lead the design and optimization of high-performance control plane components for large-scale, heterogeneous AI/ML workloads
- Establish organization-wide standards for reliability, scalability, and observability of Anyscale-managed infrastructure
- Direct the long-term strategy for accelerator integration (GPUs, TPUs) and container management
- Lead complex design and architecture discussions, resolving deep technical debt
- Partner with ML experts and customer-facing teams to translate market needs into robust infrastructure foundations
Requirements
- 5+ years of experience writing high-quality production code and leading complex distributed systems projects
- Proven track record designing and maintaining highly available, scalable, and secure cloud-native platforms (AWS, Azure, or GCP)
- Deep expertise in Kubernetes-based deployments and container orchestration at massive scale
- Advanced knowledge of Linux kernel, networking, and low-level operating system foundations
- Mastery of Go and Python
- Demonstrated ability to mentor senior engineers and influence technical direction
Conditions
- Competitive salary and equity, plus health/dental/vision coverage (many plans up to 99% employer-covered)
- Flexible time off, paid parental leave, and mental health support