About the Company
Nebius is leading a new era in cloud infrastructure for the global AI economy. We are building a full-stack AI cloud platform that supports developers and enterprises from data and model training through to production deployment, without the cost and complexity of building large in-house AI/ML infrastructure.
Responsibilities
- Optimize LLM inference across various modalities to drive business value and support customer goals
- Provide support in supervised and reinforcement learning fine-tuning to maximize model quality for the customers
- Design and implement LLM-based solutions using Nebius Token Factory’s inference services
- Build production-ready applications leveraging our serverless LLM APIs, including multimodal models (text, vision, audio) and domain-specific models
- Provide technical expertise in prompt engineering, RAG architectures and model selection
- Collaborate with product and engineering teams to surface customer feedback and shape the platform roadmap
- Guide customers in scaling from POC to production with a focus on performance, reliability, and cost efficiency
Requirements
- 5+ years of experience in ML/AI systems, with at least 2 years focused on LLMs and generative AI
- Deep knowledge of the LLM ecosystem, including model architectures and fine-tuning approaches
- Hands-on experience with:
- Running LLMs in production: deploying and operating inference workloads
- LLM fine-tuning, including supervised fine-tuning (SFT/LoRA) and data preparation/curation; experience with RL-based fine-tuning is a strong plus
- LLM evaluation: building task-specific benchmarks and offline/online eval pipelines, including LLM-as-a-judge setups
- Inference frameworks and libraries (e.g., vLLM, SGLang, TensorRT-LLM, Transformers)
- Deploying LLM-powered applications using APIs from OpenAI, Anthropic, or open-source models
- Strong Python programming skills
- Excellent communication skills, with the ability to clearly explain technical concepts to diverse audiences
Conditions
- Health Insurance: 100% company-paid medical, dental, and vision coverage for employees and families
- 401(k) Plan: Up to 4% company match with immediate vesting
- Parental Leave: 20 weeks paid for primary caregivers, 12 weeks for secondary caregivers
- Remote Work Reimbursement: Up to $85/month for mobile and internet
- Disability & Life Insurance: Company-paid short-term, long-term, and life insurance coverage