AI Research Engineer

Datadog is the leading observability and security platform for the AI era, providing businesses with unified visibility across the technology stack to manage complexity at scale.

• Build and operate multimodal data pipelines, training and evaluation infrastructure, benchmarks, and internal tooling.
• Implement models, run experiments at scale, and profile for reliability, performance, and cost.
• Build simulation environments and replay infrastructure for agent training and evaluation.
• Orchestrate distributed training and distributed RL with Ray, including scheduling, scaling, and failure recovery.
• Establish rigorous automated benchmarks and regression tests for world model predictions, agent performance, and simulation fidelity.
• Collaborate with Research Scientists, Product, and Engineering to integrate capabilities into Datadog's products and to harden prototypes into reliable services.
• Contribute to research publications at top-tier conferences (e.g., NeurIPS, ICLR, ICML), and produce high-quality code, documentation, and open-source artifacts.

• You have depth in distributed computing, RL Infra, and ML systems for training and inference at scale; experience with Ray, Slurm, or similar frameworks is a plus.
• You are proficient in Python, familiar with a systems language (e.g., Rust, C++, or Go), and comfortable with modern cloud and data infrastructure.
• You have practical experience implementing and operating ML training and inference systems (e.g., PyTorch or JAX), including containerization, orchestration, and GPU acceleration.
• You have practical experience with large-scale model training and fine-tuning, including frameworks like Megatron-LM, DeepSpeed, SkyRL, VeRL, or TorchTitan, and techniques such as SFT, RLVR, RLHF, and efficient inference (quantization, speculative decoding).
• You can explain design and performance trade-offs clearly to both technical and non-technical audiences.
• You have experience supporting or contributing to research publications.

• Competitive global benefits.
• New hire stock equity (RSUs) and employee stock purchase plan (ESPP).
• Opportunity to collaborate closely with colleagues across the Datadog offices in New York City and Paris.
• Opportunity to attend and present at conferences and meetups.
• Intra-departmental mentor and buddy program for in-house networking.
• An inclusive company culture, ability to join our Community Guilds (Datadog employee resource groups).