About the company
Nebius is building a full-stack AI cloud platform for the global AI economy, supporting developers and enterprises from data and model training through production deployment. The company builds infrastructure across compute, storage, networking and applied AI, and is listed on Nasdaq (NBIS). It is headquartered in Amsterdam, with R&D hubs across Europe, the UK, North America and Israel. Its team of 1,500+ includes hundreds of engineers specializing in hardware, software and AI R&D.
The product is an agent-native search platform providing programmatic, low-latency, observable search APIs for AI agents to retrieve, filter and reason over real-world information at scale.
Responsibilities
- Design, implement and operate large-scale indexing systems and data pipelines at the core of search infrastructure.
- Develop and optimize indexing strategies balancing performance, freshness and resource efficiency.
- Work on storage formats, compaction strategies and update mechanisms to keep data accessible and current.
- Ensure pipeline reliability and predictability under high-throughput conditions.
- Build well-tested components with clear responsibilities and interaction contracts that can evolve with the system.
- Define and implement observability primitives, including structured logs, metrics and data-quality signals across offline and nearline pipelines.
- Monitor throughput, resource usage and cost, and drive optimizations as business needs require.
- Collaborate with runtime and ML teams to ensure indexing outputs meet retrieval and ranking requirements.
- Enable safe experimentation on indexing strategies and data-processing logic through controlled rollouts and clearly defined quality signals.
- Build systems to ingest, process and organize massive volumes of data into efficient, queryable structures, supporting downstream retrieval systems and datasets that evolve continuously.
Requirements
- 8+ years of experience building production backend or data-infrastructure systems.
- Strong Go experience; C++ or Rust is a plus.
- Experience with large-scale data-processing systems, including 10+ GiB/sec throughput and petabyte-scale datasets.
- Experience building or operating databases, storage systems, data planes or indexing pipelines.
- Strong understanding of distributed systems, fault tolerance, consistency and scalability.
- Experience running production systems and handling operational incidents.
- Systems-thinking mindset and ability to reason about end-to-end data flows.
- Additional relevant experience may include distributed data-processing frameworks such as Spark, Flink, MapReduce or Beam; content systems including scraping, proxying or anti-bot infrastructure; ad tech, social networks or other large-scale content platforms; DBMS internals (open source or SaaS) and cloud infrastructure; open-source contributions or engineering-community involvement; competitive programming or CTF participation (ICPC, IOI or similar); SHAD or similar advanced technical programs; conference talks or technical publications.
- Coding interviews are part of the process.
Conditions
- Competitive compensation.
- Career growth and learning opportunities.
- Flexibility and ownership.
- Collaborative and innovative culture.
- Opportunity to work on impactful AI projects.
- International environment and talented teams.
- Applicants must be authorized to work in the country where they apply and provide proof of employment eligibility as a condition of hire.