About the role
The Data Platforms Team serves as the experts on managing data infrastructures for CoreWeave. The data infra includes but is not limited to managed databases, data ingestion, data flow, and data lake and retrieval for CoreWeave and its customers. This team is responsible for the development of use cases, discovery of innovative solutions, automation and operations of our data platform infrastructure.
Who You Are
We are seeking a senior engineer with specialization in database and stream processing who can help us fulfill the goal of our global datastore strategy and establish communication models for our data flow. This individual will work with a team of mixed skill engineers and have the opportunity to work on the full gamut of rewarding challenges that come with the business of building a cloud in a communicative, supportive, and high-performing environment.
Responsibilities
- Design and implement the platform to deliver data to teams with a focus on providing managed solutions through APIs
- Participate in operations and scaling of relational data platforms.
- Develop a stream processing architecture and solve for scalability and reliability.
- Improve the performance, security, reliability, and scalability of our data platforms, and related services and participate in the teams on-call rotation.
- Establish guidelines, guard rails for data access and storage for stakeholder teams.
- Ensure compliance with standards for data protection regulation.
Requirements
- 5+ years of experience in a software or infrastructure engineering industry.
- Experience operating services in production and at scale and versed in reliability engineering concepts such as the different types of testing, progressive deployments, error budgets, the role observability, and fault-tolerant design.
- Understanding of CAP theorem and concurrency models, can clearly define data models and establish guidelines around data management.
- Familiarity with one of the distributed NewSQL datastores such as CockroachDB, TiDB, YDB, Yugabyte and/or stream processing tools such as NATS or Kafka.
- Experience with designing and operating these systems at scale.
- Familiarity with Kubernetes and interest or comfortable with using it for event-driven and/or stateful orchestration.
- Knowledge of Linux distro, shell scripting, and the Linux storage and networking stacks.
- Proficiency in Go/Python/Java and interest in contributing to open source.
Conditions
- Base salary range: $165,000 to $242,000 per year.
- Total rewards package includes discretionary bonus, equity awards, and comprehensive benefits program.