Staff Infrastructure Engineer

Our partner is looking for a Staff Infrastructure Engineer - Data Streaming based in the United States. This position is listed on behalf of a partner company, who manages all applications and next steps.

• Lead the architecture, deployment, and operation of distributed data services, including self-hosted Kafka and Redis, across large-scale Kubernetes clusters and multi-cloud environments.
• Build highly automated, self-service infrastructure that enables services to operate consistently across AWS, GCP, and air-gapped on-premises environments.
• Manage data infrastructure supporting more than 5 PB of daily ingestion, optimizing for high throughput, low latency, reliability, scalability, and cost efficiency.
• Consolidate and optimize multi-tenant Kafka environments to improve resilience, operational efficiency, and infrastructure economics.
• Drive lifecycle automation for Kafka and Redis using Infrastructure as Code and GitOps practices, including Terraform and ArgoCD, to reduce operational toil and pager fatigue.
• Establish and enforce platform standards for observability, high availability, backup, disaster recovery, and lifecycle management of stateful Kubernetes workloads.
• Own the end-to-end platform experience for mission-critical open-source data systems serving hundreds of internal product teams.
• Partner with FinOps and engineering stakeholders to continuously identify opportunities to improve performance, reduce costs, and streamline operations.
• Collaborate with globally distributed engineering teams, particularly colleagues in Europe and India, with a preference for candidates able to work effectively within U.S. Eastern Time Zone collaboration windows.
• Work with modern orchestration and delivery technologies including Kubernetes, EKS, GKE, Jenkins, GitHub Actions, ArgoCD, and Terraform.
• Provide technical leadership in designing reliable, scalable infrastructure and help establish engineering standards and best practices across the data platform.

• 8+ years of experience in infrastructure, platform, or systems engineering, with a demonstrated history of operating stateful distributed systems at significant scale.
• Deep hands-on expertise with self-hosted Kafka and Redis in Kubernetes environments, including performance tuning, scaling, partitioning, persistence, and operator-based lifecycle management.
• Strong understanding of Kubernetes internals and production best practices for both stateless and stateful workloads.
• Experience delivering Database-as-a-Service, Messaging-as-a-Service, Platform-as-a-Service, or comparable infrastructure capabilities to internal engineering teams or external customers.
• Experience working in multi-cloud environments, with strong expertise in at least one major cloud provider such as AWS, GCP, or Azure.
• Strong experience with Infrastructure as Code and GitOps methodologies, particularly technologies such as Terraform, ArgoCD, or Pulumi.
• Familiarity with modern deployment approaches including blue-green, canary, and rolling deployments.
• Strong scripting or software development capabilities using Python, Go, or a comparable language.
• Solid understanding of CI/CD pipelines and workflow automation, including technologies such as GitHub Actions or Argo Workflows.
• Strong problem-solving skills and the ability to make sound architectural and operational decisions in complex production environments.
• Excellent communication and collaboration skills, with the ability to work effectively across engineering, infrastructure, FinOps, and globally distributed teams.
• A continuous-learning mindset and willingness to explore emerging technologies, particularly developments in cloud infrastructure, distributed systems, automation, and AI-enabled engineering.
• U.S. citizenship is required due to Federal Government contract requirements.
• Depending on responsibilities and customer requirements, the role may require additional background checks or security clearance, including Secret Clearance.

• Base salary: $156,000–$215,000 USD annually, with the applicable range varying by candidate location.
• Equity: Restricted Stock Units (RSUs).
• Employee stock program: Employee Stock Purchase Plan (ESPP).
• Time off: Flexible paid time off, company holidays, and paid sick time.
• Family support: Gender-neutral parental leave and grandparent leave.
• Healthcare: Medical, dental, and vision coverage.
• Retirement: 401(k) plan with company match.
• Financial protection: Life and disability insurance.
• Flexible spending: Health and dependent care FSAs.
• Additional insurance: Voluntary hospital, accident, and critical illness coverage.
• Wellbeing support: Employee Assistance Program (EAP) and wellness resources.
• Legal support: Pre-paid legal services.
• Pet benefits: Nationwide pet insurance.
• Specialized health support: Cancer Care program and gl