About the company
Elastic, the Search AI Company, enables everyone to find the answers they need in real time, using all their data, at scale. The Elastic Search AI Platform is used by more than 50% of the Fortune 500.
Responsibilities
- Build and maintain ingestion of security-relevant data into Elasticsearch (cloud provider audit logs, identity/SaaS activity, endpoint and asset data)
- Integrate with third-party and cloud provider APIs to pull telemetry: auth, pagination, rate limits, and handling schema changes
- Keep Elastic Cloud on Kubernetes clusters healthy; monitor and upgrade them regularly
- Manage capacity and shards, handle index lifecycle management (ILM), enable cross-cluster search (CCS)
- Use Terraform to manage cloud infrastructure and Elasticsearch resources, including pipelines, index templates, and alerts
- Utilize Kubernetes and Helm to deploy scheduled ingest jobs
- Use AI automation and tooling to reduce toil, including self-healing jobs and health checks
- Monitor backfills, ensure schemas and fields are consistent, keep an eye on costs
Requirements
- Ability to operate Elastic and Elasticsearch in production, including ingest pipelines, index templates, mappings, and queries
- Experience with ECK or Elasticsearch on Kubernetes is strongly preferred
- Proven track record of using AI to accelerate development, debug complex systems, and accelerate operations
- Kubernetes: deploying and operating workloads (scheduled jobs, Helm charts, operators); troubleshooting pods/jobs
- Terraform: managing cloud and Elasticsearch resources as code
- API integration: consuming REST APIs for data ingestion
- Python scripting: able to read, write, and modify ingestion/automation scripts
- Eligibility to work in Department of Defense (DoD) Impact Level 4 or above cloud service environments
Conditions
- Competitive pay based on the work you do
- Health coverage for you and your family in many locations
- Flexible locations and schedules for many roles
- Generous number of vacation days each year
- Up to $2000 match for financial donations and service
- Up to 40 hours each year for volunteer projects
- Minimum of 16 weeks of parental leave