About the company
Elastic, the Search AI Company, enables everyone to find the answers they need in real time, using all their data, at scale — unleashing the potential of businesses and people. The Elastic Search AI Platform, used by more than 50% of the Fortune 500, brings together the precision of search and the intelligence of AI to enable everyone to accelerate the results that matter.
Responsibilities
- Design, maintain, and improve the pipelines and infrastructure that power our data platform
- Work across the full data lifecycle — from ingestion and streaming to transformation and delivery — using tools like Apache Airflow, Spark, Iceberg, Kafka, Flink, and dbt Labs
- Spend meaningful time with stakeholders to understand what they need and help define how data should flow across systems
- Co-create data contracts, write clear documentation, and guide teammates on how to get the most out of the platform
- Monitor and refine pipeline performance and refine processes to keep things running smoothly
- Use Terraform to provision and manage resources on Google Cloud Platform (GCP)
- Help steward the platform by reviewing code and ensuring good practices and standard processes are followed
- Process access requests and support compliance with platform policies
Requirements
- 8+ years of experience in data engineering or related roles
- Experience with Apache Airflow for orchestrating data workflows
- Experience with Spark, Flink, Kafka, and dbt Labs for data processing and transformation
- Understanding of Apache Iceberg for data table formats and data warehouse and lakehouse strategies
- Skilled in using Terraform for infrastructure-as-code deployments
- Proficient in programming languages, particularly Bash, Python, and SQL
- Knowledge of database systems, including OLAP, OLTP, Document, and Vector databases
- Experience with Google Cloud Platform (GCP) for cloud resource management
- Bonus: Proven experience with data security and access controls for SOX Compliant data
- Bonus: Experience and knowledge of the Elastic stack
Conditions
- Compensation for this role is in the form of base salary. This role does not have a variable compensation component
- The typical starting salary range for new hires in this role is: $113,100 — $178,900 USD
- The typical starting salary range for this role in the select locations listed above is: $135,900 — $215,100 USD
- In addition to cash compensation, this role is currently eligible to participate in Elastic's stock program
- Our total rewards package also includes a company-matched 401k with dollar-for-dollar matching up to 6% of eligible earnings, along with a range of other benefits offered with a holistic emphasis on employee well-being