← Все вакансии/Australian Payments Plus
HybridSydney

Data Engineer

AP
Australian Payments Plus
Формат
Hybrid
О роли

Описание вакансии

About the company

Life @ AP+: We are one connected team in pursuit of one inspiring purpose – to unite people and technology to power better experiences. Each of us has a part to play in making that happen. You’ll be encouraged to bring your big ideas forward and make a difference through your work. Taking steps forward in your career whilst still having room for fun, friendships, and flexibility in your daily life. We’re driven by our core values: lead with heart, learn for tomorrow and live our legacy.

Responsibilities
  • Design, build, deploy and maintain scalable batch and real-time data pipelines that ingest, transform and make large, complex datasets available for business use.
  • Build ingestion pipelines to integrate data from APIs, databases, files, event streams and third-party platforms.
  • Design pipelines for reliability, scalability, performance and maintainability.
  • Implement orchestration, observability, error handling, reconciliation and recovery mechanisms.
  • Implement incremental processing, CDC and event-driven integration patterns as appropriate.
  • Apply strong governance, security practices to payment and transaction data.
  • Develop tables, views, schemas, stored procedures and other Snowflake data objects.
  • Develop tests to validate data quality and transformation logic.
  • Monitor and optimise pipeline and platform performance, troubleshoot technical issues.
  • Provide On-call support as part of a rotational roster.
Requirements
  • 2+ years of hands-on experience building and maintaining enterprise or bank-grade data infrastructure, ideally in payments, banking or financial services.
  • Prior experience in cloud databases like Snowflake, DBT, orchestration tools like airflow, event streaming platform like Kafka.
  • Building and maintaining software components that are part of build pipelines.
  • Strong experience with Snowflake, SQL and NoSQL data stores, including complex queries, transformations, data warehousing and large-scale data manipulation.
  • Strong Python capability and experience building data pipelines and integrations using APIs, ETL/data processing technologies and cloud infrastructure such as AWS.
  • A solid understanding of data modelling, data quality, reconciliation, governance and security when working with transaction or payment data.
  • Experience connecting and operationalising data across warehouses, lakes, streaming platforms and analytics tools, with an eye for performance, scalability and reliability.
  • A curious, collaborative engineering mindset - comfortable working autonomously in Agile teams, navigating ambiguity and partnering with analysts and business stakeholders to turn data into practical outcomes.
Стек и навыки

С чем работаем