About the company
This position is listed on behalf of a partner company, which manages all applications and next steps. Our partner is looking for an AirFlow Developer | Python | Data Engineering based in Brazil.
Responsibilities
- Develop, maintain, and enhance data pipelines using Apache Airflow
- Design, implement, and manage Airflow DAGs
- Build Python-based solutions for data automation, processing, transformation, and integration
- Create, maintain, and optimize ETL/ELT processes
- Integrate multiple data sources, APIs, databases, and services
- Monitor pipeline execution, investigate failures, troubleshoot incidents, and resolve performance bottlenecks
- Implement robust error-handling practices, including logging, retries, alerts, and observability mechanisms
- Analyze pipeline performance and identify opportunities to improve processing efficiency
- Apply software development best practices, including version control
- Collaborate with Data Engineering, Analytics, and other technology teams
Requirements
- Professional experience working with Apache Airflow, including developing, maintaining, and troubleshooting DAGs
- Strong proficiency in Python, particularly for automation, data processing, and integration tasks
- Knowledge of SQL and relational databases
- Hands-on experience building and maintaining data pipelines and ETL/ELT workflows
- Experience integrating APIs and working with multiple data sources
- Familiarity with software development best practices, code versioning, and Git
- Strong troubleshooting and problem-solving skills
- Good communication skills
- Technical English proficiency
Nice-to-have
- Experience with Docker and Kubernetes
- Familiarity with cloud environments and cloud-based data services
- Knowledge of CI/CD tools and practices
- Experience with monitoring and observability tools
- Familiarity with distributed processing and data platforms
- Understanding of data engineering architecture and best practices
- Relevant certifications or coursework in cloud computing, data engineering, or software development
Conditions
- Profit-sharing program
- Healthcare coverage: Health and dental insurance
- Flexible benefits: Access to a flexible benefits card
- Fitness and wellness: Access to TotalPass and Zenklub services
- Language development: Participation in a language-learning program
- Professional education: Access to a partnership with FIAP
- Flexible work arrangements: The position is advertised as remote, while the benefits description also references a hybrid work model
- Flexible working hours
- Career development: Internal training programs and a structured career progression plan
- Mentorship: Access to a mentoring program
- Extended parental leave
- Childcare assistance
- Knowledge-sharing initiatives
- Team well-being
- Salary details: The specific salary range is not provided and should be confirmed during the recruitment process