About the company
This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Data Developer based in Brazil.
Responsibilities
- Design, develop, and maintain robust and scalable data pipelines using Databricks, Apache Spark, SQL, and Python or Scala.
- Build and optimize solutions capable of processing and transforming large volumes of data efficiently.
- Monitor existing data pipelines and workflows, identifying opportunities to improve performance, scalability, throughput, and reliability.
- Work closely with data scientists, analysts, engineers, and business stakeholders to understand data requirements and translate them into effective technical solutions.
- Implement data quality controls and governance practices to maintain accurate, consistent, and compliant data.
- Investigate complex data and pipeline incidents, identify root causes, and implement sustainable solutions.
- Create and maintain clear technical documentation and contribute to engineering standards, best practices, and continuous improvement initiatives.
Requirements
- Solid professional experience in Data Engineering, particularly in the design and development of data pipelines.
- Hands-on experience with Databricks and Apache Spark.
- Strong SQL knowledge and experience working with large datasets.
- Proficiency in Python or Scala for data engineering applications.
- Professional experience with Microsoft Azure and cloud-based data solutions.
- Strong analytical and problem-solving abilities, including experience troubleshooting complex data-related issues.
- Excellent communication skills in both English and Portuguese.
- Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.
Conditions
- Health and dental insurance.
- Meal and food allowance.
- Childcare assistance.
- Extended paternity leave.
- Partnerships with gyms and health and wellness professionals through Wellhub and TotalPass.
- Profit Sharing and Results Participation (PLR).
- Life insurance.
- Continuous learning opportunities through a dedicated corporate learning platform.
- Discounts through an employee discount club.
- Free online resources focused on physical, mental, and overall well-being.
- Pregnancy and responsible parenting course.
- Partnerships with online learning platforms.
- Language learning platform.
- Remote work environment.