About the company
This position is listed on behalf of a partner company, which manages all applications and next steps. Our partner is looking for a Mid-Level Data Engineer, Databricks based in the United States. The role supports analytics, reporting, and automation for a federal government client.
Responsibilities
- Design, develop, test, and maintain data pipelines using Databricks, Python, PySpark, and SQL to ingest, transform, and organize data into layered, reusable tables
- Build and maintain data products supporting analytics, reporting, and automation across multiple business areas
- Validate datasets against source systems, investigate discrepancies, troubleshoot data quality issues, and implement corrections
- Apply ETL/ELT practices, data modeling principles, and quality controls
- Document data pipelines, table definitions, transformation logic, and business rules
- Own assigned engineering tasks from development through delivery and production support
- Collaborate with senior engineers, data scientists, government stakeholders, and other team members
- Adapt to changing project priorities and develop proficiency with additional tools
- Contribute to continuous improvements in data engineering workflows, pipeline reliability, and usability of shared datasets
Requirements
- Bachelor's degree in computer science, data science, information systems, engineering, or related discipline, or equivalent experience
- At least 5 years of experience in data engineering, data analysis, or a related technical field
- Hands-on experience building and supporting data pipelines in Databricks, including notebooks, PySpark or Spark SQL, and Delta tables
- Proficiency in Python and SQL for data transformation, querying, validation, and troubleshooting
- Solid understanding of ETL/ELT processes, data modeling, data integration, and data quality practices
- Ability to investigate data discrepancies, identify root causes, and implement solutions
- Strong documentation, communication, and problem-solving skills
- Demonstrated ownership, effective time management, and adaptability
- U.S. citizenship required
- Must be eligible to obtain and maintain federal suitability, a government-issued PIV credential, and all required system access
Conditions
- Annual compensation range of $100,000–$140,000 USD
- Fully remote position within the United States
- Comprehensive medical, dental, and vision insurance
- Short-term disability and life insurance coverage
- 401(k) plan with matching employer contributions
- Paid leave, including 11 holidays and a day off for your birthday
- Professional development opportunities
- Fitness membership support
- Home office allocations
- Performance bonuses and profit-sharing opportunities
- Employee referral bonuses