This position is listed on behalf of a partner company, which manages all applications and next steps.
Our partner is looking for a Sr. Data Engineer, Onboarding based in the United States.
Responsibilities
Design and optimize data pipelines: Build, maintain, and scale ETL/ELT pipelines using Databricks, PySpark, and Python, following a Bronze/Silver/Gold lakehouse architecture.
Lead healthcare data onboarding: Ingest, parse, transform, and map healthcare claims data, including 837I/P/D transactions, 835 remittance advice, and EMR records.
Develop data warehouse solutions: Build and optimize Snowflake data models, SQL transformations, and data warehousing processes.
Manage data migration: Lead the conversion and migration of data from legacy systems, including Microsoft SQL Server, into modern cloud-based data platforms.
Drive automation and efficiency: Develop reusable frameworks, tools, and automated workflows.
Ensure data quality and reliability: Implement validation checks, reconciliation processes, and monitoring solutions.
Integrate healthcare systems: Connect and validate EMR data from platforms such as Epic, Cerner, Meditech, and Athenahealth.
Collaborate across teams: Partner with Implementation, Product, Support, and IT stakeholders.
Provide technical leadership: Mentor junior engineers, conduct code reviews.
Manage documentation and handoffs: Maintain technical documentation, data flow diagrams, pipeline specifications.
Maintain security and compliance: Follow HIPAA and other applicable regulatory requirements.
Support continuous improvement: Track project progress, communicate risks.
Requirements
Education: Bachelor's degree in Computer Science, Data Science, Health Informatics, Information Systems, or a related discipline, or equivalent professional experience.
Professional experience: At least 8 years of experience in data engineering, ETL/ELT development, and data warehousing.
Programming expertise: At least 3 years of hands-on experience with Python and advanced SQL.
Databricks and PySpark: At least 2 years of practical experience with Databricks, including Delta Lake, notebooks, jobs, and workflows.
Snowflake: Working experience with Snowflake, including data modeling, SQL transformations, and warehouse optimization.
Healthcare industry knowledge: At least 2 years of healthcare experience, preferably in revenue cycle management (RCM).
Healthcare data standards: Working knowledge of healthcare EDI and X12 transaction formats, particularly 837 claims and 835 remittance transactions.
Cloud platforms: Experience with cloud environments such as AWS or Microsoft Azure.
Data engineering best practices: Ability to develop scalable pipelines, implement automated data quality controls.
Analytical and problem-solving skills: Strong attention to detail.
Communication and collaboration: Excellent written and verbal communication skills.
Leadership and mentoring: Demonstrated ability to guide less experienced engineers.
Project management: Ability to manage multiple priorities.
Security awareness: Understanding of healthcare data privacy, HIPAA requirements.
Conditions
Competitive salary: Annual compensation ranging from $140,000 to $150,000.