This position is listed on behalf of a partner company managing all applications and next steps.
Opportunity to establish the data engineering foundation behind reliable pricing for an online marketplace.
Responsibilities
Build, maintain, and own scalable, scheduled data ingestion pipelines collecting sold-listing information from multiple marketplaces and external sources.
Design and implement entity resolution systems matching inconsistent listing descriptions, text, and images to canonical items.
Develop pricing and valuation logic accounting for listing recency, item condition, and quantity/quality of comparable sales.
Establish production-grade data quality monitoring to identify data drift, fraud, anomalies, stale listings, and unreliable information.
Partner with the computer vision lead to define consistent item-matching standards.
Evaluate build-versus-buy decisions for data sources, licensing agreements, and third-party pricing feeds.
Communicate pricing confidence, data limitations, and uncertainty to non-technical stakeholders.
Requirements
At least 5 years of data engineering experience, including ownership of large-scale production ETL processes and data pipelines.
Experience handling messy, inconsistent, or adversarial data in marketplaces, pricing, fraud detection, or similar environments.
Strong SQL skills and hands-on experience with dbt, Airflow, Dagster, Spark, or comparable technologies.
Experience with statistical estimation and pricing models, including regression-based approaches.
Demonstrated experience with entity resolution, record linkage at scale, and production data quality monitoring.
Strong analytical and problem-solving skills.
Excellent communication skills.
Familiarity with pricing intelligence, data licensing, or early-stage startups is a plus.
Conditions
Annual salary: USD $160,000–$220,000.
Remote position, eligibility in the United States and North America.