About the company
This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Project Lead, AI Model Training based in United States.
Responsibilities
- Lead AI training, evaluation, and data operations engagements end to end, from initial client scoping and project design through production, acceptance, delivery, and post-project review.
- Translate client objectives into clearly defined statements of work, task specifications, quality standards, annotator profiles, workflows, and evaluation criteria.
- Configure projects across the data operations platform, including task forms, grading rubrics, routing, multi-layer quality processes, and annotator enablement.
- Partner with ML leadership to develop initial guidelines and gold-standard datasets, rigorously testing project specifications before production begins.
- Own project quality, throughput, cost, and delivery timelines, monitoring performance against agreed targets and taking corrective action when metrics drift.
- Coordinate annotator pools by managing assignments, qualifications, access, performance, calibration, and escalations in partnership with the broader annotator delivery team.
- Maintain alignment across annotators through project channels, calibration sessions, updated guidance, and ongoing operational support.
- Serve as the primary client contact throughout engagements, leading scoping discussions, progress updates, quality conversations, escalations, acceptance testing, and final delivery.
- Manage client expectations transparently, identify acceptance issues early, and communicate operational challenges and solutions with confidence.
- Identify account expansion opportunities and emerging use cases, partnering with commercial teams and providing technical and operational expertise during new business discussions.
- Assemble and deliver project batches on schedule, manage client acceptance against agreed criteria, obtain sign-off, and complete required project closeout activities.
- Conduct post-project reviews and turn lessons learned into improvements to guidelines, tooling, workflows, quality standards, and future project scopes.
- Help build a scalable delivery organization by developing repeatable playbooks, templates, processes, and quality frameworks.
- Act as a key voice for delivery with product and engineering teams, identifying platform improvements based on real-world project requirements.
Requirements
- 3+ years of professional experience in data labeling, RLHF, SFT, AI evaluation delivery, or closely related AI data operations; hands-on experience delivering real annotation or evaluation projects is essential.
- Experience working at a data-labeling organization, AI lab, model-training operation, or comparable environment is strongly preferred; general project management experience alone is not sufficient.
- Strong operational mindset with the ability to investigate quality metrics, diagnose workflow or queue issues, resolve production problems, and improve evaluation rubrics or project specifications.
- Demonstrated client-facing experience, with the ability to lead technical scoping discussions, manage expectations, communicate difficult information constructively, and translate operational details into business outcomes.
- Strong analytical capabilities and comfort working with data; experience using SQL or Python is a significant advantage.
- Ability to manage several concurrent projects with different clients, quality requirements, timelines, workflows, and annotator populations.
- Strong attention to detail and a rigorous approach to quality, performance measurement, and delivery.
- Proven ability to operate effectively in ambiguous, rapidly changing environments where processes may still be evolving.
- Builder mentality, with a willingness to create processes, tools, documentation, and operating standards rather than relying solely on established playbooks.
- Adaptable, resilient, and comfortable responding to changing client requirements, evolving specifications, and unexpected operational challenges.
- Excellent communication, organization, prioritization, and stakeholder-management skills.
- High level of discretion and professionalism when handling client-confidential information and annotator personal data under strict security and confidentiality requirements.
- Valid U.S. or Canadian work authorization required; visa sponsorship is not available for this role.
Conditions
- Competitive total on-target compensation of $150,000–$240,000.
- Participation in a company stock buying program.
- Opportunity to help build and scale a new AI-focused business unit from the ground up.
- Direct exposure to senior and C-level leadership with significant opportunity to influence business and operational strategy.
- Fast-track career growth.