Senior Technical Program Manager Data Labeling, Data and Machine Learning

Remote Full-time
About the position As a Senior Technical Program Manager: Data Labeling at Material Security, you'll be part of a team of experienced, world-class engineers, working to protect our users and their privacy (e.g., inboxes from breaches, targeted phishing, fraud, and lateral account takeover). Your mission is to develop high quality data sets that will be used to create ML/AI models that detect security relevant data and behavior (phishing emails, sensitive data in email and drive). Responsibilities You will lead cross-functional initiatives to build, scale, and optimize data annotation programs critical to AI model performance. You'll own program delivery across internal teams, vendor partners, and ML stakeholders to ensure high-quality labeled datasets are delivered on time and at scale. This role is both strategic and execution-driven: you'll define roadmaps, manage SLAs, create scalable processes, and resolve bottlenecks to ensure the labeling engine is efficient, quality-controlled, and model-aligned. Responsibilities • Define and drive end-to-end execution of large-scale annotation programs across multiple data types. • Collaborate with ML, product, and data operations teams to scope and prioritize labeling needs. • Own vendor engagement: onboarding, SLA management, training, and quality reviews. • Build feedback loops between annotators and model performance to inform labeling strategies. • Create dashboards and reporting mechanisms to track labeling velocity, quality, and cost. • Lead initiatives to improve labeling efficiency through tooling enhancements and process automation. • Be the voice of labeling in cross-functional forums-translating model needs into operational plans. • Manage and mentor a team of trained threat analysts who conduct our labeling. • Conduct analysis of the quality of the labeling and for insights into how our detections can be improved. • Hire and train new or replacement threat analysts Requirements • 5+ years of program management experience, ideally in ML ops, data labeling, or AI infrastructure. • Proven track record building and managing remote labeling teams. • Strong understanding of ML lifecycle stages and the importance of annotated data quality. • Experience defining SOPs, audit mechanisms, and workflows for scalable data labeling. • Proficient in project management tools such as Jira, Asana, or Linear for program tracking • A deep understanding on ML Operations labelling tools and experience building or maintaining an annotation tool. • Strong analytical and communication skills; ability to synthesise feedback from ML, ops, and product stakeholders and also analyzed data to spot trends in our labeling or detection quality. • Understanding of data privacy and security standards and how they can be followed in a labeling program. Nice-to-haves • Exposure to LLMs, foundation models, or active learning-based data curation. • Familiarity with annotation for multimodal inputs (e.g., Image, Text, Documents, OCR based forms etc) • Knowledge of quality scoring frameworks, inter-annotator agreement (IAA), or QA loop design. • The ability to develop and maintain labeling quality metrics and analytic insights and report on those to senior management • Technical background (e.g., in ML, data science, or engineering) is a plus. Apply tot his job
Apply Now →

Similar Jobs

Director / Sr Program Manager, AI Accelerator

Remote Full-time

Computer Vision/Deep Learning Scientist fully remote

Remote Full-time

Malware Analyst San Antonio, TX

Remote Full-time

Senior Analyst, Mandiant Threat Intelligence Services

Remote Full-time

Workforce Management Analyst

Remote Full-time

Senior Workforce Management Analyst

Remote Full-time

Content Management Analyst - Medical Education and Practice

Remote Full-time

Case Management Analyst

Remote Full-time

Remote Management Consultant; Port St. Lucie

Remote Full-time

[Remote] Managing Consultant - Oracle Cloud Payroll (Remote)

Remote Full-time

**Experienced Part-Time Data Entry Specialist – Remote Online Opportunity with arenaflex**

Remote Full-time

Director, Agentic AI/Automation

Remote Full-time

Career Development Coach

Remote Full-time

Appellate & Motion Practice Attorney | New York (REMOTE)

Remote Full-time

Senior Planner (Land Development) - $5,000 Hiring Incentive

Remote Full-time

Experienced Remote Part-time Data Entry Clerk – Administrative Support and Data Management Expertise

Remote Full-time

Remote Hospice Triage RN PT 3:30p-11p + rotating Sat & Sun 3:30p-11p CST

Remote Full-time

Remote Data Entry and Customer Service Specialist - Flexible Part-Time Work from Home Opportunity at blithequark

Remote Full-time

Experienced Full Stack Data Entry Specialist – Unlocking Magical Experiences through Accurate and Efficient Data Management at blithequark

Remote Full-time

**Experienced Customer Service Representative (Work from Home) – Delivering Exceptional Experiences at arenaflex**

Remote Full-time
← Back to Home