Coalition Inc.
Senior Manager, Machine Learning (Data Operations)
Share this job
Job Description
#### About us
Coalition is the world's first Active Insurance provider designed to help prevent digital risk before it strikes. Founded in 2017, Coalition combines comprehensive insurance coverage and innovative cybersecurity tools to help businesses manage and mitigate potential cyberattacks.
Opportunities to make an impact with bold thinking are real—and happening daily at Coalition.
#### About the role
Coalition's machine learning models are only as good as the data they're trained on. This role exists to make sure that data is right.
You'll own labeling quality and methodology across Coalition — designing annotation tasks, defining quality frameworks, and ensuring every labeled dataset meets the standard required to ship production ML models. You'll manage our labeling platform (Label Studio), work directly with ML and product teams to structure labeling programs, and oversee outsourced labeling vendors to hit quality and throughput targets.
This role reports to the Chief Product Officer and sits at the intersection of product, ML, and operations. You won't manage internal labelers — all annotation work is outsourced — but you will be the single point of accountability for whether Coalition's labeled data is accurate, consistent, and fit for purpose. #### Responsibilities
- Labeling quality & methodology: Define annotation guidelines, taxonomies, and edge-case protocols for each labeling program. Establish gold standard datasets, inter-annotator agreement (IAA) targets, and audit sampling processes. Identify and remediate mislabeled data in existing datasets.
- Platform & tooling: Serve as the primary user and requirements driver for Label Studio — defining project configuration needs, workflow designs, pre-labeling pipeline requirements, and integration points with ML infrastructure. Partner with the data engineering team that builds and maintains the platform.
- Cross-functional partnership: Work with M
Keep looking
Similar Remote AI Jobs
BV Teck
AI Data Platform Engineer
BV Teck
AI Data Engineer
The Geneva Foundation
Lead AI Data Engineer (Hybrid)
Booz Allen Hamilton
AI Data Scientist
Booz Allen Hamilton