Data Scientist - AI Evaluator

Opportunity Overview

Handshake is looking for experienced data scientists to support AI research through flexible, part-time contract work. This is not a traditional job — you'll draw on your hands-on experience building and reasoning about models and statistical analysis to evaluate AI-generated content and provide feedback that helps AI reason like a practicing data scientist.

This is an ongoing, project-based opportunity you can take on alongside your current role.

What You'll Do

Use your domain expertise to create expert-level data science problems and scenarios grounded in real modeling, analysis, and experimentation work Review and evaluate AI-generated responses for technical accuracy, practical feasibility, and alignment with how the work is actually done Provide structured written feedback to help improve AI model performance Complete tasks at your own pace with no set schedule or minimum hour requirement

Qualifications

Ideal candidates meet all three of the following

Industry/research experience — minimum 1 year of professional experience at a top company, with direct hands-on work as a data scientist Degree — Bachelor's degree in Data Science, Statistics, Mathematics, Computer Science, or a related field Sub-domain depth — demonstrated expertise in one of the following areas: Machine learning and applied ML Statistical modeling and experimentation (A/B testing, causal inference) Data analysis and feature engineering at scale

Additional qualifications (not required, but strengthen your application)

Experience at a recognized, top-tier tech company

Required for all applicants

Based in the United States Strong written communication and attention to detail Ability to explain complex data science concepts clearly Ability to work independently in a remote, asynchronous environment

Pay: $120.00 per hour