🌴 JobsLeisure.com

Where Work Meets Adventure

← Back to Leisure Jobs

Remote AI/ML Data Operations Specialist for Workflow Evaluation

Hospitality Full Benefits Career Growth
Company

Rex.zone

Location

remote, Canada

Posted

May 21, 2026

Start Your Adventure

Join our team and work where others vacation

Apply Now

About This Opportunity

Drive excellence in AI data operations as a Remote Specialist. Focus on RLHF, data labeling, prompt evaluation, and ensuring content safety within high-quality training workflows.

This mid-senior role requires expertise in AI data operations or applied ML support. You will execute critical tasks, including RLHF evaluation and response grading, while adhering to annotation guidelines. Strong written reasoning skills are essential for effective rubric-based evaluations in this impactful position.

Key Responsibilities:
• Execute RLHF evaluation and preference ranking
• Perform prompt evaluation and response grading
• Complete data labeling tasks for classification and NER
• Conduct QA evaluations through audits and spot checks
• Document edge cases affecting LLM training pipelines

Requirements:
• Mid-senior experience in AI data operations
• Expertise in rubric-based evaluations
• Familiarity with large...