Remote, full-time AI/ML data operations role supporting LLM training pipelines from Brazil. You will deliver high-quality annotations, evaluations, and QA using clear rubrics and strict guideline compliance.
What You Will Do
Perform AI data annotation and data labeling for LLM training datasets
Complete RLHF preference ranking, prompt evaluation, and QA evaluation tasks using consistent rubrics
Improve training data quality by reducing label noise and documenting edge cases
Execute NLP tasks such as named entity recognition and classification
Support computer vision annotation (bounding boxes, polygons, segmentation) when needed
Handle content safety labeling aligned to policy/risk taxonomies
Collaborate with engineering/ops on error analysis and rubric updates
Required Qualifications
Mid-Senior experience in annotation, LLM evaluation, or data la...