#CommunityAMA Annotator Training and Guidelines To ensure consistency and reliability: • Annotators are trained with examples and detailed rubrics. • They may be quizzed or go through a calibration phase. • Bad judgments or random clicking are filtered out using: • Gold standard checks • Redundant evaluations (multiple annotators per sample)