Viraj Mishra

Definitions, Label Names, or Demonstrations? Auditing What Governs LLM Annotation

According to the abstract, Mishra and colleagues use a counterfactual audit that reassigns category definitions among labels. Across three political-text datasets they report models rarely follow the reassigned definitions and fine-tuning strengthens the original label mapping.