Are the labels that are assigned to each instance vetted for factual correctness or their relationship to the psychological field? e.g. In one of the instances, the statement is "Why do I get hallucinations?" and the correct label is "Drugs". While this might be true in some cases, this isn't always true, as there are several mental illnesses and conditions that may result in hallucination. Going by this label, a decision to give advice might miss the chance to discuss the other issues. Since this challenge is meant to be supporting a chatbot, won't any advice based on these labels end up misinforming some people by omitting critical information? What psychological picture of a patient are the labels assigned here meant to be painting?
From the Data tab “Also note that labels were not assigned to the statements, but rather students provided statements and questions about their particular experience”.
I guess that means there was no evaluation by a pyschologist or similar domain expert.