{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6cd13949-86ee-566d-8a2f-6bc7b91c4596","task_key":"default--validation--29359","task_revision_id":"1","upstream_id":"29359","short_description":"HellaSwag validation 29359","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to deal with mental illness linked to childhood bullying [title] Talk to a professional. [step] The first step in dealing with any type of mental illness is to speak with a professional about what you are going through. If you aren't already doing so, you should seek the help of a professional.\",\"endings\":\"['Professionals like psychologists, psychiatrists, and therapists are trained to help people deal with mental illness. Their experience and training can help you manage your mental illness better.', \\\"Children with mental illness often seek mental health care more often than adults. [title] Read on the child's situation.\\\", 'Talk to your doctor or a mental health professional to get specific information, and then take some time to talk in private. [substeps] Professional support can be a great help.', 'They may be able to bring you resources to help you treat the psychological illnesses associated with childhood bullying as well as child trauma, neglect, or other symptoms related to mental trauma. Speak to friends and family and ask what they would recommend after you have a conversation with them.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}