{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"dbad09eb-2ef7-5ec6-a6ac-3c42607737f2","task_key":"default--validation--15035","task_revision_id":"1","upstream_id":"15035","short_description":"HellaSwag validation 15035","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to speak supportively to someone with an eating disorder [title] Educate yourself. [step] Research what it means to suffer from an eating disorder, how people cope with it, and what steps can be taken to overcome the problem. It is important that you have at least a little bit of background knowledge so the person will listen to you and think that you are someone they can talk to about their problem.\",\"endings\":\"['[title] Determine whether you are a social phobia. [step] Social phobia, or shame, can impact your perceptions of others and create resentment towards them.', '[title] Cultivate self awareness and helpful habits. [step] Observe the values and beliefs of others and ask yourself how they view the world.', '[substeps] Help them feel that they are telling you how much they need help. For example, ask them if they are feeling better or need help with something.', \\\"[substeps] The more you learn about their condition, the better equipped you'll be to approach them with your concern. They may be suffering from extreme levels of anxiety or depression that you are unaware of.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}