{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0b6abf5a-ce64-5b00-aa33-abf0fb6ccae7","task_key":"default--validation--29462","task_revision_id":"1","upstream_id":"29462","short_description":"HellaSwag validation 29462","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to deal with the death of a grandmother [title] Feel your emotions. [step] You will go through the process much more easily if you do not try to fight or hold in what you're feeling. There is no right or wrong way to grieve.\",\"endings\":\"['There is no time-frame in which grief ends. Try to open yourself up to the anger, sadness, confusion, or abandonment feelings that come over you.', 'The only way you can do that is to let your feelings out. This means talking to a doctor or counselor.', 'You can simply use the body parts you need for grief. Each loved one has their own emotional identity.', 'Because dying can be difficult, what you feel is not important. [substeps] One possibility is to go with the same mentality: \\\" grandma has passed on.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}