{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5b58dd66-7fdb-5acb-bfbf-dba391af8fc6","task_key":"default--validation--5542","task_revision_id":"1","upstream_id":"5542","short_description":"HellaSwag validation 5542","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to cope when a schoolmate dies [title] Acknowledge your emotions. [step] When you learn that a schoolmate has died, you may feel emotional and sad. That is okay.\",\"endings\":\"[\\\"It's ok to experience both emotions. But, doing so will only make it worse later, so you should try to work through them as you cool down.\\\", 'It is normal to feel sad and feel like crying. Alternately, you might feel angry, be in denial, be shocked, or feel nothing or be numb.', \\\"It's normal to feel things, and it's okay to be sad. However, you can have emotional highs and lows, but learning to live with them is difficult.\\\", 'Remind yourself that the person is likely gone, in which case you should be okay to cry and grieve. Show that you are still thinking about the person and that it is still important for you.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}