{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d0bbd453-3dca-581d-8aa1-8db8a356f752","task_key":"default--validation--19599","task_revision_id":"1","upstream_id":"19599","short_description":"HellaSwag validation 19599","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to deal with a bereavement as a teen [title] Never be afraid to cry. [step] Crying is good for you. It helps you let go of some of the hurt or anger you may have.\",\"endings\":\"[\\\"Crying can help you know that you're not alone and that you don't have anything to be sad about. Try to keep your tears from running out in the open, in front of your family and close friends.\\\", 'It is also good for your mental health. Crying will teach you how to expect the worst-and to really gain some perspective on what is real and what is not.', \\\"You shouldn't feel weak or silly while crying. After all this shows that you loved the person and that they were important to you.\\\", \\\"If you don't feel like crying, then it's okay to cry. In fact, crying allows your body to release stress, which in turn helps to relieve some of the pain you feel.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}