{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"eef4f1b5-1818-5062-afd6-f4a110f82100","task_key":"default--validation--45359","task_revision_id":"1","upstream_id":"45359","short_description":"HellaSwag validation 45359","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to cope with the death of your cat [title] Do not ignore your pain. [step] Ignoring your pain can actually make grief harder. In order to actually heal from the loss of your cat, you will need to actively face your pain and deal with it.\",\"endings\":\"[\\\"By making choices that you deem appropriate for your particular situation, you can still make this process go smoothly. [substeps] The first step to facing the pain you feel is to do everything you can to accept the fact that your cat's suffering isn't the result of your grief.\\\", 'If you feel sad and want to cry, then you should cry. Bottling up your emotions will likely extend the grieving process.', 'By doing this, you will be able to move past the grief you feel and move on with your life. [substeps] Avoid making an effort to push through your pain.', 'The best place to start is to remember something about the cat that has been passed on to you : [substeps] A loved one. If your cat lost its collar, then you may still not be able to acknowledge your pain.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}