{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5a88c67c-50af-50e3-a22a-3d7ee70aaca5","task_key":"default--validation--44186","task_revision_id":"1","upstream_id":"44186","short_description":"HellaSwag validation 44186","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to move on when a loved one dies [title] Recognize and understand you may be angry. [step] You may be angry with the person who died. Remember that they didn't choose to die, but, however unfair it is, it was there time to move on, and they won't come back.\",\"endings\":\"['[substeps] Grieving is not easy and feeling sad or angry after a loved one dies can make it hard to move on. Talk with your loved one if you feel as though you are unable to move on.', 'Here are some underlying reasons why you might feel angry. [substeps] Whether or not your loved one wanted to die: take some time to consider why your loved one chose to die: it may have been a selfish thing to do or something he loved doing.', \\\"Don't be angry with what ever you believe takes people out of the world (if you are religious). Remember that it is the same person that also brings people into the world, and it's the same person that gave you all the amazing memories you shared.\\\", \\\"Everyone makes mistakes, and you're no different. [substeps] When you are upset by someone die you know they made good decisions.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}