{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"891e6c77-fd7c-5174-9ae6-4de0412d15d6","task_key":"default--validation--20110","task_revision_id":"1","upstream_id":"20110","short_description":"HellaSwag validation 20110","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to offer help and support to a widowed mother [title] Contact her after the passing of the loved one. [step] In times of crisis people gather to provide support to one another. When someone has experienced a profound loss, it is important to show her she is not alone.\",\"endings\":\"['Sitting with the person and actively listening to her tell you what happened and acknowledging her feelings can be extremely helpful. You are there to comfort and reassure her, which will include listening, talking and calming the situation in any way.', 'Even people in financial straits can get support simply by sharing personal thoughts. Do not hesitate to reach out for support and advice.', \\\"[substeps] Tell the mother of the loved one who has passed that she loves and supports your relationship with her and is involved in reaching the person's thoughts and setting up a support system in case of an emergency. When you do visit, also provide support if the bereaved person is declining or he or she is feeling really down.\\\", \\\"Call the following numbers : [substeps] Call 1-800-273-2159 to speak with someone you know. Reach the national center for older women's survivors.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}