{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"297e76bd-bdf9-533d-bbbb-7130289da1cc","task_key":"default--validation--43354","task_revision_id":"1","upstream_id":"43354","short_description":"HellaSwag validation 43354","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to help your daughter survive divorce [title] Let her know that you are there for her. [step] Make it clear that no matter what the time of day or night, she has a place to come to if she needs respite, or an ear to talk to if she is in need. When you live far away from her, the phone connection is even more crucial.\",\"endings\":\"['Listen for things that your daughter is grateful for and offer to call her every time. [substeps] Ask how she connects with friends and family, like when she needs to see a doctor or is caught up in school.', '[title] Consider the ways in which you might be able to help her tangibly. [step] Think about the sorts of things that might help her through this hard time.', 'Making it a point to get in touch without calling is essential for a successful mother. How are you helping her cope with the divorce? [substeps] Give hugs when she gets home from the hospital.', '[substeps] Say something like, \\\" let\\\\'s try to talk more frequently when i am away. We have different lives now, so try to give her some little space.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}