{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a81ab252-62d3-532e-a292-4758d04e2694","task_key":"default--validation--39170","task_revision_id":"1","upstream_id":"39170","short_description":"HellaSwag validation 39170","config":"default","split":"validation","body":"{\"activity_label\":\"Relationships\",\"ctx\":\"[header] How to comfort someone who is sad [title] Open the conversation. [step] Let the person know that you see that they are upset and that you are available to listen. If you don't know the person very well, you could identify why you're trying to help.\",\"endings\":\"['[substeps] Give the person some space, so they can get over whatever\\\\'s bothering them. You could say, \\\" you don\\\\'t have to feel that way.', '[substeps] For instance, if you know the person, you could say, \\\" i see you\\\\'re having a hard time right now. Do you want to talk about it? \\\" if they do not want your company, that is perfectly okay.', '[substeps] Simply saying \\\" how\\\\'s it going? \\\" is usually much more comforting than saying, \\\" how are you doing? \\\" keep your voice even and nonjudgmental. If the person interacts emotionally, they may not be ready to talk.', \\\"[substeps] A good friend will let you know what's going on in their day, since you will be there to offer support. It can also be more helpful if you can connect them with someone that shares the same grief as you.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}