{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"56213b1f-1c08-5de7-a84d-e7729a05a963","task_key":"default--validation--16109","task_revision_id":"1","upstream_id":"16109","short_description":"HellaSwag validation 16109","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to support someone diagnosed with cancer [title] Be a good listener. [step] One of the best ways to show your support is by letting your friend know that you are ready to listen. Tell her that you understand that she may not want to talk about her illness, but that when she does, you'll be there.\",\"endings\":\"['[substeps] Raise your eyebrows, nod, and let her know that you understand. Be open and patient as your friend talks.', 'Respond with questions about how their illness impacts their life, job, or work. [substeps] Listen by giving a positive input to what they are saying.', \\\"Then, when she's ready to talk, don't try to change the conversation or cut her off. Instead, listen to her so that you can better see what she is talking about or how she feels about it.\\\", \\\"Don't assume that your friend already knows this. It's always welcome to hear that someone is ready to be there for you.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}