{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"bf3e9ac1-0f0c-5bf8-b8d8-933b8236c59e","task_key":"default--validation--28513","task_revision_id":"1","upstream_id":"28513","short_description":"HellaSwag validation 28513","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to confront others about their poor hygiene [title] Set a goal for the conversation. [step] Making sure that you have a particular result in mind will help you plan for the difficult conversation. Know the specific changes that you want to see in your friend or colleague's behavior and be clear about why those changes are important.\",\"endings\":\"['[substeps] For example, in order to have a conversation that will lead to a happy and pleasant reunion, write the goal down on a notepad. This will keep you on track and prevent you from running out the door and rudely telling your friend how excited and well you are.', \\\"[substeps] Consider aspects of the person's behavior that annoy you. If they are a supervisor and you are unsure about what they are doing right, get involved.\\\", '[substeps] Think about what you hope to say to your friend or colleague, or use a standard psychology approach. For example, you might want to talk about how your friend makes a huge mess and how they need to fix it right now.', '[substeps] Avoid examining his or her personality; keep your goals focused on behaviors. Write your goal down so that you can keep it as a reference as you plan the conversation.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}