{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c797556c-7e2b-57d1-a3f5-ee0dd783a3a8","task_key":"default--validation--38736","task_revision_id":"1","upstream_id":"38736","short_description":"HellaSwag validation 38736","config":"default","split":"validation","body":"{\"activity_label\":\"Youth\",\"ctx\":\"[header] How to get your parent's permission [title] Be responsible. [step] Before you even seek out your parents' permission for an activity, show them how responsible you are. You need to be doing this for a while, too, not just in the few days leading up to your asking.\",\"endings\":\"[\\\"When you ask your parents to help you out, be consistent with your approach, and don't punish them for being too involved in it. The conversation will be much more productive if you don't demand that your parents' permission be restricted, too.\\\", 'Your parents are more likely to say yes to you if they perceive you as responsible and trustworthy. Here are some ways you can indicate you are responsible : [substeps] Do all your chores without needing to be asked or reminded.', \\\"[substeps] Consistently do everything your parents say you should do, whether you feel like you're being asked to. This will show them you can really take responsibility for your actions.\\\", \\\"To be responsible, you need to be responsible for things you may not normally do, whether it's babysitting and an unexpected visit to the grocery store. In addition, keep an updated list that you can carry with you so your parents don't get lost in their head.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}