{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"094ca276-e4b6-59f4-ad53-4e6ebbb5af3c","task_key":"default--validation--30529","task_revision_id":"1","upstream_id":"30529","short_description":"HellaSwag validation 30529","config":"default","split":"validation","body":"{\"activity_label\":\"Youth\",\"ctx\":\"[header] How to get your dad to stop picking on you [title] Ignore it. [step] Sometimes, the best way to deal with someone messing with you is to ignore it. Your dad may thrive off the response he gets from you.\",\"endings\":\"[\\\"He may think it's amusing to see you annoyed, so try to not indulge him. [substeps] When your dad starts picking on you, just pretend you do not hear him.\\\", \\\"Try to remember that the only way he can be disrespectful is if it's because he's punishing you : [substeps] If you're two years old, he may be disciplining you all the time. If you're older, he may even be spanking you all the time.\\\", \\\"He probably doesn't realize that something will happen if you argue, and he will eventually get bored with you and may start picking on you anyway. [substeps] Talking to your dad a lot will let him know that you aren't as laid back as he may expect.\\\", \\\"In order to avoid another bad mood, resist the urge to tell him to stop. You won't be able to control the situation if you don't respond to the reminder.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}