{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"cb60be8d-8007-51ab-be23-7854f82507bb","task_key":"default--validation--49011","task_revision_id":"1","upstream_id":"49011","short_description":"HellaSwag validation 49011","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to get little kids to listen to you [title] Get down to the child's eye level. [step] Imagine being a child and having someone much bigger looking down to talk to you. It can be intimidating.\",\"endings\":\"['Realizing that you are standing at attention is dangerous. Get down to their eye level and try to show your concern for their well-being, instead of getting down in a corner and making loud, threatening remarks.', 'How would you look like that? Step out of your comfort zone. [title] Sitting in a chair should be good for your posture.', 'When they make eye contact and then move straight at you, saying \\\" who\\\\'s it? \\\" or \\\" know, it\\\\'s not you...\\\", guess a bit. Might be more difficult, but being down to the eyes is much more effective.', \\\"When you get down to your child's height, you're literally putting yourself on their level, which is a great way to start. [substeps] Don't attempt to have a conversation or give a child instructions from another room.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}