{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ad05d0e0-970b-58f1-bc9f-bad9e3eec7fa","task_key":"default--validation--27025","task_revision_id":"1","upstream_id":"27025","short_description":"HellaSwag validation 27025","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to quickly defuse a toddler tantrum with the tantrum rug [title] Recognize that children are always learning to control their environment. [step] This also includes learning to control the adults in their environment. [title] Learn to recognize an oncoming tantrum.\",\"endings\":\"['[step] The first thing you need to do to avoid an oncoming tantrum is to move out of its way. You can do this by pushing the toddler away and staying in the same place.', '[step] Toddlers can unconsciously take charge of situations. When the toddler decides what to do (or his actions), they know the next movement when they see the parent.', '[step] When a toddler begins to throw a tantrum, it will be indicated by yelling, thrashing, kicking, holding their breath, flailing arms, etc. The tantrum may include any or all of these behaviours.', '[step] Children can sense when an opportune moment finally rolls around, and will begin using this knowledge to control them. [substeps] An opportune moment may be a moment that they have been having with their parents, or which they know will happen, in the future.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}