{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"edd12208-8823-5f89-adc5-ad00ea8b7fc4","task_key":"default--validation--21314","task_revision_id":"1","upstream_id":"21314","short_description":"HellaSwag validation 21314","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to handle tantrums from your blind or visually impaired toddler [title] Observe your child's behavior. [step] As your child gets older, you will see and observe new behaviors that were not there before. These behaviors may not fit into what you would identify as developing skills.\",\"endings\":\"['Learning to recognize the cues that are making your child anxious can help you avoid lashing out. [substeps] For example, your child may act very polite if they are being treated badly.', \\\"[substeps] Missing exercise due to vision impeders can have negative impact on your child's daily life. Eating out late, misplacing the food you bought at a store, and playing in the car with friends are examples of this behavior.\\\", 'It is important to note that all children will go through these phases, and this is a normal part of growing up. However, many of these \\\" problem behaviors \\\" may be unfamiliar or unexpected, and they can change quickly.', \\\"However, your child may be developing some skills. These behaviors may add to your child's needs.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}