{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d4134317-6258-5422-90aa-01b5edcc679a","task_key":"default--validation--34831","task_revision_id":"1","upstream_id":"34831","short_description":"HellaSwag validation 34831","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to help your chronically ill toddler exercise [title] Make an appointment with your child's pediatrician. [step] Your toddler's doctor can help you understand your child's needs, strengths, and limitations. They may also be able to recommend basic exercises that are safe and appropriate for your child's age, physical condition, and overall health.\",\"endings\":\"[\\\"[substeps] Avoid asking your doctor any leading questions during the appointment. Your child is supposed to know their' doctor' better.\\\", \\\"Tell the doctor about your toddler's health history, any current symptoms, and any medications they are taking. [substeps] Depending on your child's condition, your pediatrician may recommend medications to help make physical activity easier and safer.\\\", \\\"[substeps] If you child's doctor does not have a thorough list of approved exercises for their recommendation, you should ask if a physical therapy specialist is in your area. [title] Suggest encourage that your toddler exercise outdoors.\\\", \\\"[substeps] If your toddler's medical needs do not involve exercise or your toddler's health, your doctor may be able to suggest alternative exercises that could ease your toddler's symptoms. [title] Ensure the cramps are minimized.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}