{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"98f4247e-889f-5d18-8f99-023772360c7a","task_key":"default--validation--8627","task_revision_id":"1","upstream_id":"8627","short_description":"HellaSwag validation 8627","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to help your baby reach delayed physical milestones [title] Take your child to the doctor. [step] If you believe that your child may be experiencing developmental delays in any area, take them to the doctor immediately. Your doctor can determine if there is a delay by using strict screening guidelines.\",\"endings\":\"['This ensures that babies only have one or two developmental delays each year. With each delay, the doctor will perform visual tests along with a physical exam.', \\\"They will generally confirm each step one by one, but the doctor may also refer to your baby's pediatrician for further instructions. [substeps] The doctor may start by reviewing your baby's weight; then, they may refer to your baby's fitness level; and then they may determine the condition of each stage of symptom.\\\", 'Measure the amount of times the child has undergone stage one (known as the \\\" full phase \\\"). [substeps] If your child consistently skips that phase, then they may be pregnant or experiencing unwanted physical symptoms.', \\\"[substeps] It is important that you keep up with scheduled pediatrician visits even if you haven't seen evidence of delays. The doctor may be able to notice lags or delays that you haven't picked up on yet.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}