{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"252ed693-5b5e-5230-9ca3-754345782264","task_key":"default--validation--26716","task_revision_id":"1","upstream_id":"26716","short_description":"HellaSwag validation 26716","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to get a child to go to sleep [title] Recognize how much sleep your child needs. [step] Depending on how old your child is, she needs a different amount of sleep for her well-being. Make sure that her overall sleep time includes naps if she is 5 or under.\",\"endings\":\"['The same goes for your child if she is over 12 months old. Teens generally need about seven to eight hours of sleep each night.', 'The recommended time to sleep in hours by age is : [substeps] Infants 0-2 months require 10.5-18 hours daily. Babies 2-12 months need 14-15 hours daily.', \\\"Younger children usually need 1 or 2 hours of sleep, depending on the age of the child. [substeps] Avoid reducing your child's sleep time to 1 hour each night if she is 10 to 12 years old.\\\", '[substeps] More sleep is okay for older children as well, but as the baby ages, their needs become more specific. If your child is younger, you should only feed her if she requires it and eat food when she is tired.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}