{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"26664a60-b370-5444-ba01-e083dead0812","task_key":"default--validation--21664","task_revision_id":"1","upstream_id":"21664","short_description":"HellaSwag validation 21664","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to treat flu in toddlers [title] Keep your child hydrated. [step] Children may forget to drink enough fluids when they are not feeling well. In addition, you child will lose water faster than usual if her body is producing mucus or if she is running a fever.\",\"endings\":\"[\\\"Answer all the pediatrician's and physician's questions as well. Also, get your child more fluids when they are thirsty in order to help them lose water faster.\\\", \\\"Offer her plenty of liquids frequently and encourage her to drink even if she isn't thirsty. [substeps] Good drinks include water, juice, clear broth, or warm lemon water.\\\", 'Offer a hot water bottle at dinner, and when it is full, have your toddler drink a cup of water. [substeps] Take the bottle to your toddler to get his juices flowing.', '[substeps] Provide hydration every three to four hours, or whenever your child is thirsty. If you notice your child crying at bedtime and she does not drink enough, take her temperature every hour or so to ensure the child gets enough fluids.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}