{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4b6c258c-84e5-511d-950f-865a1aaba550","task_key":"default--validation--49834","task_revision_id":"1","upstream_id":"49834","short_description":"HellaSwag validation 49834","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to follow baby led weaning [title] Begin at the appropriate age. [step] Baby led weaning should not be started before the baby is ready. Due to a baby's development, most infants can start baby led weaning at six months of age.\",\"endings\":\"['[substeps] Most baby led weaning begins at six months of age. It usually takes 24 to 24 hours before the baby falls asleep after the first meal.', 'Trying to start baby led weaning earlier, like at four month of age, may pose choking risks. [substeps] Your baby will demonstrate that they are ready developmentally to make the transition from breast milk to food.', 'This gives babies their first weaning. Start by taking the baby to your local supermarket or baby store and offering food (hence the name).', '[substeps] The best time to begin baby led weaning will vary between individuals. You may decide to start the weaning around the age of 11 months, or only start it around that 12 month mark.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}