{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7223c97a-68d2-5217-ba65-aab933568394","task_key":"default--validation--2739","task_revision_id":"1","upstream_id":"2739","short_description":"HellaSwag validation 2739","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to stimulate a 12 month old's senses [title] Babies thrive on routine, so it's not only \\\" okay \\\" it's desirable to have your one year old on some sort of schedule. [title] Alternate times of stimulation with times of rest. [step] This lets a baby's brain process what she or he has taken in.\",\"endings\":\"['A 5-month old might lack many of these benefits, however. Talk with your doctor about how to alternate use, if this is an important concept.', '[substeps] All babies are different; some crave sitting in your lap and reading, others could not care less at this age. Offer an activity at several peaceful times and if the baby rejects it completely, go on to something they do like.', \\\"It even helps if you make sure to be consistent during the day. [title] Make sure your one year old eats quality food and not bland food; this is the main reason why your little one is this tiny person's sanctuary.\\\", \\\"But don't use that time for demanding pursuits. [title] Incorporate activities that your baby already does whether it's walking around a local mall, playing fetch with friends, or attending the annual art festival.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}