{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e82d1431-b71f-5208-8ec7-20b43e071eca","task_key":"default--validation--21426","task_revision_id":"1","upstream_id":"21426","short_description":"HellaSwag validation 21426","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to choose educational tech toys for your kids [title] Consider the child's age. [step] Not all educational tech toys are appropriate for all ages. This means you should think about the child's age as you choose one.\",\"endings\":\"['Most toys have suggested ages on the package, which can help you choose the right product for the right age. [substeps] Though the child may be able to use a toy designed for an older kid, think about the toy parts.', \\\"Younger children have a better chance of absorbing the material they're given, so they have more eyes to draw on. Some educational toys are designed specifically for older children and usually contain a specific theme, or single curriculum.\\\", 'Preteens between 8 and 14 years of age can choose any toy they want. Preteens younger than 4 years of age may choose any toys they want.', 'At this age, you will have to handle this information for any board games that you have to encourage them to play. [substeps] Showing the child how to read and write well builds your bond with them.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}