{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b78284f0-4b28-5514-99cf-4978a290d5d4","task_key":"default--validation--26832","task_revision_id":"1","upstream_id":"26832","short_description":"HellaSwag validation 26832","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to identify a gifted child [title] Pay attention to your child's memory. [step] Gifted children tend to have a greater memory than average children. Oftentimes, you may notice memory in unexpected, somewhat subtle ways.\",\"endings\":\"[\\\"However, this makes it easy to evaluate your child's memory. [substeps] Your child may seem strange when they're young.\\\", 'The child may forget to mention certain things (depending on the age of the child) later on. Look out for any telltale but sudden changes in memory.', \\\"[substeps] Gifted children may seem distracted during their activities. They may forget something when they're studying or trying something new.\\\", 'Keep an eye out for signs of a superior memory. [substeps] Children may remember facts better than others.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}