{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9ccfead1-b6cf-5e08-94db-3de364f6c7fa","task_key":"default--validation--4171","task_revision_id":"1","upstream_id":"4171","short_description":"HellaSwag validation 4171","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to deal with teenage boys [title] Know that going through puberty can change their point of view. [step] Boys normally go through puberty between the ages of 11 and 16. It is during these years that they experience most of their physical changes (including growing taller and developing muscle).\",\"endings\":\"['They start understanding the psychopaths in their teens and need to learn skills to deal with these biological change. Studies show that peers (teens or teenagers) show that teenagers can experience puberty that is related to their individual abilities, even earlier in life.', 'This is especially true of boys who have a harder time getting the muscular build they need to be strong and sporty. [substeps] Boys start developing testosterone at about 16, but boys tend to grow taller as they get older and are more developed.', 'You also go through puberty from four to six months old, and grown some over the years. Parents who disagree with a girl about the situation are another area where girls may experience strong feelings, so find an adult you trust.', \\\"During and after these years they'll normally start to develop their sexuality. They'll start to look at themselves, and others, differently.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}