{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"79a08405-57cc-5780-b3d5-4b98a3100154","task_key":"default--validation--4584","task_revision_id":"1","upstream_id":"4584","short_description":"HellaSwag validation 4584","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to find a symbolic baby name [title] Pick family names. [step] Naming your child after your grandparents, uncles, and aunts is a way to make that person live on in the next generation. It ties your child's name into the heritage of your family.\",\"endings\":\"[\\\"It is likely that a given child's name is one that is repeating those names from the 10 most foundational generations from your grandparents' robes. [substeps] You want the gender of the parents in your birth canal experience, to show how they differ from other children whose names are traditionally included in fitting names.\\\", \\\"Thus, this is a way to make your baby's name symbolic both of a person who you admire and your family more generally. [substeps] Sometimes family names have become outdated and would sound off-putting in the modern world.\\\", \\\"You can even use your personal personality to your advantage. [substeps] For example, if your grandmother has long been growing up in that house, it's probably a series of names.\\\", 'To name just 4 people, the birth name is \\\" elizabeth, jul-we love to refer to ourselves as \\\" twins \\\", \\\" about. \\\" you can also use it to make your baby name come later when the details of the child\\\\'s name have arrived.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}