{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"43336b51-3b60-51b0-9298-14b7d070d844","task_key":"default--validation--38490","task_revision_id":"1","upstream_id":"38490","short_description":"HellaSwag validation 38490","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to ready a young child for ballet class [title] Get a dance bag. [step] In most dance studios, they sell merchandise such as leotards, tights, shoes, and duffel bags. They come in all sizes, patterns, and prints so get one that is right for your child.\",\"endings\":\"['If they are only in ballet, get a small bag that will hold their leotard, tights, ballet slippers, hair items, and spare shoes. If your child is in more than one dance genre (jazz, acro, musical theater, hip-hop, lyrical, tap, etc.', 'For more instance, a sock puppet is good for your toddler because they are laying down when the teacher starts moving up and down. You also can buy a pre-pressed corset from the store that the grocery store delivers.', '[substeps] For example, if your child is 15, then find a store that sells different kinds of items like necklaces, a scarf, and a beanie. Avoid online stores and stores that have extra sizes.', \\\"Make sure that it is a so-called no-cost bag specifically designed for children to use. [substeps] If you don't feel comfortable wearing a budget bag, purchase a larger one so that you don't need a crowded space.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}