{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8cbdcf59-c547-5bd6-9f2c-8a5c7844b059","task_key":"default--validation--36360","task_revision_id":"1","upstream_id":"36360","short_description":"HellaSwag validation 36360","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to pack a diaper bag for a newborn [title] Consider the amount of storage. [step] Select the type of bag that will fit your needs. The bag must have plenty of compartments laid out in an organized manner so that you can store different items in it without needing to bring an extra bag.\",\"endings\":\"[\\\"[substeps] If you have enough space, consider carrying diapers in different compartments. Trying a backpack with a cart in your baby's diaper bag will help to keep your child safe.\\\", \\\"[substeps] For freshwater infants, a small bathtub is a good option since they won't require a bucket. For trash bags, plastic buckets will work just fine.\\\", '[substeps] Look for a bag with accessible pockets that you can keep the things you use often readily available. These pockets might be good for storing your own personal items in, like your wallet, keys, or phone.', \\\"If you want to store all of your diapers in one purse or diaper bag, then include a large zip-top bag. If you plan to have more variety in your baby's diaper bag, then consider a smaller bag, like a.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}