{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f37b236d-b38c-5940-b3fe-0eee25dc3998","task_key":"default--validation--13823","task_revision_id":"1","upstream_id":"13823","short_description":"HellaSwag validation 13823","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to make a diaper stroller [title] Use size 1 diapers to form the stroller. [step] There are many different ways of assembling a diaper stroller, some more complicated than others, so the list of materials varies depending on the desired finished product. However, since most newborn babies wear size 1, that is the best diaper size to use.\",\"endings\":\"['While many baby kits such as baby formula stations, egg feeders, and general infant carriers require large diapers, this method requires larger diapers to form a stroller. [substeps] Start by altering the size 1 diaper to a smaller size.', '[title] Use a diaper that folds even, rather than folding well. [step] This will make changing a diaper much easier.', 'Diaper stroller ideas can be found here. [substeps] Size 2 diapers should form the base of the stroller, using narrow sections of material such as a piece of soft net for straps.', '[substeps] If multiple babies are expected, the person can make a different looking diaper stroller for each one. [title] Form the wheels of the stroller.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}