{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"80e314b9-c226-58d7-b707-b24f52a95a84","task_key":"default--validation--31469","task_revision_id":"1","upstream_id":"31469","short_description":"HellaSwag validation 31469","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to make a sarong [title] Measure your waist. [step] Sarongs are generally just large rectangles of fabric that can be wrapped and tied in different ways. They typically measure anywhere from 66 to 72 inches (168 to 183 cm) across, depending on your measurements.\",\"endings\":\"['[substeps] Hems are of fabric that wrap around your entire waist. Fasten them with twine, easy fasteners, or decorative buttons.', 'Using a fabric tape measure, measure your waist. To measure your waist, measure around the narrowest part of your abdomen between your rib cage and hips.', '[substeps] \\\" waist wrap \\\" is a medium-sized piece of fabric that wraps around your waist. In general, a sarong wraps from around your chest down to your stomach.', \\\"[title] Decide whether you want a slim fit or a looser fit. [step] Check how long you're wearing sarongs for maintenance purposes.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}