{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b05369dc-c98f-5488-a61e-4b8b7cd853f8","task_key":"default--validation--25582","task_revision_id":"1","upstream_id":"25582","short_description":"HellaSwag validation 25582","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to do an ariana grande ponytail [title] Give your hair volume. [step] Put some dry shampoo or hairspray in your hair, and tease the front section of your hair. You can also use volumizing mousse on dry hair and blow dry it to add some volume.\",\"endings\":\"['This teasing will prevent kinks and frizz. [title] Give your hair a deep side part.', '[title] Start with hair in the desired ponytail. [step] Find the top section closest to your head.', '[substeps] Teasing is the method of creating texture where you use a teasing brush or flat oval brush to comb small sections of your hair backward. Start in the center of a section of hair and draw your brush back in quick strokes toward your head.', '[title] Spray a volumizing hair oil on your damp hair. [step] Set your teased hair in your hands on a flat surface for a few seconds and then brush your hair out so that any waves or frizz come out.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}