{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"fb643fc9-bf45-5e07-a72e-0076eb745c68","task_key":"default--validation--45622","task_revision_id":"1","upstream_id":"45622","short_description":"HellaSwag validation 45622","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to point cut hair [title] Wet the hair and comb out any tangles. [step] For the best results, wash and rinse the hair before you begin to cut it. While the hair is still wet, comb through it to release tangles and remove loose hair.\",\"endings\":\"['[title] Loosen stubborn tangles with hairspray. [step] Shake several feet of hair out and use a wide-toothed comb to gently work through tangles.', 'Allow it to dry before you begin cutting. [substeps] Unlike teasing or coarseness, teasing is easier to do with hair just a bit damp or a bit heavier than as with teasing and coarseness.', '[title] Cut from the bottom of the head. [step] Start from the hairline and move down to the back of the head until you reach the center of the head.', '[substeps] Textured or tightly coiled hair should be dried and straightened before being point cut. [title] Comb thin , 2 inch (5 cm) long sections of hair into your fingers.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}