{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"445d7faf-e669-5658-a050-959a64f496bd","task_key":"default--validation--3337","task_revision_id":"1","upstream_id":"3337","short_description":"HellaSwag validation 3337","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to do headband curls [title] Brush your hair. [step] Before you dive into making your headband curls, brush or comb your hair to remove knots. Brush or comb the tips of your hair, then hold the brush an inch or so higher and brush down through your hair.\",\"endings\":\"[\\\"Use short strokes, about one to two inches, on your hair. [substeps] When you're styling your hair, it's best to brush it out first.\\\", \\\"When you're finished, it should feel soft and silky under your fingers. [substeps] Don't like the length? Leave about ½ to ¾ of a-half inch of hair to span between your brows.\\\", 'Keep working your way up your head, brushing in downward motions, until you reach the top of your head. [substeps] Having knotted hair will make doing this hairstyle harder, and it will make your curls less defined.', 'Comb the hair as you brush to dislodge any knots. [substeps] If you have very coarse hair, you can skip this step.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}