{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a40ae887-2db1-5f4c-85e2-b0fd87d9f8fa","task_key":"default--validation--44996","task_revision_id":"1","upstream_id":"44996","short_description":"HellaSwag validation 44996","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to make a rope braid with only two strands [title] Brush your hair. [step] Your hair should be smooth and free of tangles when you begin to make the rope braid. Use a brush or comb to thoroughly brush any knots or tangles out of your hair.\",\"endings\":\"['You can use a moisturizing cream to smooth your hair out if it is not complying. [substeps] You can also dampen your hair with water to make it easier to put back in a ponytail and braid.', 'If you have fine, fine hair, you can skip the brush or comb and just use the palm of your hand to tousle your hair into the braid. [title] Wrap a piece of cord in a cheesecloth.', 'Your hair should also be relaxed and even. [title] Tie a few strands of hair in two bows.', '[substeps] Use a texturizing hairspray or mousse, which has been approved by the american academy of hairstylists. To make the rope braid, rub a water conditioner into your hair and smooth it down using a plastic comb.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}