{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5af53d9d-a990-5867-a291-0885509e46c7","task_key":"default--validation--6981","task_revision_id":"1","upstream_id":"6981","short_description":"HellaSwag validation 6981","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to tame curly hair [title] Throw out the hairbrush. [step] Using a hairbrush regularly will dismantle your curls and cause breakage and frizz. Use a wide-toothed comb or your fingers while your hair is wet to detangle.\",\"endings\":\"[\\\"Then, use your fingers to gently comb the hair so it's smooth and tangle free. [substeps] The goal is to get through all the tangles-no frizzier hair! Use your fingertips to gently brush the ends of your hair to make them tangle as you do this.\\\", 'If you need to detangle during the day, wet that section of hair and use your fingers to gently comb through it. [substeps] Never brush wet hair--use a wide-toothed comb or your fingers out of the shower.', \\\"Comb it out as necessary to avoid thinning it. You can apply a good conditioner to wet hair when your hair is dry, but don't use conditioner so often to tame it.\\\", 'Comb sections upward, then down to loosen frizz. [title] Apply anti-frizz serum in the shower.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}