{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"822073cf-feb6-5535-9364-ea45fe43d8cd","task_key":"default--validation--11575","task_revision_id":"1","upstream_id":"11575","short_description":"HellaSwag validation 11575","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to dye your hair chocolate mauve [title] Lift the color from dark hair with bleach. [step] To get dark hair to accept light mauve and pink tones, you must lighten the color in the top layers. Bleach is the only way to lighten dark brunette hair, but it can do serious damage to your locks so it's best to see a professional.\",\"endings\":\"['[substeps] Take a straightener with a nozzle attachment and dip it into the bleach solution. Tug gently on the roots of your hair to blend the color.', 'Use bleach 1 for each of your dyed hair colors. Rinse out the bleach solution and shampoo your hair thoroughly.', '[title] Protect your hair with hairspray. [step] Part your hair on the middle and use a wide-tooth comb to spray each layer of your hair with the temporary tint that you will use in the summer.', \\\"[title] Allow the roots to grow out for several weeks. [step] You'll want your brunette roots to be fairly obvious when you apply the mauve tones to add the chocolate warmth.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}