{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e0e55845-b129-5f27-aa60-9427ecb1cd28","task_key":"default--validation--44489","task_revision_id":"1","upstream_id":"44489","short_description":"HellaSwag validation 44489","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to choose developer for hair color [title] Use volume 10 developer to lift your color a single level. [step] Volume 10 is the weakest developer level, as it contains only 3% hydrogen peroxide. Volume 10 is a good option if you are going just a bit darker than your current hair color and you do not need to lift, or remove, any of your existing color.\",\"endings\":\"['[substeps] It is also recommended if you have thin or fine hair, as it will not be too strong. This developer is also ideal if you are going to be using toner on your hair because it will balance out the toner.', '[title] Decide if you want to go darker. [step] Darker hair makes your hair color reappear more abruptly.', \\\"Don't worry-it will be back to normal within a day or two. [title] Dilute product with developer 10 to give the product your very name.\\\", 'It is easier to have it lifted than to straighten and restore hair without actually wanting to. Using volume 10 developer will keep it from being bleached and all of your color will be visible, even if your hair is very light.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}