{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a4b39445-c6c1-5bca-81ec-91830ee8a927","task_key":"default--validation--33412","task_revision_id":"1","upstream_id":"33412","short_description":"HellaSwag validation 33412","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to spike your hair [title] Wash your hair. [step] It is important to start with clean hair that is free of any product. Start by washing your hair with a quality shampoo and conditioner.\",\"endings\":\"[\\\"It shouldn't be dry, or without conditioner. [substeps] How often will you wash your hair? Most people only wash their hair once a week, but you can switch to more frequent washings every three to four weeks.\\\", \\\"Some shampoo will help ensure that it does not leave your hair tangling. Some can help you detangle your hair without making it tangle, but don't buy any too pricey as they are more effective.\\\", 'Look for a shampoo that is made for your hair type. If you have thick hair, avoid using too much conditioner as you do not want your hair to be too slick to hold on to any product.', \\\"Don't wash your hair conditioner on the day of your hair test or the day you will have your laser-bleached hair! If you have a strand of hair to spike, wash it afterwards in the shower. If your hair is already bleached, run your fingers through your hair to determine how much product it needs and how long it will take to spike.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}