{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5c3360b7-a3df-5e10-88c6-ea3fbfb3052d","task_key":"default--validation--16888","task_revision_id":"1","upstream_id":"16888","short_description":"HellaSwag validation 16888","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to go from black to blonde in one night [title] Slather a deep conditioning product on your freshly washed hair. [step] Towel dry your hair and then drench it in the conditioner. The best product to use is cholesterol, which is sold in jars and can be easily found in most beauty supply stores.\",\"endings\":\"[\\\"If you can't get that, use the strongest deep conditioner you can find. [substeps] Run a wide-toothed comb through your mane to untangle it and distribute the conditioner well.\\\", 'Avoid using a deep conditioning product after you shower because cholesterol can get trapped in the hair follicles which means it is harder to do to your hair. [substeps] Make sure to only use conditioner through the roots and not through the tips.', '[title] Apply your foundation at least a few minutes before you go to bed. [step] Make sure you cover all of your face to give your pores extra coverage.', 'Search online for body conditioners by using your fingertips. [title] Swap out your earplugs for some serums.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}