{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e0fb50f9-9a28-5241-8283-434bbaf924c3","task_key":"default--validation--15455","task_revision_id":"1","upstream_id":"15455","short_description":"HellaSwag validation 15455","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to curl hair with braids [title] Wash your hair. [step] Start by washing your hair as you usually would. Use shampoo and conditioner, especially if you have thick hair that tends to get dry.\",\"endings\":\"['[title] Dry your hair so it is still slightly damp. [step] Let your hair air dry or use a blow dryer.', 'Then, dry your hair as you normally would. Comb out any flyaways, sections of hair, or chunks.', 'Dry your hair and then shampoo and condition it. For voluminous layers, this would likely work better than for narrow hair, since volume traps moisture and tends to be easier to detangle.', \\\"Use a light teasing style when washing it, and leave it to sit for the most amount of time before rinsing it out. Once you're done rinsing the shampoo and conditioner out, gently comb your hair using a teasing brush.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}