{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"93f658ca-5454-5c5e-9305-93f894dce342","task_key":"default--validation--39378","task_revision_id":"1","upstream_id":"39378","short_description":"HellaSwag validation 39378","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to blow dry curly hair [title] Wash your hair. [step] You will need to wash your hair before drying it, but do not wash your hair every day if possible. When you do wash it, do not use shampoo every time.\",\"endings\":\"['Just use a little bit of conditioner to remove any condition. [title] Squirt some coconut oil in your hand and rub the oil on your hair in a couple of sections.', 'Make sure your hair is completely dry when you get out of the shower. [title] Chop up some handfuls of hair into fine bunches, then chignon half of your hair over your head.', 'Instead, shampoo it four or five times per week and then rinse. [substeps] If you have curly hair, use a wide-tooth comb to gently detangle your hair.', 'Do not aggressively rub the shampoo into your hair. Instead, let the water run through it, and gently massage your scalp.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}