{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e74f7ff1-c832-5220-bb9b-aee26c59361b","task_key":"default--validation--21213","task_revision_id":"1","upstream_id":"21213","short_description":"HellaSwag validation 21213","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to straighten your hair [title] Wash and blow-dry your hair. [step] Straightening your hair works best on freshly washed or day-old hair. When washing your hair, tailor your shampoo and conditioning products to your hair type.\",\"endings\":\"[\\\"This includes your normal hair, oily hair, and thick hair. Since straightening hair in these three categories will dramatically alter it, you'll want to be sure to only get the most consistent hair.\\\", '[substeps] The direction in which your hair straightener blows-dry your hair usually resembles the direction from your roots to your ends. Your scalp and hands typically look the healthiest when drying your hair, but your hair will still look dirty and tangled.', 'For thick, frizzy hair, use a smoothing shampoo and conditioner. For thin, flat hair, use volumizing products.', \\\"If your hair is already tightly conditioned, it doesn't need to be so tight. [substeps] Unlike other hair types, straight hair can typically be straightened with a little effort.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}