{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b4a60049-e060-5426-a86f-7e4ce78aa153","task_key":"default--validation--43246","task_revision_id":"1","upstream_id":"43246","short_description":"HellaSwag validation 43246","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to towel dry hair [title] Get a soft towel or t-shirt ready. [step] When you're towel drying your hair, it's best to use a very soft towel or even an old t-shirt instead of a coarse, nubby towel. Using softer material will prevent your hair from getting tangled and damaged when you dry it.\",\"endings\":\"[\\\"[substeps] Other general reasons you should towel dry your hair include night of sweat, need a shower, and going to the bathroom. You don't want to use a towel that is too rough.\\\", '[substeps] Be careful not to bring the towel too close to your hair, or else it will bunch up under the towel. Towel drying dries your hair very quickly so be sure to only use soft towels as you dry your hair.', '[substeps] You could use any towel, but a clean, soft t-shirt could work for this step. [title] Use a hair dryer on low heat.', \\\"[substeps] When you use a soft towel, your hair cuticle lies flat, so it dries in nice, glossy waves or curls. When you use a coarse towel, it's more likely to frizz.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}