{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f6463621-3423-59f7-a5c5-2acb0c4c0940","task_key":"default--validation--45922","task_revision_id":"1","upstream_id":"45922","short_description":"HellaSwag validation 45922","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to change wavy frizzy hair to straight hair [title] Rough dry your hair. [step] If you already blow dry your hair, the way you position your blow dryer may be contributing to your frizzy hair. When drying your hair, shake the dryer over your head, back and forth, until your hair is 80% dry.\",\"endings\":\"[\\\"[substeps] Keep your blow dryer's nozzle face down, otherwise your hair will frizz. When hair is 80% finished, apply a smoothing or anti-frizz serum, before completing your blow out.\\\", 'When sitting down, gather your hair in the palm of your hand and scrunch it for three to five minutes. [title] Use a food processor or blender to blend your hair.', 'This article will also refer to hair softening methods. [substeps] Your hair may still remain shinier after it is dry.', 'At this point, your hair should feel almost like wet noodle hair. [title] Apply the mousse to damp your hair while it is still damp.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}