{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8c76d964-221f-5fe5-a005-d65a712f0949","task_key":"default--validation--19188","task_revision_id":"1","upstream_id":"19188","short_description":"HellaSwag validation 19188","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to do scene hair without cutting it [title] Dampen your hair. [step] You can hop into the shower and get it wet, or you can spritz it with water until it is damp. If you decided to wet your hair in the shower, you may want to towel-dry it off until it is no longer dripping.\",\"endings\":\"['[substeps] Very thin hair may need only a small amount of water to dry completely. If so, spritz with water to drop the moisture and make it easier to pull off the other half of your hair.', '[substeps] Stripping the moisture from your hair helps to prepare it for scene hairangling. [title] Work out your curls with a wide-toothed comb.', \\\"It's a great way to save some time and look neat while you're at it. [substeps] Method one is simply wet your hair before you shower-you can skip this if you did choose to style your hair in the shower.\\\", '[title] Apply a volumizing mousse, focusing on the roots. [step] One of the important aspects of scene hair is volume and poof.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}