{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f91397c8-8657-52f5-823c-410ae9b34e90","task_key":"default--validation--16889","task_revision_id":"1","upstream_id":"16889","short_description":"HellaSwag validation 16889","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to tell if jordans are fake [title] Examine the quality of the box. [step] Real jordans come packaged in a sturdy box. The lid should fit tightly, with no gaps.\",\"endings\":\"[\\\"Be sure to also assess the durability of the box's lid. Before you buy a jordans box, ask your retailer or shop to provide you with a detailed list of optimal durability methods.\\\", 'Valid fake mefixes often come with cover tabs that : [substeps] Have an unpleasant sound or scent which visitors can detect. Do not cover the lid when you lift it.', 'There will be an air jordan \\\" jumpman \\\" logo on the lid and also on the side of the box. The printed colors on the packaging should appear even and uniform, with no areas of fading.', 'As for authenticity, read the box under a care light to determine if it is quality. Is it the perfect size? If so, this means the box is not fake.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}