{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"abb76060-abd4-5a73-b9fd-cf46e9346025","task_key":"default--validation--42189--variant-2086a4469524","task_revision_id":"1","upstream_id":"42189--variant-2086a4469524","short_description":"HellaSwag validation 42189","config":"default","split":"validation","body":"{\"activity_label\":\"Home and Garden\",\"ctx\":\"[header] How to take an inch off your waist [title] Try an at-home body wrap. [step] In order to do this wrap you'll need lotion, clear plastic wrap and an elastic reusable bandage (like the kind you'd use on a sprained wrist). Once you've obtained the necessary items, perform the following instructions right before you go to bed : [substeps] Apply the lotion to your stomach and waist area in a thick layer.\",\"endings\":\"['Insert 1 tablespoon of lotion into a clean, dry cotton ball or towel. Seal the covering with tape or another adhesive.', \\\"Spread cold compresses about 15 minutes before bedtime if you're feeling cold. Cover your waist area with a bandage before you sleep.\\\", \\\"Don't massage the lotion too much into your skin. Wrap the clear plastic wrap around your waist, on top of where you put the lotion.\\\", 'Give it about 5-6 minutes to absorb. Wipe off any oils or lotion before bed.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}