{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ee69d90f-46e2-52fa-9396-c3aaa0d67ada","task_key":"default--validation--40039","task_revision_id":"1","upstream_id":"40039","short_description":"HellaSwag validation 40039","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to style a toddler boy's hair [title] Use light-hold gel and a brush for a shower-fresh look. [step] Pour a quarter-sized amount of gel onto your palm, then rub your palms together. Use your hands to work the gel through short, slightly damp hair.\",\"endings\":\"[\\\"This will work the gel through all of your hair, such as roots. Once you've spread gel through, use a brush to slick your hair back.\\\", 'Give your hair a light misting with your hair gel, then fluff the hair from the base with a comb. [substeps] Smooth the hair out by running your fingers through it.', 'Work the gel in from hairline to hairline, starting on the sides. Leave the gel in for at least 1-2 minutes, and then brush the gel off of your hair once you are finished.', \\\"You can either smooth down your toddler's hair to make it lay flat, or create some messy spikes over the top of his head. Smooth down the sides of his hair with your palms.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}