{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"253466d2-ef52-52a3-8fd6-a7c905d7af3a","task_key":"default--validation--26724","task_revision_id":"1","upstream_id":"26724","short_description":"HellaSwag validation 26724","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to wear skirts [title] Choose a pencil skirt if you want a classic, streamlined silhouette. [step] The pencil skirt starts at the waist and ends just above the knee. It is fitted, tapering down to the knees, and has clean, tailored lines.\",\"endings\":\"['Pencil skirts end up looking slimmer in the fall, when the weather will be cooler. They have to fall well below the knee for a classic look.', 'You may also choose a pencil skirt if you already have shorter, more formfitting skirts. Pencil skirts also have beadwear and streamlined fronts.', 'They are perfect for formal occasions, including office settings. Here are some chic outfit ideas : [substeps] Pair a black pencil skirt with a black, fitted shirt.', 'Pencil skirts pair nicely with nearly any skirt, from skirts with a crisp knee or plunging waist or short, form-fitting skirts. [substeps] Pencil skirts also come in colors that are flattering to most body types.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}