{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"bc77e5b8-32dc-52a7-af58-aac074593aee","task_key":"default--validation--36059","task_revision_id":"1","upstream_id":"36059","short_description":"HellaSwag validation 36059","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to wear a cargo skirt [title] Choose a skirt length based on your body and preference. [step] Cargo skirts usually hit at or above the knee. Shorter or petite girls might choose a shorter, above-the-knees style to lengthen their legs, while those with wider hips or thighs may want to avoid a skirt that cuts off at the widest part of the thighs.\",\"endings\":\"['When in doubt, go with a knee-length cut, which is flattering for all body types. [substeps] Maxi-length cargo skirts are also available.', 'Top it off with a color that brings out the color of your own skin. [substeps] Choose a long black or grey skirt if you have pale skin.', '[substeps] If your body is proportional to your skirt length, or you are curvy and it measures above your knee circumference, then your skirt should be of this size. It should not spike up to the knee when worn.', '[substeps] Consider how wide you want your skirt to be. Skirts that fall just below the knee should be longer than skirts that hit below the knee.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}