{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"19428576-5cbb-53f3-94af-1a85ee1088c2","task_key":"default--validation--38728--variant-b001f500630a","task_revision_id":"1","upstream_id":"38728--variant-b001f500630a","short_description":"HellaSwag validation 38728","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to be yourself and impress others [title] Create yourself! [step] You may not know who you are, what you like, what you want to do in life, but this is okay. Create yourself, don't find yourself, create yourself. Create your own personality, but be yourself.\",\"endings\":\"[\\\"Creating your personality doesn't mean copying others, but you can always get influence. Have confidence, a good sense of style and a contagious smile.\\\", 'Start off trying to feel confident, a natural quality that may help you succeed in work. Your self confidence is what makes you who you are.', 'Act as a part of an abacus, don\\\\'t resist being yourself. [substeps] For example, if you love traveling, always go to your destination, don\\\\'t just say, \\\" i have a lot of fun traveling.', \\\"Don't be sloppy and make you look pale. You don't have to be perfect, you just have to be yourself.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}