{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6dea9a3d-83f5-5e75-8ed6-e5e1960d481d","task_key":"default--validation--12379","task_revision_id":"1","upstream_id":"12379","short_description":"HellaSwag validation 12379","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to adjust to hair loss and baldness [title] Try to come to terms with your loss. [step] Many (probably all) men panic when they first see a thinning patch in their hair. Hair symbolizes vitality, sex appeal, and youth.\",\"endings\":\"['Even an occasional trim can help curb your worries and allow your hair to return to its natural shape. [title] Keep a diary to keep track of your thinning condition.', 'After your initial attempts, however, slowly and persistently accept your hair as your new warm-up, whether just by touching it or by talking to yourself in the mirror. Beauty can\\\\'t be \\\" shared \\\" with no one but you.', 'Studies show this is especially true of men with disease at their first shave. This is commonly used as a welcoming reminder of youthful vigor and maturity, due to the hair loss as a result of the shave.', \\\"Men fear going bald because they fear that they are losing these things. However, the truth is that it's all in the mind.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}