{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2c8d7228-1398-54cd-99d6-c8ed472025b7","task_key":"default--validation--44985","task_revision_id":"1","upstream_id":"44985","short_description":"HellaSwag validation 44985","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to detox an alcoholic [title] Suggest a visit to the doctor. [step] Encourage your loved one to visit their primary care physician and be honest with the doctor about drinking habits. Friends and family members are likely to be more forthcoming than about the person's drinking habits, so request to tag along during the visit and, if prompted, offer your perspective to the doctor.\",\"endings\":\"[\\\"Tell your loved one that there is a chance that they may recommend an alternate way to self-medicate, such as a full night's stand or an alcoholics anonymous anonymous ritual. [title] Be deactivated, if needed.\\\", 'Keep in mind, though, that certain forms of alcohol use often raise the risk of overdosing. [title] Discuss detox strategies with your loved one.', '[substeps] An alcoholic may only be willing to tell their doctor part of the problem. Without all of the information, their doctor may have difficulty developing a treatment plan.', '[substeps] You might say, \\\" i enjoyed noticing you drinking and thought it would help you to cope better. But i\\\\'ve noticed you\\\\'ve started drinking now and still seem to need to see a doctor because alcohol affects all of us.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}