{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7f884dc9-8ea9-563a-a2ba-a9bf9689a593","task_key":"default--validation--29818--variant-18d0bdc23fb0","task_revision_id":"1","upstream_id":"29818--variant-18d0bdc23fb0","short_description":"HellaSwag validation 29818","config":"default","split":"validation","body":"{\"activity_label\":\"Work World\",\"ctx\":\"[header] How to handle an employee with substance abuse issues [title] Watch out for unusual behavior. [step] There are an array of symptoms that might point to a person being on drugs, because it will depend upon the drug and its properties. For some, drugs will make them drowsy, relaxed, and happy.\",\"endings\":\"['Others might worsen their symptoms with recovery. [substeps] If you see a friend, family member, colleague, or coworker going to a drug store, do not assume the individual is on drugs by their appearance or demeanor, or by their behavior.', 'Other drug-related responses include insomnia and headache, which can be indicative of substance abuse. If you notice any of these symptoms, that includes : [substeps] Trouble remembering details regarding the drug or its effects on you mood, reasoning, or decision.', 'Other people who abuse substances tend to be very energetic and erratic in their behavior. You may notice that the person is always on the move but never seems to actually achieve anything.', 'For others, eye injuries, convulsions, or other issues can also indicate drug addiction. [substeps] It is important to know that these things are merely behavior, not things for you to take measures to prevent.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}