{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"06dbcbe5-87cc-517c-9e8f-452ef9647e04","task_key":"default--validation--21376","task_revision_id":"1","upstream_id":"21376","short_description":"HellaSwag validation 21376","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to stop using inhalants [title] Always remember that almost any product used in the home can be abused as an inhalant. [step] They have safe legal purposes but can be deadly if used incorrectly. Among them are whipped cream containers, toxic dry erase/permanent markers, paint, glues, and even bath salts.\",\"endings\":\"['If it is used inconsistently, it can cause serious health problems such as liver damage, bladder, and colon cancer. [substeps] Also, it has been linked to increased peptic ulcers, damage to the lungs, and corticosteroids.', 'All of these substances contain carcinogenic components, which are harmful to those under the supervision of a pathologist. Therefore, it is important to clearly tell the pros and cons of every product before choosing.', 'Then there are much worse ones such as gasoline, propane, freon and butane. [title] Understand that alcohol and cigarettes are much more likely to be abused as drugs.', \\\"Many people who use the supplies in bath tubs may end up with an overdose of an illegal substance, or an accident, on their hands. The best solution is to keep the container in a place away from light and fumes that may impact the body's ability to process the substance.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}