{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"64ef3b07-85d2-5551-9d60-2c96fd8f92f4","task_key":"default--validation--8280--variant-671c59e9121f","task_revision_id":"1","upstream_id":"8280--variant-671c59e9121f","short_description":"HellaSwag validation 8280","config":"default","split":"validation","body":"{\"activity_label\":\"Computers and Electronics\",\"ctx\":\"[header] How to drug test someone [title] Use laboratory testing to drug test employees. [step] Laboratory tests require the patient to go to a specialized facility. Lab tests are more accurate than take-home tests and are what you should use if you plan on drug screening employees or job applicants.\",\"endings\":\"['These tests will depend on a number of factors such as age, sex, and health. [substeps] For instance, medical schools often need laboratory tests to test low blood sugar and high cholesterol, especially in individuals over thirty or more years of age.', \\\"[substeps] Medical tests focus on determining an individual's level of risk and how he or she will deal with medical issues. Some facilities require the drug tested first, while others require testing as early as six to eight weeks later.\\\", '[substeps] Get detailed procedures by various pharmacies and look for lab testing information available on the website of your local pharmacy store. [title] Ask your pharmacist or health professional to show up at the testing clinic.', '[substeps] In a laboratory setting, there will be less of a chance of sample tampering. Drug tests that evaluate hair and saliva will usually have to be sent to a lab.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}