{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c1286945-a2b7-58ee-a5b8-539ec83ef140","task_key":"default--validation--22533","task_revision_id":"1","upstream_id":"22533","short_description":"HellaSwag validation 22533","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to use antibiotics effectively [title] Take only antibiotics specifically prescribed for you. [step] The doctor chooses an antibiotic and the dosage based upon your state of health, your weight, and what microorganism (s) are causing your infection. This minimizes the risk of side effects.\",\"endings\":\"['Do not take medication that has not been specifically prescribed for you and your medical condition. [substeps] Let your doctor determine the treatment plan.', 'In addition, it keeps your doctor up to date on your medical history. [substeps] While antibiotics are very effective against various pathogens, they cannot effectively treat a variety of ailments.', '[substeps] Make sure to always rinse the medication away after taking it. If you go to a pharmacist, see them whenever it comes in.', 'Avoid taking antibiotics for several days to two weeks, as they may cause your infection to grow out of control. Examples of specific antibiotic treatments that are frequently prescribed to you: the following : [substeps] Aspirin 10 days: probably recommended for infection with a bacteria that is known as keratitis.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}