{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5325b60f-b1e4-5a25-98ec-57e0c5dbcdd5","task_key":"default--validation--10553--variant-ac87a5283735","task_revision_id":"1","upstream_id":"10553--variant-ac87a5283735","short_description":"HellaSwag validation 10553","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to treat malaria [title] Determine if you're at risk of malaria. [step] Though certain populations are at higher risk, anyone can get malaria. You should be aware of the risk factors to know if there's a possibility you've contracted the disease.\",\"endings\":\"['Some organs, such as the liver, kidneys, and intestines. [substeps] Bladder infections, for example, are seen by doctors as the risk factors for malaria.', 'Contact your local health agency and educate them about any other risks you might be experiencing. [substeps] A lot of people, as humans, who have had malaria in their lives have been directly affected by its effects on their bodies.', 'In very rare cases, it can be spread through blood transfusions or organ transplants if the medical staff has made a mistake in screening the donor. Sharing needles for injection can also spread the disease.', 'The more you know about the symptoms, the better equipped you are to prepare for the diagnosis, if necessary. [substeps] If you have to know the specific conditions in your area, such as high blood sugar, you may be at high risk of getting malaria.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}