{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"39943bab-74c0-570d-bc8f-b5a543fbcb1b","task_key":"default--validation--7122","task_revision_id":"1","upstream_id":"7122","short_description":"HellaSwag validation 7122","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to prevent cat scratch disease [title] Know if you are at risk. [step] Some people are more likely to get csd than others. Organ transplant patients, infants and young children, and pregnant women are more likely to get diseases from animals.\",\"endings\":\"['[substeps] African american women and their kids younger than 18 are at higher risk for developing csd. Breast cancer can be a possible cause of csd.', 'You should also be aware that some people (generally disabled or under) are at an increased risk of getting diseases from humans. [substeps] If you are a disabled person or have a history of stress or illness, your risk for csd is higher than usual.', \\\"If your cat's immune system is compromised, s/he could take some medications such as insulin, antibiotics, or a prescription pain reliever. People you know or are friends with may be at greater risk for csd than they are for humans because of their immunity to it.\\\", 'Those who are immunocompromised, or have a weak immune system, such as people with hiv, should be extra careful about getting csd. [title] Wash your hands after handling your cat.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}