{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"39809db2-dc5c-5979-a642-0f0b2b3c7be7","task_key":"default--validation--6754","task_revision_id":"1","upstream_id":"6754","short_description":"HellaSwag validation 6754","config":"default","split":"validation","body":"{\"activity_label\":\"Youth\",\"ctx\":\"[header] How to avoid getting sick at school [title] Wash your hands as often as possible. [step] Wash your hands thoroughly with warm water and soap before you eat, and after you use the restroom or come into contact with anything that other students have used before you. Washing your hands often may cause dry skin, so carry moisturizing lotion during winter months.\",\"endings\":\"[\\\"[substeps] First wet your hands with warm or cool running water, and add soap. The water doesn't need to be hot to clean germs and microbes from your hands.\\\", '[substeps] If your school allows hand washing, then take care to do so after a meal. If you make a mess in the bathroom, then you are much more likely to get sick at the end of the day.', '[substeps] Call ahead to inform teachers of your sickness by phone or text message. Otherwise, bring a copy of your school paper with you to school.', \\\"[substeps] While it's convenient for you to use the bathroom on your own, you may want to substitute soap when you're traveling. Some people use sanitary hand sanitizers for the bathroom.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}