{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f1605304-bbf7-5ecb-8c68-959f010d5851","task_key":"default--validation--35980","task_revision_id":"1","upstream_id":"35980","short_description":"HellaSwag validation 35980","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to prevent nail fungus [title] Wash your hands and feet regularly. [step] Washing your hands and feet regularly with warm water and soap (including washing your feet at least once a day when you have a shower) helps to keep them clean. This, in turn, minimizes the chance that a fungal infection will grow on your nails.\",\"endings\":\"['[substeps] Pay special attention to your nails during hot weather. When wet, they can catch a fungus.', '[substeps] Make sure to wash your hands before and during touching the base of your nails. If you touch any solid objects, you are at risk of contracting a fungal infection.', 'Make sure that you wash between your fingers and toes, as well as over the nails themselves. Regular and thorough washing is one of the best things you can do for prevention.', '[substeps] Soak your hands in both warm (not hot) water and soap before you touch your cuticles or any other spot containing bacteria. Leave the soap on your hands and feet for at least 30 minutes before scrubbing and rinsing your hands.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}