{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d692960f-1369-5106-a318-71563351f94a","task_key":"default--validation--12317","task_revision_id":"1","upstream_id":"12317","short_description":"HellaSwag validation 12317","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to tell if you have body odor [title] Smell yourself. [step] Your first line of defense against troublesome body odor is a keen sense of smell. Take a whiff of potential problem areas, including your underarms, feet and genitals.\",\"endings\":\"['Pop something soft, like a soft quilt, into your nose for a few seconds. Then, gently dust your face with a washcloth and let it soak into your skin.', 'Try to incorporate all facial fluids into your body. By applying some colognes or moisturizing agents while showering and leaving the bathroom after showering in order to help reduce odor, you can help avoid body odor.', 'Place a clean cotton ball in your ear canal and smell around your body for other smell-sensitive areas. The best spot to smell is your armpit.', \\\"While your own body odor is typically tough to distinguish, you may be able to pick up on it if it's strong enough. [substeps] See if you can detect any salty, musty or pungent notes.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}