{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9b6b28fc-29f7-555c-aef4-552c21330bc1","task_key":"default--validation--9920","task_revision_id":"1","upstream_id":"9920","short_description":"HellaSwag validation 9920","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to smell good for boys [title] Don't be embarrassed. [step] Worrying about how you smell, especially to the opposite sex is a natural concern, and not something you should feel embarrassed about. [title] Shower or bathe regularly.\",\"endings\":\"[\\\"[step] Even if you are not perfectly clean, you don't want to smell like you just washed your hair. [title] Pour a little bit of body wash onto your damp hands.\\\", '[step] Shower regularly in warm water, and use deodorant or body mist for quicker results. Be sure that you scrub your armpits, the backs of your hands, and the back of your neck, if you have any.', '[step] Showering or bathing daily is one of the easiest and most effective ways to make sure you smell good. Focus on cleansing the areas that are most likely to produce odor such as the armpits, groin, and feet.', \\\"[step] So, a general rule, only shower once a day. If you have lice there's a good chance you'll smell.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}