{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"87afac1d-e4ef-560d-9906-2fe51aa0441a","task_key":"default--validation--46926","task_revision_id":"1","upstream_id":"46926","short_description":"HellaSwag validation 46926","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to make a daily hygienic routine (for men ) [title] Floss and brush your teeth. [step] ( mouthwash optional ) [title] Step into the shower. [step] Start by washing and rinsing your hair, then wet your washcloth (not a reusable sponge) and wash your face.\",\"endings\":\"['You can also use a facial wipe, especially in showers that are crusted over. Use a facial moisturizer each to keep your skin soft.', 'Make sure your face is clear of any soap or fats, and that you swish your toothbrush. You can also add a capful of face washing.', 'Make sure your scalp gets clean before attempting to brush, your facial should be clean and good to proceed. If you have clumpy hair, you may need to hold the water or pat your hair dry with a towel.', \\\"This way your pores aren't open when you rinse your hair creating zits from soap. [title] Squeeze a generous amount of body wash on your washcloth and lather all over chest, arms, armpits, genitals, buttocks, legs, and feet last.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}