{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"458b61ca-e67a-5367-8e62-63208c9effcb","task_key":"default--validation--38325","task_revision_id":"1","upstream_id":"38325","short_description":"HellaSwag validation 38325","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to look beautiful in 10 minutes [title] Fake a shower. [step] If you've only got ten minutes, you don't have time to shower, but you do have time to fake it. Quickly wash your face, then wipe your body down with baby wipes to remove any odors.\",\"endings\":\"['Splash some water onto your face, then mix 3 parts antiperspirant and 1 part lotion, and apply your new, healthy smelling \\\" self-tanner \\\" to your skin. Let it sit for a couple of minutes, then remove any tight or overly-revealing clothing.', \\\"Dab a few drops of some baby powder on your fingertips to create a messy feel. ( if you're ever feeling up to it, there are lather and soap or sponge-grain-based facial powders available online.\\\", \\\"Cover your body with lotion to hide any smells and also to moisturize your skin. [substeps] If you're still concerned that you smell, spray a spritz of your favorite perfume into the air, then walk through the spray to allow the scent to settle on your skin.\\\", 'Wipe your skin with a gentle cleanser or soft washcloth, then pat it dry with a towel. [substeps] Warm up by letting your body warm up to a temperature you like, then put on some moisturizer or lotion.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}