{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"fc4061d9-d605-5fbb-91bd-ccccb19a4685","task_key":"default--validation--220","task_revision_id":"1","upstream_id":"220","short_description":"HellaSwag validation 220","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to do a full body scrub [title] Make a coffee scrub. [step] Coffee grounds are a natural exfoliate and the caffeine can reduce the amount of cellulite in your skin. You can either use fresh ground coffee, or reuse yesterdays coffee grounds.\",\"endings\":\"['To make a high quality coffee scrub, make sure to mix the ground coffee and water in an espresso maker. [substeps] Swap your old coffee grounds for fresh fresh grounds, a blend of coffee grounds, honey, sugar, and baking soda to give your coffee a gritty, an earthy flavor.', \\\"For this recipe you'll need 1 cup of coconut oil , 1/2 cup of sugar , 1/3 cup of coffee grounds, and 2 tbs of olive oil. [substeps] Mix your ingredients in a medium sized bowl and then store in a sealed jar.\\\", 'Good fresh grounds will be unsweetened and high in vitamins and antioxidants. [substeps] Make your own coffee scrub with two tablespoons of ground coffee or simply add ingredients if you want a coarse grind.', 'Grind 1 tablespoon coffee grounds into a paste and spread it over your scalp. Apply it with a washcloth, and rinse it out.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}