{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"bcaad080-e623-507e-a820-fa7c3e7c91d3","task_key":"default--validation--45400","task_revision_id":"1","upstream_id":"45400","short_description":"HellaSwag validation 45400","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to get naturally plump and sexy lips [title] Exfoliate your lips with a sugar and honey lip scrub. [step] Mix 1 tablespoon of sugar with 1 teaspoon of honey or coconut oil and mix the scrub together. Gently rub the mixture on your lips for 2 to 3 minutes, then rinse it off with water.\",\"endings\":\"['[substeps] White, granulated sugar will be more exfoliating, while brown sugar will be gentler and more suitable to sensitive skin. This will help remove the dead skin that accumulates overtime as well as stimulate circulation in your lips.', '[substeps] Sugar scrubs will be more dry than coconut oil and can further influence the natural taste of your lips. You can use any color or look you like.', 'You can also mix a dash of your favorite lip balm, which is a standard lip fixative. [substeps] Waiting for the sugar and honey to dissolve will help to make your lips look plumper.', \\\"[substeps] Make sure that you rinse your lips well before applying the sugar scrub to them. Pay special attention to your lips after you're trying to plump them.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}