{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0ff068fa-4367-51f0-a450-912933634c4b","task_key":"default--validation--35336","task_revision_id":"1","upstream_id":"35336","short_description":"HellaSwag validation 35336","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to get natural red lips [title] Use a sugar scrub. [step] Dry, dead skin that builds up on your lips can cause them to look paler than they otherwise would. To bring out your natural reddish hue, you need to exfoliate your lips to uncover the fresh skin underneath.\",\"endings\":\"['Apply a sugar scrub or a kit of sugar-exfoliating scrubs to your lips. [substeps] For a natural lip scrub, put the bowl or container with sugar on a plate and stir well, and apply a thin layer to your lips.', 'To exfoliate, use a sugar scrub that has been specially intended for dry skin. You can purchase sugar scrubs at most health food stores, or be able to find a product specifically tailored to dry skin.', 'Create a rough exfoliating scrub by mixing together minced garlic, black pepper, vegetable oil, lemon juice, honey, and a dash of orange zest. Apply this scrub directly to your lips and let it sit for 10 to 20 minutes before rinsing.', \\\"An easy way to do this is by mixing up a homemade lip scrub with ingredients you probably already have on hand. Here's how to do it : [substeps] Mix a teaspoon of sugar and a teaspoon of honey (or olive oil, if you don't have honey available).\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}