{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a470b724-247d-513e-9d7a-f8e4678a242e","task_key":"default--validation--32260","task_revision_id":"1","upstream_id":"32260","short_description":"HellaSwag validation 32260","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to get clear, smooth skin [title] Pick an appropriate cleanser. [step] Skin can range from dry to oily and in between. When picking out a cleanser, choose one that matches your.\",\"endings\":\"['It will say on the bottle whether it\\\\'s for oily skin, dry skin, combination skin, or all skin types. [substeps] Choose a mild cleanser, such as one that says \\\" for sensitive skin.', '[substeps] Women with oily skin may need to use a bit more than usual to achieve a smooth looking skin. If the type of cleanser you use-over the counter cleansers, for example-are fairly common, the product may not work for you.', \\\"Then, wash it off after 2-3 days. To avoid stripping oils from the skin, opt for a healthy-looking cleanser that's foaming, or ingredients that'll keep the skin looking smooth.\\\", \\\"Whether you're trying to or not, you should go for something that contains salicylic acid and benzoyl peroxide. Ask a dermatologist or skin care specialist for suggestions.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}