{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9fac747f-f2ef-539b-bc09-63114c1a01e5","task_key":"default--validation--40007","task_revision_id":"1","upstream_id":"40007","short_description":"HellaSwag validation 40007","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to look after your skin [title] Wash your face in the morning and in the evening. [step] Make sure that you use the right facial cleaner for your skin type. For example, if you have oily skin or acne, get something that contains salicylic acid or benzoyl peroxide.\",\"endings\":\"['If you have dry skin, use a gentle, moisturizing, fragrance-free face wash. [title] Avoid using hot water while you bath, and limit your bathing time to 20 minutes.', 'If you have combination skin, find one with a different additive. [substeps] If your normal acne product washes out, make sure you store it in a clean plastic bag inside of a clean container that can be used for cleaning.', 'If you have combination acne, use a mild face cleanser. Apply a soft washcloth wet with warm water and gently scoop and massage the area of your face that has acne.', 'If you do have dark skin, make sure to soak up excess moisture from the face. [substeps] If your skin is oily or acne-prone, then grab a face cleanser made specifically for oily skin.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}