{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"800c2069-736b-5754-a36f-c01096136d87","task_key":"default--validation--21440","task_revision_id":"1","upstream_id":"21440","short_description":"HellaSwag validation 21440","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to rehydrate skin [title] Use a moisturizing cleanser to wash your face. [step] Use the gentlest, cleanest, and most natural moisturizer you can get your hands on. Things like benzoyl peroxide will dry out your skin, leading to cracks and damage.\",\"endings\":\"['Spritz your face with a generous amount of water, and massage the cleanser into your face using circular motions. Repeat this process throughout the day to get every major irritant out of your skin.', 'Special moisturizers are available by prescription and through mineral or traditional health food stores. [substeps] If you do not have a prescription moisturizer, skip the first step.', \\\"Choose a fragrance-free moisturizer that doesn't have any fragrance in it to help your skin look its most moisturized. [substeps] If you have a rosacea or agoraphobic skin condition, make sure to wash your face regularly.\\\", 'A simple moisturizing cleanser is perfect. [substeps] Avoid fragrances or added chemicals--you just want to clean off.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}