{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"cd0feb11-3292-5a51-bd12-580e309f5ef9","task_key":"default--validation--37489","task_revision_id":"1","upstream_id":"37489","short_description":"HellaSwag validation 37489","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to care for your skin over 40 [title] Cleanse your face twice per day. [step] As skin ages, it becomes more sensitive and loses elasticity. Because of this, extra care must be taken with your daily skincare regimen.\",\"endings\":\"[\\\"Wash your face with lukewarm water once in the morning and once in the evening before bed. Use a mild, gentle cleanser with a creamy consistency, which won't strip your skin of its natural moisture.\\\", \\\"This includes exfoliating for a few minutes after washing your face. You should also exfoliate once every two days or when you're doing some other activities.\\\", 'Excessive use of harsh soap or cleansers can lead to inessential aging in your skin. Use the trial and error approach and make sure to remove any potential wrinkles before beginning your skincare routine.', '[substeps] Use a great pore cleanser and wash your face. Apply some warm/cold water and a facial cleanser that is ingredients like baby cleanser, and follow it with some facial spray.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}