{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a860e0af-eae5-5ff6-8ac0-1070030fb796","task_key":"default--validation--15836--variant-7484ba48ae43","task_revision_id":"1","upstream_id":"15836--variant-7484ba48ae43","short_description":"HellaSwag validation 15836","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to choose moisturizer for oily skin [title] Rule out problematic products. [step] Don't assume you have naturally oily skin just because it appears shinier than you would like. You might just be using the wrong product.\",\"endings\":\"['Search for products with natural ingredients in them that irritate oily skin. [substeps] Avoid products that have harsh chemicals and that use salicylic acid for the base to help moisturize your skin.', \\\"[substeps] It's possible that the moisturizer you are using is too heavy. When you use a product that is too rich for your skin, your pores can't absorb it.\\\", '[title] Use a basic sunscreen over other moisturizing products. [step] A moisturizing product is designed to smooth out the outer layer of your skin, making it look smooth and blemish-free.', 'Instead, you may have found just the right product that is actually causing your skin problem. Read what other people say about your skin to see if you are aware of any other problem.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}