{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8c77fc65-22ed-553b-96e2-35bd1dd3f41d","task_key":"default--validation--14758","task_revision_id":"1","upstream_id":"14758","short_description":"HellaSwag validation 14758","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to take care of your skin [title] Wash your face twice daily to keep it oil-free, improve complexion, and prevent breakouts. [step] You should wash your face in the morning when you get up, and in the evening before going to bed. Use lukewarm water and a facial cleanser suitable to your.\",\"endings\":\"['This will help reduce oil production and the chances of breakouts. Your skin needs moisturizer to keep it healthy.', 'You can wash your face with clean hands, a washcloth, or a soft sponge. [substeps] Follow up with some toner and moisturizer.', 'You can also exfoliate with your fingertips. Be careful not to put too much pressure on your face while doing this because oils (e.g., alpha hydroxy acids) are skin irritants.', 'Splash a few drops of essential oils in your hands, and rub your face with them until it is smooth. The odor of the cool water will help to loosen the dead skin, and keep it from spreading.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}