{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ecb29068-cd7a-567b-8225-6e7aa8eb56dd","task_key":"default--validation--32141","task_revision_id":"1","upstream_id":"32141","short_description":"HellaSwag validation 32141","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to cure oily skin [title] Use a gentle facial cleanser twice a day. [step] Most dermatologists agree that cleansing the skin is the best way to reduce oil. Make sure to use a gentle, ph balanced cleanser rather than regular soap.\",\"endings\":\"['This will help cut down on the amount of oil you use at every time you take a shower. It will also reduce the likelihood that pores will form, which will reduce your problem.', 'Most soaps are highly alkaline and strip the natural acid mantle from the skin leaving it vulnerable to bacteria. [substeps] Products containing benzoyl peroxide, salicylic acid, glycolic acid, or beta-hydroxy acid are often considered best.', '[substeps] Often, commercial cleansers are advertised as soft and ph clean, which is not good for oily skin. If you take the time to soak in a bubble bath, you can feel the bubbles from the water moving under your skin as you gently exfoliate.', '[substeps] Wash your face once a day with warm water. Lather up and let the cleanser sit in the skin for 15 to 30 minutes.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}