{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e5291172-6cb1-5392-aff1-5cc145e20b26","task_key":"default--validation--22464","task_revision_id":"1","upstream_id":"22464","short_description":"HellaSwag validation 22464","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to lessen wrinkles and remove dead skin on your face [title] Prevent wrinkles with a good skin care routine. [step] Keeping your skin clean and healthy will help you stay wrinkle free for as long as possible. You can do this by : [substeps] Washing your face daily with clean water and mild soap that won't dry out your skin.\",\"endings\":\"['Applying an acne-fighting cleanser when you wake up. This will lower bacteria in your skin and reduce dirt.', 'Applying a gentle facial toner or body oil to your face to help keep it smooth and water-free. Using a gentle facial cleanser after washing your face.', 'This will help remove dirt, oil, and dead skin cells which can clog your pores. Moisturize your skin to prevent it from getting dry and itchy.', \\\"Gently pat your face dry with a soft towel. Apply a facial cleanser containing salicylic acid, a gentle cleanser meant for sensitive skin if this isn't your first facial.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}