{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1a0d85d6-81d6-58c5-9151-e5cf30f9469c","task_key":"default--validation--15706","task_revision_id":"1","upstream_id":"15706","short_description":"HellaSwag validation 15706","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to get great skin like a celebrity [title] Exfoliate your skin with a mixture of sugar and extra virgin olive oil. [step] That's how christie brinkley stays so youthful; it's like giving yourself a mini microdermabrasion. Jessica biel adds sugar to her regular cleanser when she wants to slough away dead skin.\",\"endings\":\"[\\\"Of course, however, you shouldn't do that daily. Too much sugar will just make your skin look streaky and flaky.\\\", 'Likewise, where bacteria happen, we all contribute to \\\" super \\\" oily skin. [substeps] Honey is also a great extra exfoliant to remove dead skin and let your pores get fresh and exfoliated when you just want to hide your acne.', 'Fill yourself up with the recommended amount of sugar and olive oil, and apply it to your shoulders and neck. Let it sit for 30 minutes, and then rinse the cleanser out of your skin with warm water.', '[title] Nourish your skin the way nicky hilton does : [step] Massage vitamin c into your face. You can buy it in liquid form in most health food stores.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}