{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"66510d93-1d80-5074-ad16-4840a2feca32","task_key":"default--validation--8759--variant-fd2b24be45ea","task_revision_id":"1","upstream_id":"8759--variant-fd2b24be45ea","short_description":"HellaSwag validation 8759","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to make an all natural facial at home [title] Pull back you hair and wear a comfortable t-shirt. [step] You're going to be making and using a scrub, a steam, and a mask. It's best to make sure your hair is out of your face so it doesn't get in your way.\",\"endings\":\"[\\\"[substeps] If you don't want to be bothered, use some water. You don't want your skin to get oily.\\\", 'The steam technique is very important because the smell can cause blackheads and other blemishes. [substeps] To create an all natural facial, wash your hair the day before.', \\\"Put on a comfy t-shirt that you don't mind splattering with different facial products. [title] Use a gentle cleanser to wash your face.\\\", '[substeps] For a less dangerous facial to use at home, you can substitute a chapstick. Use this on the inside flap of your lip.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}