{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e0df909f-e676-5a33-8971-e225824cb885","task_key":"default--validation--31069","task_revision_id":"1","upstream_id":"31069","short_description":"HellaSwag validation 31069","config":"default","split":"validation","body":"{\"activity_label\":\"Youth\",\"ctx\":\"[header] How to remove acne overnight with ice [title] Make an ice pack. [step] Rather than applying ice directly to your face, it's best to make an ice wrap or an ice pack. If you don't have an existing ice pack, you can easily make one at home.\",\"endings\":\"[\\\"[substeps] Grab as many ice cubes as you'll need to treat the outbreak area. Wrap the ice in a thin, clean towel.\\\", \\\"[substeps] Make sure that you don't use warm, but not hot, water. Cold water will melt your skin and cause scarring.\\\", 'First, wrap a towel around your head and freeze a few ice cubes in place. Next, purchase a craft ice pack, which is often used to treat split skin, and place the top portion of the ice pack over the acne, and use a staff applicator to tightly press the ice into your skin.', '[substeps] Scoop a few ice cubes into a bag of dry ice and place it in a cooler and let it chill. Apply the ice to your face as soon as you wake up.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}