{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a3cc0c54-f9c7-5575-b5a7-4de27cc116e9","task_key":"default--validation--36917","task_revision_id":"1","upstream_id":"36917","short_description":"HellaSwag validation 36917","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to fake a nose bleed [title] Make some fake blood. [step] For this particular technique, you'll make a chocolate syrup based blood. By tinting the syrup with red dye and laundry detergent, you can create a brownish-red solution that mimics the appearance of real blood that has been out of the body and exposed to air for an extended period of time.\",\"endings\":\"['The consistency of this blood also makes it easy to smear. [substeps] In a small bowl, mix 2/3 cup (150 ml) chocolate syrup with 1/3 cup (75 ml) concentrated liquid laundry detergent until well combined.', 'You can easily recreate a fake blood spill from a friend. [substeps] Once the dye is absorbed the color will start fading away because sugar (and other matter) in the blood has been replaced by the solid material.', 'This blood will become dark and dribbling blue liquid that resembles blood. Mix this into a mixture of red and green food coloring, and coffee grounds.', \\\"This method will require some assistance from a trained butcher or trauma expert. [substeps] It won't work for everyone.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}