{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"cafc102a-4ea3-5bd4-8dcf-39f01eb9ea7e","task_key":"default--validation--43467","task_revision_id":"1","upstream_id":"43467","short_description":"HellaSwag validation 43467","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to color your hair without using hair dye [title] Use brewed coffee and conditioner to darken your hair. [step] Place 2 cups (470 ml) of leave-in conditioner into a bowl. Stir in 2 tablespoons (10 g) of coffee grounds and 1 cup (240 ml) of room-temperature brewed coffee.\",\"endings\":\"[\\\"Brew the mixture for 2 minutes until the coffee thickens. [substeps] If you don't have brewed coffee yet, substitute 1-2 teaspoons (10 ml) of powdered coffee grounds.\\\", 'Apply the mixture to your hair, wait 1 hour, then rinse it out with warm water. To help set the color, rinse your hair with apple cider vinegar afterward, then let your hair air dry.', 'The coffee will absorb the dye, creating a hair-blonde shade. [substeps] Coffee grounds will be more likely to dull your hair if you use colored/brewed coffee.', 'You want a very hot surface for the dye to stay on. [substeps] If you want to make your hair lighter by storing the dye on your hair for overnight, add leftover coffee grounds.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}