{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2aecb5d9-0864-5fb0-abb8-a227ab2f1cd8","task_key":"default--validation--20258","task_revision_id":"1","upstream_id":"20258","short_description":"HellaSwag validation 20258","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to dye hair [title] Wash your hair 24 to 48 hours before dyeing. [step] Doing this allows the natural oils in your hair to develop which in turn allows the dye to bind to your hair more easily. The dye will blend more naturally with your hair, and that tends to make it last longer.\",\"endings\":\"['[title] Get at least two 24-48 hours in the shower before you dye your hair. [step] You want the water to be cool enough for you to touch up the dye, so that you can ease your hair further into color.', '[substeps] For shorter-haired children, you can skip this step and take a shower instead. The smell of floral or avocado breath or the steam of the shower can also stimulate the hair shaft to produce dye.', '[substeps] If possible, avoid conditioner when you wash your hair the day before dyeing it. Conditioner eliminates your natural oils, which you need for the dye to set in more easily.', '[substeps] Running a temperature of cold water over your locks may be gentle enough to avoid strain on your hair while you are dyeing. Try using your fingers or a wide-toothed comb to apply the dye to your hair.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}